2024-09-12T11:56:29.635 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T11:56:29.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T11:56:29.851 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901705' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGt1rq/wRYe2bbv1yx5C6skoIu4hE70tk6ko1xfIrpoEcbBkc+Z8fdfHAJ459V+yKCV4DQwFDlNyNm+gzjdHQ+s= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5iZKg7xdc7mtOGlrqp35Nze0C31ZRHgBEnI2P8UUR/CVCjda2XiVPP6KNmA0lFZBSIkDEbTcKqqAPfzkI5fFk= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwbLlyCCPVcldgPeLu+XrAaAzSK7b8GTmqlc2EjSNdbNolAR6p2KSJ3yinJyc1nIlhg2JZDvSDX6537QM1Ui2E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T11:56:29.852 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T11:56:29.852 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T11:56:29.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T11:56:29.854 INFO:teuthology.task.internal:Checking packages... 2024-09-12T11:56:29.884 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T11:56:29.884 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T11:56:29.884 INFO:teuthology.packaging:ref: None 2024-09-12T11:56:29.885 INFO:teuthology.packaging:tag: None 2024-09-12T11:56:29.885 INFO:teuthology.packaging:branch: squid 2024-09-12T11:56:29.885 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T11:56:29.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T11:56:30.137 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T11:56:30.138 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T11:56:30.153 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T11:56:30.153 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T11:56:30.159 INFO:teuthology.task.internal:Saving configuration 2024-09-12T11:56:30.185 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T11:56:30.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T11:56:30.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:51:19.232888', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGt1rq/wRYe2bbv1yx5C6skoIu4hE70tk6ko1xfIrpoEcbBkc+Z8fdfHAJ459V+yKCV4DQwFDlNyNm+gzjdHQ+s='} 2024-09-12T11:56:30.264 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:51:19.234234', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5iZKg7xdc7mtOGlrqp35Nze0C31ZRHgBEnI2P8UUR/CVCjda2XiVPP6KNmA0lFZBSIkDEbTcKqqAPfzkI5fFk='} 2024-09-12T11:56:30.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 11:51:19.235393', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwbLlyCCPVcldgPeLu+XrAaAzSK7b8GTmqlc2EjSNdbNolAR6p2KSJ3yinJyc1nIlhg2JZDvSDX6537QM1Ui2E='} 2024-09-12T11:56:30.292 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T11:56:30.305 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T11:56:30.305 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T11:56:30.305 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T11:56:30.305 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T11:56:30.414 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc452e8430>, signals=[15]) 2024-09-12T11:56:30.414 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T11:56:30.423 INFO:teuthology.task.internal:Opening connections... 2024-09-12T11:56:30.423 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T11:56:30.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:56:30.513 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T11:56:30.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:56:30.602 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-09-12T11:56:30.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:56:30.686 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T11:56:30.692 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-12T11:56:30.710 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-12T11:56:30.710 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T11:56:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-12T11:56:30.770 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-12T11:56:30.770 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T11:56:30.770 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-12T11:56:30.770 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T11:56:30.770 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T11:56:30.770 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T11:56:30.771 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-12T11:56:30.806 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-12T11:56:30.825 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-12T11:56:30.825 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-12T11:56:30.883 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-12T11:56:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T11:56:30.885 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T11:56:30.885 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T11:56:30.885 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-12T11:56:30.915 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-09-12T11:56:30.934 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-09-12T11:56:30.934 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-09-12T11:56:30.992 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-09-12T11:56:30.992 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-09-12T11:56:30.992 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-09-12T11:56:30.992 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-09-12T11:56:30.992 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T11:56:30.993 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T11:56:30.993 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-09-12T11:56:31.023 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T11:56:31.032 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T11:56:31.046 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T11:56:31.047 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-12T11:56:31.049 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-12T11:56:31.052 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-09-12T11:56:31.068 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T11:56:31.074 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T11:56:31.074 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-12T11:56:31.107 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-12T11:56:31.109 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-09-12T11:56:31.220 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T11:56:31.323 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T11:56:31.338 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T11:56:31.339 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-12T11:56:31.339 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-12T11:56:31.339 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T11:56:31.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T11:56:31.357 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-12T11:56:31.417 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-12T11:56:31.418 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-12T11:56:31.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-12T11:56:33.926 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T11:56:55.050 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:20 2024-09-12T11:56:59.625 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.5 MB 00:00 2024-09-12T11:57:01.234 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-12T11:57:02.005 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T11:57:07.395 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-12T11:57:09.451 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T11:57:09.452 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T11:57:09.557 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T11:57:09.570 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-12T11:57:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-12T11:57:09.855 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 157 kB/s | 23 kB 00:00 2024-09-12T11:57:15.138 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.4 MB/s | 29 MB 00:05 2024-09-12T11:57:15.671 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.6 MB/s | 16 MB 00:05 2024-09-12T11:57:16.663 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.0 MB/s | 35 MB 00:06 2024-09-12T11:57:16.663 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-12T11:57:16.664 INFO:teuthology.orchestra.run.smithi081.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-12T11:57:17.341 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-12T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-12T11:57:17.694 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-12T11:57:18.661 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-12T11:57:18.662 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-12T11:57:21.132 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-12T11:57:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T11:57:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T11:57:24.733 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T11:57:24.869 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T11:57:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T11:57:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T11:57:34.615 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T11:58:12.938 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T11:58:12.983 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T11:58:13.365 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T11:58:13.366 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T11:58:13.366 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T11:58:13.366 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T11:58:14.228 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T11:58:14.229 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-12T11:58:14.556 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T11:58:14.635 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T11:58:14.636 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T11:58:14.636 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T11:58:14.636 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T11:58:14.636 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T11:58:14.636 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T11:58:14.637 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T11:58:14.637 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T11:58:14.695 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T11:58:14.695 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T11:58:14.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-12T11:58:14.727 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T11:58:14.728 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T11:58:14.729 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T11:58:14.729 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-12T11:58:14.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T11:58:14.729 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T11:58:14.730 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T11:58:14.730 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-505.el9.x86_64 2024-09-12T11:58:14.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T11:58:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-12T11:58:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T11:58:16.725 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-12T11:58:16.732 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-12T11:58:16.748 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.xVfrLsgF3g 2024-09-12T11:58:16.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xVfrLsgF3g 2024-09-12T11:58:16.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.xVfrLsgF3g 2024-09-12T11:58:16.959 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.xVfrLsgF3g is 6KB 2024-09-12T11:58:17.008 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.xVfrLsgF3g 2024-09-12T11:58:17.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T11:58:17.096 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T11:58:17.096 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T11:58:17.096 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T11:58:17.096 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T11:58:17.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T11:58:17.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-12T11:58:47.277 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T11:58:47.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T11:58:47.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T11:59:47.289 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T11:59:56.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T11:59:56.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:00:00.361 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-12T12:00:00.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T12:00:00.827 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T12:00:00.827 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-12T12:00:00.842 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-505.el9.x86_64 2024-09-12T12:00:00.842 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T12:00:00.842 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T12:00:00.842 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T12:00:01.843 DEBUG:teuthology.parallel:result is None 2024-09-12T12:00:01.843 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T12:00:01.851 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T12:00:01.852 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:00:01.854 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:00:01.856 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T12:00:01.875 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T12:00:02.020 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T12:00:02.028 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T12:00:02.028 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:00:02.031 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:00:02.033 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T12:00:02.082 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T12:00:02.089 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T12:00:02.089 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:00:02.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:00:02.119 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T12:00:02.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:00:02.137 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:00:02.139 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:00:02.162 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T12:00:02.210 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:02.227 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:02.230 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:02.232 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:02.246 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:02.283 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T12:00:02.284 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T12:00:02.291 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T12:00:02.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:00:02.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:00:02.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T12:00:02.324 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T12:00:02.333 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T12:00:02.333 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:00:02.359 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:00:02.364 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T12:00:02.382 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:02.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:02.504 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:02.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:02.627 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:00:02.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:00:02.702 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:02.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:02.801 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:02.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:02.928 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:00:02.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:00:02.995 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:03.050 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T12:00:03.095 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:03.198 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T12:00:03.227 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:00:03.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T12:00:03.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-12T12:00:03.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-12T12:00:03.301 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-09-12T12:00:03.342 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:00:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:00:03.379 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:00:03.732 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T12:00:03.743 INFO:teuthology.task.internal:Starting timer... 2024-09-12T12:00:03.743 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T12:00:03.800 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T12:00:03.827 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T12:00:03.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-12T12:00:03.879 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-12T12:00:03.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-12T12:00:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-12T12:00:03.945 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-09-12T12:00:03.993 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-09-12T12:00:03.995 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T12:00:03.996 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-12T12:00:04.014 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-12T12:00:04.014 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-12T12:00:04.041 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-12T12:00:04.041 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-09-12T12:00:04.064 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-09-12T12:00:04.065 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-09-12T12:00:04.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:00:04.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:00:04.092 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:00:04.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:00:04.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:00:04.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:00:04.150 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T12:00:04.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:00:04.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:00:04.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-09-12T12:00:04.253 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T12:00:04.339 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T12:00:04.342 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T12:00:04.523 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T12:00:04.535 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T12:00:04.536 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi103.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T12:04:08.167 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-09-12T12:04:08.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T12:04:08.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:04:08.271 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-12T12:04:08.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-12T12:04:08.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T12:04:08.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:04:08.435 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-12T12:04:08.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T12:04:08.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-12T12:04:08.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T12:04:08.597 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-09-12T12:04:08.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-09-12T12:04:08.635 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T12:04:08.648 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T12:04:08.648 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:04:08.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:04:08.651 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:04:08.652 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:04:08.654 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T12:04:08.654 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:04:08.682 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:04:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:04:08.697 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:04:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:04:08.704 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T12:04:08.719 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T12:04:08.721 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-12T12:04:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-12T12:04:08.732 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-12T12:04:08.735 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-12T12:04:08.744 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-09-12T12:04:08.746 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:04:08.750 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:04:08.755 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-09-12T12:04:08.760 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:04:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:04:08.770 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T12:04:08.785 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T12:04:08.817 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:04:08.820 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:04:08.821 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:04:08.821 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-12T12:04:08.821 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.821 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.821 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.822 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.824 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:04:08.824 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-12T12:04:08.824 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.824 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.824 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.824 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.848 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:04:08.852 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:04:08.852 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-12T12:04:08.852 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.852 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.853 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.853 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:04:08.853 INFO:teuthology.run_tasks:Running task install... 2024-09-12T12:04:08.861 DEBUG:teuthology.task.install:project ceph 2024-09-12T12:04:08.861 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T12:04:08.861 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T12:04:08.861 INFO:teuthology.task.install:Using flavor: default 2024-09-12T12:04:08.866 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T12:04:08.867 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T12:04:08.867 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:04:08.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:04:08.869 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:04:08.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:04:08.870 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T12:04:08.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:04:09.024 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:04:09.024 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:04:09.037 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:04:09.037 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:04:09.049 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T12:04:09.049 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T12:04:09.146 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:04:09.146 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:04:09.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:04:09.158 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:04:09.158 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:04:09.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:04:09.167 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T12:04:09.167 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:04:09.167 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T12:04:09.171 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:04:09.172 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:04:09.184 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:04:09.184 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:04:09.192 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T12:04:09.192 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T12:04:09.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:04:09.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:04:09.258 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T12:04:09.312 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:04:09.325 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:04:09.333 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T12:04:09.376 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-12T12:04:09.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-12T12:04:09.389 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-12T12:04:09.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-12T12:04:09.398 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-09-12T12:04:09.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-09-12T12:04:09.617 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-12T12:04:09.619 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-12T12:04:09.624 INFO:teuthology.orchestra.run.smithi173.stdout:45 files removed 2024-09-12T12:04:09.645 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:04:09.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:04:09.651 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T12:04:10.178 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-09-12T12:04:10.199 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-12T12:04:10.214 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-12T12:04:10.462 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-12T12:04:10.475 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-12T12:04:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 53 kB/s | 12 kB 00:00 2024-09-12T12:04:10.737 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T12:04:10.740 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-12T12:04:10.742 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-12T12:04:11.279 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-12T12:04:12.417 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-12T12:04:12.432 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-12T12:04:13.372 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T12:04:14.085 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-12T12:04:16.558 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 20 MB 00:03 2024-09-12T12:04:19.290 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-12T12:04:20.352 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-12T12:04:20.758 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-12T12:04:21.034 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-12T12:04:21.629 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T12:04:22.012 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-12T12:04:22.551 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-12T12:04:22.766 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T12:04:23.305 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T12:04:27.351 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 4.8 kB/s | 1.7 kB 00:00 2024-09-12T12:04:28.222 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T12:04:28.737 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-12T12:04:29.587 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:04:29.588 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:04:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:04:29.600 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:04:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:04:29.601 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:04:29.603 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:04:29.605 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:04:29.606 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:04:29.668 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-12T12:04:29.688 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:04:29.689 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:04:29.690 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:04:29.691 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:04:29.692 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:04:29.693 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:04:29.694 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:04:29.695 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:04:29.696 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:04:29.697 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:04:29.698 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:04:29.699 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:04:29.700 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout:====================================================================================== 2024-09-12T12:04:29.701 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-09-12T12:04:29.702 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 8 Packages 2024-09-12T12:04:29.702 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:04:29.702 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 226 M 2024-09-12T12:04:29.702 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-12T12:04:30.178 INFO:teuthology.orchestra.run.smithi103.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-12T12:04:30.379 INFO:teuthology.orchestra.run.smithi103.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.4 MB/s | 897 kB 00:00 2024-09-12T12:04:30.487 INFO:teuthology.orchestra.run.smithi103.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.3 MB/s | 145 kB 00:00 2024-09-12T12:04:30.517 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:04:30.518 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:04:30.531 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:04:30.531 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:04:30.532 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:04:30.534 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:04:30.535 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:04:30.538 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:04:30.539 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:04:30.586 INFO:teuthology.orchestra.run.smithi103.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-12T12:04:30.602 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-09-12T12:04:30.617 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-12T12:04:30.617 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-09-12T12:04:30.617 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-12T12:04:30.617 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:04:30.618 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:04:30.619 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:04:30.620 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:04:30.621 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:04:30.622 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:04:30.623 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:04:30.624 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:04:30.625 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:04:30.626 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:04:30.627 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:04:30.628 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:04:30.629 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:04:30.630 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:Install 148 Packages 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 8 Packages 2024-09-12T12:04:30.631 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:04:30.632 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 226 M 2024-09-12T12:04:30.632 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-09-12T12:04:30.688 INFO:teuthology.orchestra.run.smithi103.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 1.5 MB 00:00 2024-09-12T12:04:30.739 INFO:teuthology.orchestra.run.smithi103.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-12T12:04:30.922 INFO:teuthology.orchestra.run.smithi103.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 4.7 MB 00:00 2024-09-12T12:04:31.047 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:04:31.048 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T12:04:31.059 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T12:04:31.059 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T12:04:31.060 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T12:04:31.061 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T12:04:31.063 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T12:04:31.065 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T12:04:31.066 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T12:04:31.129 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-12T12:04:31.147 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-12T12:04:31.147 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T12:04:31.148 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T12:04:31.149 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T12:04:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T12:04:31.151 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T12:04:31.152 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T12:04:31.153 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T12:04:31.154 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T12:04:31.155 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T12:04:31.156 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T12:04:31.157 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T12:04:31.158 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T12:04:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-12T12:04:31.160 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:04:31.161 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 226 M 2024-09-12T12:04:31.161 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-12T12:04:31.247 INFO:teuthology.orchestra.run.smithi103.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-12T12:04:31.265 INFO:teuthology.orchestra.run.smithi173.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-09-12T12:04:31.289 INFO:teuthology.orchestra.run.smithi103.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 607 kB/s | 25 kB 00:00 2024-09-12T12:04:31.481 INFO:teuthology.orchestra.run.smithi103.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 19 MB/s | 11 MB 00:00 2024-09-12T12:04:31.548 INFO:teuthology.orchestra.run.smithi103.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 228 kB 00:00 2024-09-12T12:04:31.615 INFO:teuthology.orchestra.run.smithi103.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 406 kB/s | 27 kB 00:00 2024-09-12T12:04:31.740 INFO:teuthology.orchestra.run.smithi173.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.8 MB/s | 897 kB 00:00 2024-09-12T12:04:31.780 INFO:teuthology.orchestra.run.smithi081.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T12:04:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:(13/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T12:04:31.815 INFO:teuthology.orchestra.run.smithi173.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.9 MB/s | 145 kB 00:00 2024-09-12T12:04:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 158 kB/s | 32 kB 00:00 2024-09-12T12:04:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-12T12:04:31.883 INFO:teuthology.orchestra.run.smithi103.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T12:04:31.916 INFO:teuthology.orchestra.run.smithi103.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T12:04:31.967 INFO:teuthology.orchestra.run.smithi103.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.9 MB/s | 506 kB 00:00 2024-09-12T12:04:32.059 INFO:teuthology.orchestra.run.smithi103.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 493 kB/s | 45 kB 00:00 2024-09-12T12:04:32.168 INFO:teuthology.orchestra.run.smithi103.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.2 MB/s | 136 kB 00:00 2024-09-12T12:04:32.240 INFO:teuthology.orchestra.run.smithi173.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.8 MB/s | 5.4 MB 00:01 2024-09-12T12:04:32.251 INFO:teuthology.orchestra.run.smithi103.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-12T12:04:32.276 INFO:teuthology.orchestra.run.smithi103.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 162 kB 00:00 2024-09-12T12:04:32.288 INFO:teuthology.orchestra.run.smithi081.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 897 kB 00:00 2024-09-12T12:04:32.320 INFO:teuthology.orchestra.run.smithi103.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 4.7 MB/s | 321 kB 00:00 2024-09-12T12:04:32.352 INFO:teuthology.orchestra.run.smithi103.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.9 MB/s | 301 kB 00:00 2024-09-12T12:04:32.396 INFO:teuthology.orchestra.run.smithi081.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.3 MB/s | 145 kB 00:00 2024-09-12T12:04:32.403 INFO:teuthology.orchestra.run.smithi103.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-12T12:04:32.428 INFO:teuthology.orchestra.run.smithi103.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T12:04:32.449 INFO:teuthology.orchestra.run.smithi173.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-12T12:04:32.520 INFO:teuthology.orchestra.run.smithi103.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-12T12:04:32.566 INFO:teuthology.orchestra.run.smithi173.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 3.2 MB/s | 2.4 MB 00:00 2024-09-12T12:04:32.612 INFO:teuthology.orchestra.run.smithi103.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 348 kB/s | 32 kB 00:00 2024-09-12T12:04:32.687 INFO:teuthology.orchestra.run.smithi103.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.9 MB/s | 146 kB 00:00 2024-09-12T12:04:32.963 INFO:teuthology.orchestra.run.smithi103.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.5 MB/s | 3.1 MB 00:00 2024-09-12T12:04:33.030 INFO:teuthology.orchestra.run.smithi103.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 10 MB/s | 3.6 MB 00:00 2024-09-12T12:04:33.080 INFO:teuthology.orchestra.run.smithi081.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 3.8 MB/s | 5.4 MB 00:01 2024-09-12T12:04:33.122 INFO:teuthology.orchestra.run.smithi103.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.7 MB/s | 249 kB 00:00 2024-09-12T12:04:33.174 INFO:teuthology.orchestra.run.smithi173.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 6.5 MB/s | 4.7 MB 00:00 2024-09-12T12:04:33.189 INFO:teuthology.orchestra.run.smithi103.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 740 kB/s | 49 kB 00:00 2024-09-12T12:04:33.272 INFO:teuthology.orchestra.run.smithi103.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 197 kB/s | 16 kB 00:00 2024-09-12T12:04:33.288 INFO:teuthology.orchestra.run.smithi081.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-09-12T12:04:33.398 INFO:teuthology.orchestra.run.smithi103.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-12T12:04:33.431 INFO:teuthology.orchestra.run.smithi103.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 1.8 MB/s | 285 kB 00:00 2024-09-12T12:04:33.482 INFO:teuthology.orchestra.run.smithi103.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-12T12:04:33.506 INFO:teuthology.orchestra.run.smithi081.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-09-12T12:04:33.515 INFO:teuthology.orchestra.run.smithi103.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 217 kB/s | 18 kB 00:00 2024-09-12T12:04:33.649 INFO:teuthology.orchestra.run.smithi103.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-12T12:04:33.758 INFO:teuthology.orchestra.run.smithi103.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-12T12:04:33.825 INFO:teuthology.orchestra.run.smithi103.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-12T12:04:33.850 INFO:teuthology.orchestra.run.smithi103.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-12T12:04:33.900 INFO:teuthology.orchestra.run.smithi103.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T12:04:33.959 INFO:teuthology.orchestra.run.smithi103.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T12:04:34.017 INFO:teuthology.orchestra.run.smithi103.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T12:04:34.056 INFO:teuthology.orchestra.run.smithi081.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 6.1 MB/s | 4.7 MB 00:00 2024-09-12T12:04:34.076 INFO:teuthology.orchestra.run.smithi103.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T12:04:34.200 INFO:teuthology.orchestra.run.smithi173.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 6.9 MB/s | 21 MB 00:03 2024-09-12T12:04:34.226 INFO:teuthology.orchestra.run.smithi103.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-12T12:04:34.260 INFO:teuthology.orchestra.run.smithi103.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-12T12:04:34.266 INFO:teuthology.orchestra.run.smithi173.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 379 kB/s | 25 kB 00:00 2024-09-12T12:04:34.361 INFO:teuthology.orchestra.run.smithi103.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-12T12:04:34.433 INFO:teuthology.orchestra.run.smithi173.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 8.4 MB/s | 11 MB 00:01 2024-09-12T12:04:34.453 INFO:teuthology.orchestra.run.smithi103.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 237 kB/s | 22 kB 00:00 2024-09-12T12:04:34.509 INFO:teuthology.orchestra.run.smithi173.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.0 MB/s | 228 kB 00:00 2024-09-12T12:04:34.536 INFO:teuthology.orchestra.run.smithi103.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-12T12:04:34.562 INFO:teuthology.orchestra.run.smithi103.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-12T12:04:34.584 INFO:teuthology.orchestra.run.smithi173.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 361 kB/s | 27 kB 00:00 2024-09-12T12:04:34.604 INFO:teuthology.orchestra.run.smithi103.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-12T12:04:34.659 INFO:teuthology.orchestra.run.smithi173.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 422 kB/s | 32 kB 00:00 2024-09-12T12:04:34.784 INFO:teuthology.orchestra.run.smithi173.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 5.9 MB/s | 752 kB 00:00 2024-09-12T12:04:34.843 INFO:teuthology.orchestra.run.smithi173.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T12:04:34.864 INFO:teuthology.orchestra.run.smithi081.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 13 MB/s | 11 MB 00:00 2024-09-12T12:04:34.902 INFO:teuthology.orchestra.run.smithi173.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T12:04:34.914 INFO:teuthology.orchestra.run.smithi081.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-12T12:04:35.002 INFO:teuthology.orchestra.run.smithi173.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.0 MB/s | 506 kB 00:00 2024-09-12T12:04:35.104 INFO:teuthology.orchestra.run.smithi103.stdout:(54/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 13 MB/s | 49 MB 00:03 2024-09-12T12:04:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-12T12:04:35.188 INFO:teuthology.orchestra.run.smithi103.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-12T12:04:35.213 INFO:teuthology.orchestra.run.smithi103.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-12T12:04:35.230 INFO:teuthology.orchestra.run.smithi103.stdout:(58/156): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-09-12T12:04:35.264 INFO:teuthology.orchestra.run.smithi103.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-12T12:04:35.339 INFO:teuthology.orchestra.run.smithi103.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-12T12:04:35.365 INFO:teuthology.orchestra.run.smithi103.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T12:04:35.415 INFO:teuthology.orchestra.run.smithi103.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-12T12:04:35.454 INFO:teuthology.orchestra.run.smithi103.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 415 kB/s | 47 kB 00:00 2024-09-12T12:04:35.479 INFO:teuthology.orchestra.run.smithi103.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-09-12T12:04:35.490 INFO:teuthology.orchestra.run.smithi081.stdout:(10/156): ceph-common-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 21 MB 00:03 2024-09-12T12:04:35.504 INFO:teuthology.orchestra.run.smithi103.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.1 MB/s | 188 kB 00:00 2024-09-12T12:04:35.530 INFO:teuthology.orchestra.run.smithi103.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-12T12:04:35.540 INFO:teuthology.orchestra.run.smithi081.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T12:04:35.560 INFO:teuthology.orchestra.run.smithi173.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 9.6 MB/s | 5.3 MB 00:00 2024-09-12T12:04:35.615 INFO:teuthology.orchestra.run.smithi081.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 360 kB/s | 27 kB 00:00 2024-09-12T12:04:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 677 kB/s | 45 kB 00:00 2024-09-12T12:04:35.647 INFO:teuthology.orchestra.run.smithi103.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-12T12:04:35.690 INFO:teuthology.orchestra.run.smithi081.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 424 kB/s | 32 kB 00:00 2024-09-12T12:04:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T12:04:35.714 INFO:teuthology.orchestra.run.smithi103.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-12T12:04:35.747 INFO:teuthology.orchestra.run.smithi103.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-12T12:04:35.794 INFO:teuthology.orchestra.run.smithi173.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-12T12:04:35.797 INFO:teuthology.orchestra.run.smithi103.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T12:04:35.886 INFO:teuthology.orchestra.run.smithi173.stdout:(22/156): python3-rados-19.1.1-298.gb53b6d3e.el 3.4 MB/s | 321 kB 00:00 2024-09-12T12:04:35.898 INFO:teuthology.orchestra.run.smithi103.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-09-12T12:04:35.907 INFO:teuthology.orchestra.run.smithi081.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 3.4 MB/s | 752 kB 00:00 2024-09-12T12:04:35.965 INFO:teuthology.orchestra.run.smithi103.stdout:(72/156): openblas-openmp-0.3.26-2.el9.x86_64.r 10 MB/s | 4.9 MB 00:00 2024-09-12T12:04:35.970 INFO:teuthology.orchestra.run.smithi173.stdout:(23/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.5 MB/s | 301 kB 00:00 2024-09-12T12:04:35.990 INFO:teuthology.orchestra.run.smithi103.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 953 kB/s | 87 kB 00:00 2024-09-12T12:04:36.008 INFO:teuthology.orchestra.run.smithi081.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.6 MB/s | 163 kB 00:00 2024-09-12T12:04:36.024 INFO:teuthology.orchestra.run.smithi103.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-12T12:04:36.082 INFO:teuthology.orchestra.run.smithi103.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 666 kB/s | 61 kB 00:00 2024-09-12T12:04:36.108 INFO:teuthology.orchestra.run.smithi081.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.2 MB/s | 127 kB 00:00 2024-09-12T12:04:36.116 INFO:teuthology.orchestra.run.smithi103.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-12T12:04:36.158 INFO:teuthology.orchestra.run.smithi103.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-12T12:04:36.170 INFO:teuthology.orchestra.run.smithi173.stdout:(24/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 4.7 MB/s | 17 MB 00:03 2024-09-12T12:04:36.192 INFO:teuthology.orchestra.run.smithi103.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-12T12:04:36.195 INFO:teuthology.orchestra.run.smithi173.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 442 kB/s | 100 kB 00:00 2024-09-12T12:04:36.217 INFO:teuthology.orchestra.run.smithi103.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-12T12:04:36.262 INFO:teuthology.orchestra.run.smithi173.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 930 kB/s | 85 kB 00:00 2024-09-12T12:04:36.293 INFO:teuthology.orchestra.run.smithi103.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-12T12:04:36.318 INFO:teuthology.orchestra.run.smithi103.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-12T12:04:36.346 INFO:teuthology.orchestra.run.smithi173.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-12T12:04:36.375 INFO:teuthology.orchestra.run.smithi081.stdout:(17/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 5.9 MB/s | 17 MB 00:02 2024-09-12T12:04:36.396 INFO:teuthology.orchestra.run.smithi173.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 637 kB/s | 32 kB 00:00 2024-09-12T12:04:36.400 INFO:teuthology.orchestra.run.smithi081.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 1.7 MB/s | 506 kB 00:00 2024-09-12T12:04:36.410 INFO:teuthology.orchestra.run.smithi103.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-12T12:04:36.435 INFO:teuthology.orchestra.run.smithi103.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T12:04:36.455 INFO:teuthology.orchestra.run.smithi173.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.5 MB/s | 146 kB 00:00 2024-09-12T12:04:36.459 INFO:teuthology.orchestra.run.smithi081.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 773 kB/s | 45 kB 00:00 2024-09-12T12:04:36.535 INFO:teuthology.orchestra.run.smithi103.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-09-12T12:04:36.538 INFO:teuthology.orchestra.run.smithi173.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 9.1 MB/s | 3.1 MB 00:00 2024-09-12T12:04:36.560 INFO:teuthology.orchestra.run.smithi103.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 617 kB/s | 77 kB 00:00 2024-09-12T12:04:36.568 INFO:teuthology.orchestra.run.smithi081.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.2 MB/s | 136 kB 00:00 2024-09-12T12:04:36.586 INFO:teuthology.orchestra.run.smithi103.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-09-12T12:04:36.612 INFO:teuthology.orchestra.run.smithi103.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 560 kB/s | 42 kB 00:00 2024-09-12T12:04:36.637 INFO:teuthology.orchestra.run.smithi103.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-12T12:04:36.662 INFO:teuthology.orchestra.run.smithi103.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T12:04:36.696 INFO:teuthology.orchestra.run.smithi103.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 279 kB 00:00 2024-09-12T12:04:36.723 INFO:teuthology.orchestra.run.smithi103.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 606 kB/s | 51 kB 00:00 2024-09-12T12:04:36.746 INFO:teuthology.orchestra.run.smithi103.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 638 kB/s | 54 kB 00:00 2024-09-12T12:04:36.797 INFO:teuthology.orchestra.run.smithi103.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 553 kB/s | 42 kB 00:00 2024-09-12T12:04:36.822 INFO:teuthology.orchestra.run.smithi103.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 585 kB/s | 44 kB 00:00 2024-09-12T12:04:36.864 INFO:teuthology.orchestra.run.smithi103.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-12T12:04:36.906 INFO:teuthology.orchestra.run.smithi103.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-09-12T12:04:36.931 INFO:teuthology.orchestra.run.smithi103.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-12T12:04:36.980 INFO:teuthology.orchestra.run.smithi173.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.8 MB/s | 3.6 MB 00:00 2024-09-12T12:04:36.998 INFO:teuthology.orchestra.run.smithi103.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-12T12:04:37.023 INFO:teuthology.orchestra.run.smithi103.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 628 kB/s | 58 kB 00:00 2024-09-12T12:04:37.026 INFO:teuthology.orchestra.run.smithi081.stdout:(21/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-12T12:04:37.030 INFO:teuthology.orchestra.run.smithi173.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T12:04:37.051 INFO:teuthology.orchestra.run.smithi081.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 335 kB/s | 162 kB 00:00 2024-09-12T12:04:37.065 INFO:teuthology.orchestra.run.smithi103.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T12:04:37.077 INFO:teuthology.orchestra.run.smithi081.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T12:04:37.099 INFO:teuthology.orchestra.run.smithi103.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-12T12:04:37.119 INFO:teuthology.orchestra.run.smithi081.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T12:04:37.122 INFO:teuthology.orchestra.run.smithi173.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-12T12:04:37.141 INFO:teuthology.orchestra.run.smithi103.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-09-12T12:04:37.144 INFO:teuthology.orchestra.run.smithi081.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.5 MB/s | 100 kB 00:00 2024-09-12T12:04:37.148 INFO:teuthology.orchestra.run.smithi173.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 421 kB/s | 49 kB 00:00 2024-09-12T12:04:37.169 INFO:teuthology.orchestra.run.smithi081.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T12:04:37.181 INFO:teuthology.orchestra.run.smithi173.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 281 kB/s | 16 kB 00:00 2024-09-12T12:04:37.191 INFO:teuthology.orchestra.run.smithi103.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-12T12:04:37.273 INFO:teuthology.orchestra.run.smithi173.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.2 MB/s | 285 kB 00:00 2024-09-12T12:04:37.286 INFO:teuthology.orchestra.run.smithi081.stdout:(27/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 5.9 MB/s | 5.3 MB 00:00 2024-09-12T12:04:37.311 INFO:teuthology.orchestra.run.smithi081.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.2 MB/s | 171 kB 00:00 2024-09-12T12:04:37.315 INFO:teuthology.orchestra.run.smithi173.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-12T12:04:37.337 INFO:teuthology.orchestra.run.smithi081.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 635 kB/s | 32 kB 00:00 2024-09-12T12:04:37.341 INFO:teuthology.orchestra.run.smithi173.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 271 kB/s | 18 kB 00:00 2024-09-12T12:04:37.359 INFO:teuthology.orchestra.run.smithi103.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-09-12T12:04:37.362 INFO:teuthology.orchestra.run.smithi081.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T12:04:37.400 INFO:teuthology.orchestra.run.smithi103.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-09-12T12:04:37.421 INFO:teuthology.orchestra.run.smithi081.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-12T12:04:37.426 INFO:teuthology.orchestra.run.smithi103.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 840 kB/s | 19 kB 00:00 2024-09-12T12:04:37.468 INFO:teuthology.orchestra.run.smithi103.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-12T12:04:37.471 INFO:teuthology.orchestra.run.smithi081.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.9 MB/s | 249 kB 00:00 2024-09-12T12:04:37.493 INFO:teuthology.orchestra.run.smithi103.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T12:04:37.518 INFO:teuthology.orchestra.run.smithi103.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T12:04:37.521 INFO:teuthology.orchestra.run.smithi081.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 988 kB/s | 49 kB 00:00 2024-09-12T12:04:37.543 INFO:teuthology.orchestra.run.smithi103.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T12:04:37.569 INFO:teuthology.orchestra.run.smithi103.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T12:04:37.588 INFO:teuthology.orchestra.run.smithi081.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 247 kB/s | 16 kB 00:00 2024-09-12T12:04:37.602 INFO:teuthology.orchestra.run.smithi103.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-12T12:04:37.647 INFO:teuthology.orchestra.run.smithi081.stdout:(35/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-12T12:04:37.653 INFO:teuthology.orchestra.run.smithi103.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-12T12:04:37.686 INFO:teuthology.orchestra.run.smithi103.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-12T12:04:37.711 INFO:teuthology.orchestra.run.smithi103.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T12:04:37.730 INFO:teuthology.orchestra.run.smithi081.stdout:(36/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 9.1 MB/s | 3.6 MB 00:00 2024-09-12T12:04:37.737 INFO:teuthology.orchestra.run.smithi103.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-12T12:04:37.764 INFO:teuthology.orchestra.run.smithi081.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-12T12:04:37.781 INFO:teuthology.orchestra.run.smithi081.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 366 kB/s | 18 kB 00:00 2024-09-12T12:04:37.796 INFO:teuthology.orchestra.run.smithi103.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-09-12T12:04:37.821 INFO:teuthology.orchestra.run.smithi103.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-12T12:04:37.855 INFO:teuthology.orchestra.run.smithi103.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T12:04:37.880 INFO:teuthology.orchestra.run.smithi103.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-12T12:04:37.914 INFO:teuthology.orchestra.run.smithi103.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T12:04:37.947 INFO:teuthology.orchestra.run.smithi103.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T12:04:37.973 INFO:teuthology.orchestra.run.smithi103.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T12:04:37.990 INFO:teuthology.orchestra.run.smithi103.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.1 MB/s | 18 kB 00:00 2024-09-12T12:04:38.015 INFO:teuthology.orchestra.run.smithi103.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-12T12:04:38.039 INFO:teuthology.orchestra.run.smithi081.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-12T12:04:38.040 INFO:teuthology.orchestra.run.smithi103.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-12T12:04:38.066 INFO:teuthology.orchestra.run.smithi103.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-12T12:04:38.141 INFO:teuthology.orchestra.run.smithi103.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-09-12T12:04:38.166 INFO:teuthology.orchestra.run.smithi103.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T12:04:38.200 INFO:teuthology.orchestra.run.smithi103.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-12T12:04:38.233 INFO:teuthology.orchestra.run.smithi173.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 12 MB/s | 49 MB 00:03 2024-09-12T12:04:38.239 INFO:teuthology.orchestra.run.smithi081.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 168 kB/s | 80 kB 00:00 2024-09-12T12:04:38.250 INFO:teuthology.orchestra.run.smithi103.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-12T12:04:38.275 INFO:teuthology.orchestra.run.smithi103.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 770 kB/s | 58 kB 00:00 2024-09-12T12:04:38.309 INFO:teuthology.orchestra.run.smithi103.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-12T12:04:38.334 INFO:teuthology.orchestra.run.smithi103.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-12T12:04:38.396 INFO:teuthology.orchestra.run.smithi103.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T12:04:38.396 INFO:teuthology.orchestra.run.smithi103.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-12T12:04:38.419 INFO:teuthology.orchestra.run.smithi103.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-09-12T12:04:38.444 INFO:teuthology.orchestra.run.smithi103.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T12:04:38.469 INFO:teuthology.orchestra.run.smithi103.stdout:(139/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-12T12:04:38.495 INFO:teuthology.orchestra.run.smithi103.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T12:04:38.520 INFO:teuthology.orchestra.run.smithi103.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T12:04:38.531 INFO:teuthology.orchestra.run.smithi081.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-09-12T12:04:38.533 INFO:teuthology.orchestra.run.smithi173.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 66 kB/s | 80 kB 00:01 2024-09-12T12:04:38.545 INFO:teuthology.orchestra.run.smithi103.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T12:04:38.571 INFO:teuthology.orchestra.run.smithi103.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T12:04:38.590 INFO:teuthology.orchestra.run.smithi081.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 990 kB/s | 801 kB 00:00 2024-09-12T12:04:38.596 INFO:teuthology.orchestra.run.smithi103.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T12:04:38.615 INFO:teuthology.orchestra.run.smithi081.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 332 kB/s | 191 kB 00:00 2024-09-12T12:04:38.621 INFO:teuthology.orchestra.run.smithi103.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T12:04:38.647 INFO:teuthology.orchestra.run.smithi103.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:04:38.672 INFO:teuthology.orchestra.run.smithi103.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T12:04:38.699 INFO:teuthology.orchestra.run.smithi081.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2024-09-12T12:04:38.722 INFO:teuthology.orchestra.run.smithi103.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T12:04:38.724 INFO:teuthology.orchestra.run.smithi081.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-12T12:04:38.808 INFO:teuthology.orchestra.run.smithi081.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-12T12:04:38.850 INFO:teuthology.orchestra.run.smithi081.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.9 MB/s | 1.2 MB 00:00 2024-09-12T12:04:38.925 INFO:teuthology.orchestra.run.smithi081.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.0 MB/s | 215 kB 00:00 2024-09-12T12:04:38.983 INFO:teuthology.orchestra.run.smithi173.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 255 kB/s | 191 kB 00:00 2024-09-12T12:04:39.017 INFO:teuthology.orchestra.run.smithi081.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-12T12:04:39.031 INFO:teuthology.orchestra.run.smithi103.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 7.5 MB/s | 2.3 MB 00:00 2024-09-12T12:04:39.051 INFO:teuthology.orchestra.run.smithi081.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-12T12:04:39.076 INFO:teuthology.orchestra.run.smithi081.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 709 kB/s | 107 kB 00:00 2024-09-12T12:04:39.102 INFO:teuthology.orchestra.run.smithi081.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-12T12:04:39.123 INFO:teuthology.orchestra.run.smithi103.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 20 MB/s | 1.8 MB 00:00 2024-09-12T12:04:39.126 INFO:teuthology.orchestra.run.smithi081.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-12T12:04:39.152 INFO:teuthology.orchestra.run.smithi081.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-12T12:04:39.177 INFO:teuthology.orchestra.run.smithi081.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-12T12:04:39.198 INFO:teuthology.orchestra.run.smithi103.stdout:(151/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.2 MB/s | 3.4 MB 00:00 2024-09-12T12:04:39.202 INFO:teuthology.orchestra.run.smithi081.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-12T12:04:39.224 INFO:teuthology.orchestra.run.smithi103.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 406 kB/s | 41 kB 00:00 2024-09-12T12:04:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T12:04:39.253 INFO:teuthology.orchestra.run.smithi081.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-12T12:04:39.283 INFO:teuthology.orchestra.run.smithi173.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 412 kB/s | 801 kB 00:01 2024-09-12T12:04:39.286 INFO:teuthology.orchestra.run.smithi081.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T12:04:39.307 INFO:teuthology.orchestra.run.smithi103.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-12T12:04:39.309 INFO:teuthology.orchestra.run.smithi173.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2024-09-12T12:04:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-12T12:04:39.345 INFO:teuthology.orchestra.run.smithi081.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-12T12:04:39.357 INFO:teuthology.orchestra.run.smithi103.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 4.6 MB/s | 3.2 MB 00:00 2024-09-12T12:04:39.371 INFO:teuthology.orchestra.run.smithi081.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T12:04:39.396 INFO:teuthology.orchestra.run.smithi081.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T12:04:39.421 INFO:teuthology.orchestra.run.smithi081.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T12:04:39.441 INFO:teuthology.orchestra.run.smithi103.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-12T12:04:39.446 INFO:teuthology.orchestra.run.smithi081.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T12:04:39.466 INFO:teuthology.orchestra.run.smithi103.stdout:(156/156): NetworkManager-tui-1.49.90-1.el9.x86 930 kB/s | 249 kB 00:00 2024-09-12T12:04:39.473 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:04:39.473 INFO:teuthology.orchestra.run.smithi103.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-12T12:04:39.497 INFO:teuthology.orchestra.run.smithi081.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-09-12T12:04:39.564 INFO:teuthology.orchestra.run.smithi081.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-12T12:04:39.631 INFO:teuthology.orchestra.run.smithi081.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-12T12:04:39.689 INFO:teuthology.orchestra.run.smithi081.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T12:04:39.715 INFO:teuthology.orchestra.run.smithi081.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T12:04:39.748 INFO:teuthology.orchestra.run.smithi081.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-12T12:04:39.790 INFO:teuthology.orchestra.run.smithi081.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T12:04:39.815 INFO:teuthology.orchestra.run.smithi081.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T12:04:39.857 INFO:teuthology.orchestra.run.smithi081.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T12:04:39.941 INFO:teuthology.orchestra.run.smithi081.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-12T12:04:39.950 INFO:teuthology.orchestra.run.smithi173.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 160 kB/s | 106 kB 00:00 2024-09-12T12:04:39.966 INFO:teuthology.orchestra.run.smithi081.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-12T12:04:39.992 INFO:teuthology.orchestra.run.smithi081.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-12T12:04:40.009 INFO:teuthology.orchestra.run.smithi173.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-12T12:04:40.017 INFO:teuthology.orchestra.run.smithi081.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T12:04:40.034 INFO:teuthology.orchestra.run.smithi173.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 187 kB/s | 135 kB 00:00 2024-09-12T12:04:40.042 INFO:teuthology.orchestra.run.smithi081.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-12T12:04:40.084 INFO:teuthology.orchestra.run.smithi081.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-12T12:04:40.110 INFO:teuthology.orchestra.run.smithi081.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 516 kB/s | 35 kB 00:00 2024-09-12T12:04:40.193 INFO:teuthology.orchestra.run.smithi081.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T12:04:40.218 INFO:teuthology.orchestra.run.smithi081.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-12T12:04:40.244 INFO:teuthology.orchestra.run.smithi081.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T12:04:40.269 INFO:teuthology.orchestra.run.smithi081.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T12:04:40.294 INFO:teuthology.orchestra.run.smithi081.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-12T12:04:40.301 INFO:teuthology.orchestra.run.smithi173.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-12T12:04:40.319 INFO:teuthology.orchestra.run.smithi081.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-12T12:04:40.345 INFO:teuthology.orchestra.run.smithi081.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T12:04:40.370 INFO:teuthology.orchestra.run.smithi081.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T12:04:40.393 INFO:teuthology.orchestra.run.smithi173.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-09-12T12:04:40.395 INFO:teuthology.orchestra.run.smithi081.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T12:04:40.420 INFO:teuthology.orchestra.run.smithi081.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T12:04:40.443 INFO:teuthology.orchestra.run.smithi173.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-12T12:04:40.485 INFO:teuthology.orchestra.run.smithi173.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 522 kB/s | 22 kB 00:00 2024-09-12T12:04:40.504 INFO:teuthology.orchestra.run.smithi081.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T12:04:40.530 INFO:teuthology.orchestra.run.smithi081.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-12T12:04:40.546 INFO:teuthology.orchestra.run.smithi081.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-12T12:04:40.553 INFO:teuthology.orchestra.run.smithi173.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 313 kB 00:00 2024-09-12T12:04:40.572 INFO:teuthology.orchestra.run.smithi081.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-12T12:04:40.588 INFO:teuthology.orchestra.run.smithi081.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 859 kB/s | 36 kB 00:00 2024-09-12T12:04:40.606 INFO:teuthology.orchestra.run.smithi081.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-12T12:04:40.639 INFO:teuthology.orchestra.run.smithi081.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T12:04:40.645 INFO:teuthology.orchestra.run.smithi173.stdout:(52/156): python3-requests-2.25.1-8.el9.noarch. 180 kB/s | 125 kB 00:00 2024-09-12T12:04:40.656 INFO:teuthology.orchestra.run.smithi081.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T12:04:40.670 INFO:teuthology.orchestra.run.smithi173.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-12T12:04:40.681 INFO:teuthology.orchestra.run.smithi081.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-12T12:04:40.702 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-12T12:04:40.707 INFO:teuthology.orchestra.run.smithi081.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T12:04:40.720 INFO:teuthology.orchestra.run.smithi173.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-12T12:04:40.723 INFO:teuthology.orchestra.run.smithi081.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-12T12:04:40.771 INFO:teuthology.orchestra.run.smithi173.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-12T12:04:40.804 INFO:teuthology.orchestra.run.smithi173.stdout:(56/156): python3-urllib3-1.26.5-6.el9.noarch.r 270 kB/s | 215 kB 00:00 2024-09-12T12:04:40.829 INFO:teuthology.orchestra.run.smithi173.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T12:04:40.853 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-12T12:04:40.853 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-12T12:04:40.922 INFO:teuthology.orchestra.run.smithi173.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-09-12T12:04:40.947 INFO:teuthology.orchestra.run.smithi173.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 319 kB/s | 45 kB 00:00 2024-09-12T12:04:40.966 INFO:teuthology.orchestra.run.smithi081.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-12T12:04:40.981 INFO:teuthology.orchestra.run.smithi173.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-12T12:04:40.991 INFO:teuthology.orchestra.run.smithi081.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 78 kB/s | 22 kB 00:00 2024-09-12T12:04:41.005 INFO:teuthology.orchestra.run.smithi173.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-12T12:04:41.041 INFO:teuthology.orchestra.run.smithi081.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T12:04:41.056 INFO:teuthology.orchestra.run.smithi173.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-09-12T12:04:41.066 INFO:teuthology.orchestra.run.smithi081.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-12T12:04:41.098 INFO:teuthology.orchestra.run.smithi173.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-09-12T12:04:41.100 INFO:teuthology.orchestra.run.smithi081.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-12T12:04:41.125 INFO:teuthology.orchestra.run.smithi081.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T12:04:41.131 INFO:teuthology.orchestra.run.smithi173.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T12:04:41.150 INFO:teuthology.orchestra.run.smithi081.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T12:04:41.157 INFO:teuthology.orchestra.run.smithi173.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-12T12:04:41.176 INFO:teuthology.orchestra.run.smithi081.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T12:04:41.182 INFO:teuthology.orchestra.run.smithi173.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-12T12:04:41.209 INFO:teuthology.orchestra.run.smithi081.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T12:04:41.252 INFO:teuthology.orchestra.run.smithi081.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T12:04:41.302 INFO:teuthology.orchestra.run.smithi081.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-12T12:04:41.341 INFO:teuthology.orchestra.run.smithi173.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-12T12:04:41.369 INFO:teuthology.orchestra.run.smithi081.stdout:(114/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-12T12:04:41.394 INFO:teuthology.orchestra.run.smithi081.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-09-12T12:04:41.419 INFO:teuthology.orchestra.run.smithi081.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-12T12:04:41.433 INFO:teuthology.orchestra.run.smithi173.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-12T12:04:41.445 INFO:teuthology.orchestra.run.smithi081.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T12:04:41.470 INFO:teuthology.orchestra.run.smithi081.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T12:04:41.495 INFO:teuthology.orchestra.run.smithi081.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T12:04:41.499 INFO:teuthology.orchestra.run.smithi173.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-12T12:04:41.520 INFO:teuthology.orchestra.run.smithi081.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-12T12:04:41.525 INFO:teuthology.orchestra.run.smithi173.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-12T12:04:41.550 INFO:teuthology.orchestra.run.smithi173.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-12T12:04:41.554 INFO:teuthology.orchestra.run.smithi081.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-12T12:04:41.579 INFO:teuthology.orchestra.run.smithi081.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-12T12:04:41.609 INFO:teuthology.orchestra.run.smithi173.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T12:04:41.613 INFO:teuthology.orchestra.run.smithi081.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 422 kB/s | 11 kB 00:00 2024-09-12T12:04:41.638 INFO:teuthology.orchestra.run.smithi081.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 765 kB/s | 18 kB 00:00 2024-09-12T12:04:41.642 INFO:teuthology.orchestra.run.smithi173.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-12T12:04:41.664 INFO:teuthology.orchestra.run.smithi081.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-12T12:04:41.689 INFO:teuthology.orchestra.run.smithi081.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-09-12T12:04:41.701 INFO:teuthology.orchestra.run.smithi173.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-12T12:04:41.714 INFO:teuthology.orchestra.run.smithi081.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T12:04:41.739 INFO:teuthology.orchestra.run.smithi081.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T12:04:41.760 INFO:teuthology.orchestra.run.smithi173.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-12T12:04:41.765 INFO:teuthology.orchestra.run.smithi081.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T12:04:41.790 INFO:teuthology.orchestra.run.smithi081.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T12:04:41.815 INFO:teuthology.orchestra.run.smithi081.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T12:04:41.849 INFO:teuthology.orchestra.run.smithi081.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T12:04:41.851 INFO:teuthology.orchestra.run.smithi173.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-09-12T12:04:41.874 INFO:teuthology.orchestra.run.smithi081.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-12T12:04:41.876 INFO:teuthology.orchestra.run.smithi173.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-09-12T12:04:41.902 INFO:teuthology.orchestra.run.smithi173.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-12T12:04:41.908 INFO:teuthology.orchestra.run.smithi081.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T12:04:41.927 INFO:teuthology.orchestra.run.smithi173.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-12T12:04:41.933 INFO:teuthology.orchestra.run.smithi081.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-12T12:04:41.958 INFO:teuthology.orchestra.run.smithi081.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-12T12:04:42.000 INFO:teuthology.orchestra.run.smithi081.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-12T12:04:42.002 INFO:teuthology.orchestra.run.smithi173.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T12:04:42.017 INFO:teuthology.orchestra.run.smithi081.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-12T12:04:42.028 INFO:teuthology.orchestra.run.smithi173.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-12T12:04:42.034 INFO:teuthology.orchestra.run.smithi081.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-09-12T12:04:42.053 INFO:teuthology.orchestra.run.smithi173.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T12:04:42.059 INFO:teuthology.orchestra.run.smithi081.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-12T12:04:42.085 INFO:teuthology.orchestra.run.smithi081.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T12:04:42.086 INFO:teuthology.orchestra.run.smithi173.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T12:04:42.110 INFO:teuthology.orchestra.run.smithi081.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T12:04:42.112 INFO:teuthology.orchestra.run.smithi173.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T12:04:42.135 INFO:teuthology.orchestra.run.smithi081.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T12:04:42.145 INFO:teuthology.orchestra.run.smithi173.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T12:04:42.161 INFO:teuthology.orchestra.run.smithi081.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-12T12:04:42.170 INFO:teuthology.orchestra.run.smithi173.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-12T12:04:42.186 INFO:teuthology.orchestra.run.smithi081.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T12:04:42.204 INFO:teuthology.orchestra.run.smithi173.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T12:04:42.211 INFO:teuthology.orchestra.run.smithi081.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T12:04:42.229 INFO:teuthology.orchestra.run.smithi173.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-12T12:04:42.245 INFO:teuthology.orchestra.run.smithi081.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T12:04:42.295 INFO:teuthology.orchestra.run.smithi081.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T12:04:42.305 INFO:teuthology.orchestra.run.smithi173.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-12T12:04:42.330 INFO:teuthology.orchestra.run.smithi173.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-09-12T12:04:42.355 INFO:teuthology.orchestra.run.smithi173.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 279 kB 00:00 2024-09-12T12:04:42.381 INFO:teuthology.orchestra.run.smithi173.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-12T12:04:42.406 INFO:teuthology.orchestra.run.smithi173.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-12T12:04:42.431 INFO:teuthology.orchestra.run.smithi173.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-12T12:04:42.454 INFO:teuthology.orchestra.run.smithi081.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-12T12:04:42.464 INFO:teuthology.orchestra.run.smithi173.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T12:04:42.490 INFO:teuthology.orchestra.run.smithi173.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-12T12:04:42.524 INFO:teuthology.orchestra.run.smithi173.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-12T12:04:42.549 INFO:teuthology.orchestra.run.smithi173.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T12:04:42.582 INFO:teuthology.orchestra.run.smithi173.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-12T12:04:42.608 INFO:teuthology.orchestra.run.smithi173.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-12T12:04:42.641 INFO:teuthology.orchestra.run.smithi173.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T12:04:42.654 INFO:teuthology.orchestra.run.smithi081.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-12T12:04:42.667 INFO:teuthology.orchestra.run.smithi173.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 761 kB/s | 45 kB 00:00 2024-09-12T12:04:42.672 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-12T12:04:42.672 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-12T12:04:42.896 INFO:teuthology.orchestra.run.smithi081.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 169 kB/s | 41 kB 00:00 2024-09-12T12:04:42.951 INFO:teuthology.orchestra.run.smithi173.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-12T12:04:42.976 INFO:teuthology.orchestra.run.smithi173.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 67 kB/s | 22 kB 00:00 2024-09-12T12:04:43.026 INFO:teuthology.orchestra.run.smithi173.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-12T12:04:43.051 INFO:teuthology.orchestra.run.smithi173.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-12T12:04:43.077 INFO:teuthology.orchestra.run.smithi173.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-12T12:04:43.102 INFO:teuthology.orchestra.run.smithi173.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T12:04:43.127 INFO:teuthology.orchestra.run.smithi173.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T12:04:43.152 INFO:teuthology.orchestra.run.smithi173.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T12:04:43.177 INFO:teuthology.orchestra.run.smithi173.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-12T12:04:43.188 INFO:teuthology.orchestra.run.smithi081.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 853 kB/s | 249 kB 00:00 2024-09-12T12:04:43.219 INFO:teuthology.orchestra.run.smithi173.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T12:04:43.295 INFO:teuthology.orchestra.run.smithi173.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-12T12:04:43.311 INFO:teuthology.orchestra.run.smithi173.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-12T12:04:43.328 INFO:teuthology.orchestra.run.smithi173.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-12T12:04:43.362 INFO:teuthology.orchestra.run.smithi173.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-12T12:04:43.371 INFO:teuthology.orchestra.run.smithi081.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 2.0 MB/s | 1.8 MB 00:00 2024-09-12T12:04:43.379 INFO:teuthology.orchestra.run.smithi173.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T12:04:43.404 INFO:teuthology.orchestra.run.smithi173.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-12T12:04:43.413 INFO:teuthology.orchestra.run.smithi081.stdout:(154/156): NetworkManager-1.49.90-1.el9.x86_64. 2.1 MB/s | 2.3 MB 00:01 2024-09-12T12:04:43.455 INFO:teuthology.orchestra.run.smithi173.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-12T12:04:43.480 INFO:teuthology.orchestra.run.smithi173.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-12T12:04:43.505 INFO:teuthology.orchestra.run.smithi173.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T12:04:43.539 INFO:teuthology.orchestra.run.smithi173.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T12:04:43.564 INFO:teuthology.orchestra.run.smithi173.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T12:04:43.589 INFO:teuthology.orchestra.run.smithi173.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-12T12:04:43.590 INFO:teuthology.orchestra.run.smithi081.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 1.4 MB 00:00 2024-09-12T12:04:43.615 INFO:teuthology.orchestra.run.smithi173.stdout:(125/156): protobuf-compiler-3.14.0-13.el9.x86_ 911 kB/s | 863 kB 00:00 2024-09-12T12:04:43.640 INFO:teuthology.orchestra.run.smithi173.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-12T12:04:43.674 INFO:teuthology.orchestra.run.smithi173.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 740 kB/s | 20 kB 00:00 2024-09-12T12:04:43.724 INFO:teuthology.orchestra.run.smithi173.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-12T12:04:43.749 INFO:teuthology.orchestra.run.smithi173.stdout:(129/156): python3-jaraco-functools-3.5.0-2.el9 145 kB/s | 19 kB 00:00 2024-09-12T12:04:43.774 INFO:teuthology.orchestra.run.smithi173.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 921 kB/s | 46 kB 00:00 2024-09-12T12:04:43.799 INFO:teuthology.orchestra.run.smithi173.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-12T12:04:43.825 INFO:teuthology.orchestra.run.smithi173.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-12T12:04:43.850 INFO:teuthology.orchestra.run.smithi173.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 648 kB/s | 16 kB 00:00 2024-09-12T12:04:43.876 INFO:teuthology.orchestra.run.smithi173.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T12:04:43.901 INFO:teuthology.orchestra.run.smithi173.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T12:04:43.926 INFO:teuthology.orchestra.run.smithi173.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-12T12:04:43.952 INFO:teuthology.orchestra.run.smithi173.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T12:04:43.977 INFO:teuthology.orchestra.run.smithi173.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T12:04:44.002 INFO:teuthology.orchestra.run.smithi173.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T12:04:44.027 INFO:teuthology.orchestra.run.smithi173.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-12T12:04:44.061 INFO:teuthology.orchestra.run.smithi173.stdout:(141/156): python3-kubernetes-26.1.0-2.el9.noar 2.6 MB/s | 1.0 MB 00:00 2024-09-12T12:04:44.086 INFO:teuthology.orchestra.run.smithi173.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 887 kB/s | 74 kB 00:00 2024-09-12T12:04:44.111 INFO:teuthology.orchestra.run.smithi173.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T12:04:44.137 INFO:teuthology.orchestra.run.smithi173.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-12T12:04:44.153 INFO:teuthology.orchestra.run.smithi173.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T12:04:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-12T12:04:44.197 INFO:teuthology.orchestra.run.smithi081.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-09-12T12:04:44.204 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:04:44.204 INFO:teuthology.orchestra.run.smithi081.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-12T12:04:44.204 INFO:teuthology.orchestra.run.smithi173.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-12T12:04:44.254 INFO:teuthology.orchestra.run.smithi173.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T12:04:44.513 INFO:teuthology.orchestra.run.smithi173.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T12:04:44.680 INFO:teuthology.orchestra.run.smithi173.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 6.8 MB/s | 3.4 MB 00:00 2024-09-12T12:04:45.247 INFO:teuthology.orchestra.run.smithi173.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 72 kB/s | 41 kB 00:00 2024-09-12T12:04:45.420 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-12T12:04:45.464 INFO:teuthology.orchestra.run.smithi173.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-09-12T12:04:45.570 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-12T12:04:45.570 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-12T12:04:45.581 INFO:teuthology.orchestra.run.smithi173.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.7 MB/s | 1.8 MB 00:01 2024-09-12T12:04:45.998 INFO:teuthology.orchestra.run.smithi173.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 332 kB/s | 249 kB 00:00 2024-09-12T12:04:46.415 INFO:teuthology.orchestra.run.smithi173.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-12T12:04:46.614 INFO:teuthology.orchestra.run.smithi173.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-12T12:04:46.622 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:04:46.622 INFO:teuthology.orchestra.run.smithi173.stdout:Total 14 MB/s | 226 MB 00:15 2024-09-12T12:04:47.864 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-09-12T12:04:47.917 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-12T12:04:47.917 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-12T12:04:48.015 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-09-12T12:04:48.016 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-09-12T12:04:49.145 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-12T12:04:49.287 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:04:49.325 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:04:49.548 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:04:49.589 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:04:49.622 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:04:49.666 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:04:49.814 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-09-12T12:04:49.814 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-09-12T12:04:49.995 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:04:50.115 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:04:50.237 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:04:50.266 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:04:50.341 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:04:50.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:04:50.529 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:04:50.585 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:04:50.613 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:04:50.717 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:04:50.747 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:04:50.793 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:04:50.815 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:04:50.835 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:04:51.025 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:04:51.158 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:04:51.314 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:04:51.423 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:51.507 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:51.736 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:51.845 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:04:51.957 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:04:51.996 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:04:52.031 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:04:52.106 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:04:52.157 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:04:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:04:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:04:52.273 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:04:52.310 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:04:52.387 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:04:52.440 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:04:52.471 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:04:52.506 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:04:52.583 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:04:52.617 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:04:52.660 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:04:52.689 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:04:52.768 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:04:52.816 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:04:52.891 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:04:53.043 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:04:53.102 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:04:53.663 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:04:53.748 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:04:53.777 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:04:53.812 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:04:53.850 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:04:53.892 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:04:54.061 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:04:54.129 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:04:54.193 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:04:54.274 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:04:54.305 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:04:54.341 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:04:54.388 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:04:54.424 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:04:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-12T12:04:54.467 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:04:54.509 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:04:54.584 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:04:54.619 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:04:54.655 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:04:54.677 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:04:54.711 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:04:54.746 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:04:54.785 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:04:54.807 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:04:54.827 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:04:54.930 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:04:54.960 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:04:55.000 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:04:55.034 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:04:55.067 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:04:55.151 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:04:55.194 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:04:55.271 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:04:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:04:55.317 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:04:55.345 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:04:55.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:04:55.394 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:04:55.418 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:04:55.422 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:04:55.450 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:04:55.480 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:04:55.514 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:04:55.523 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:04:55.543 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:04:55.565 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:04:55.606 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:04:55.641 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:04:55.710 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:04:55.728 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:04:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:04:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:04:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:04:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:04:55.897 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:04:55.915 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:04:55.919 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:04:55.979 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:04:55.985 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:04:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:04:56.034 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:04:56.228 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-09-12T12:04:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:04:56.360 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T12:04:56.398 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T12:04:56.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:04:56.459 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T12:04:56.494 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T12:04:56.519 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T12:04:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:04:56.562 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T12:04:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:04:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:04:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:04:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:04:56.886 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T12:04:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:04:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:04:57.012 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:04:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:04:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:04:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:04:57.134 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:04:57.163 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:04:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:04:57.225 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:04:57.238 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:04:57.267 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:04:57.268 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:04:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:04:57.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:04:57.333 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:04:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:04:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:04:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:04:57.415 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T12:04:57.452 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:04:57.464 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T12:04:57.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:04:57.492 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:04:57.513 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:04:57.582 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:04:57.596 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:04:57.626 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:04:57.645 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:04:57.689 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T12:04:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:04:57.711 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:04:57.735 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T12:04:57.753 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:04:57.831 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:04:57.876 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:04:57.924 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:04:57.929 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:04:57.954 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:04:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:04:58.061 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:04:58.065 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T12:04:58.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:04:58.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:04:58.176 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:04:58.192 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T12:04:58.297 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:58.308 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:04:58.369 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:04:58.377 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:58.605 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T12:04:58.719 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T12:04:58.813 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T12:04:58.848 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T12:04:58.892 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T12:04:58.913 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:04:58.965 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T12:04:59.007 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:04:59.009 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T12:04:59.035 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:04:59.049 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T12:04:59.086 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:04:59.102 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T12:04:59.125 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:04:59.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T12:04:59.162 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T12:04:59.168 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:04:59.232 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T12:04:59.284 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T12:04:59.315 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T12:04:59.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:04:59.359 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T12:04:59.410 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:04:59.412 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:04:59.443 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T12:04:59.467 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:04:59.472 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T12:04:59.509 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:04:59.525 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T12:04:59.536 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:04:59.538 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:04:59.569 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:04:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:04:59.583 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T12:04:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:04:59.654 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:04:59.657 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T12:04:59.690 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:04:59.709 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T12:04:59.741 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:04:59.785 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T12:04:59.791 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:04:59.905 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:04:59.915 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T12:04:59.928 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:04:59.971 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T12:04:59.977 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:05:00.000 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:05:00.018 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:05:00.074 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:05:00.105 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:05:00.140 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:05:00.369 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:05:00.403 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:05:00.451 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:05:00.492 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:05:00.497 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T12:05:00.517 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:05:00.574 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T12:05:00.603 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T12:05:00.615 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:05:00.621 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:05:00.646 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T12:05:00.653 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:05:00.684 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T12:05:00.715 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:05:00.725 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T12:05:00.738 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:05:00.743 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:05:00.783 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:05:00.828 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:05:00.874 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:05:00.893 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T12:05:00.913 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:05:00.944 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:05:00.962 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T12:05:00.974 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:05:01.017 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T12:05:01.037 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:05:01.067 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:05:01.090 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T12:05:01.109 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:05:01.121 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T12:05:01.143 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:05:01.157 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T12:05:01.204 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T12:05:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:05:01.240 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T12:05:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:05:01.291 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T12:05:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:05:01.333 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T12:05:01.416 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:05:01.464 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:05:01.479 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T12:05:01.704 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T12:05:01.844 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T12:05:01.948 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T12:05:02.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T12:05:02.194 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:05:02.245 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:05:02.277 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T12:05:02.287 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:05:02.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-12T12:05:02.360 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T12:05:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:05:02.441 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T12:05:02.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:05:02.495 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:05:02.572 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T12:05:02.583 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:05:02.617 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T12:05:02.623 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:05:02.645 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T12:05:02.679 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T12:05:02.718 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T12:05:02.750 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T12:05:02.779 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T12:05:02.813 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:05:02.814 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T12:05:02.847 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T12:05:02.854 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:05:02.889 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T12:05:02.924 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T12:05:02.938 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:05:02.981 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:03.010 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T12:05:03.018 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:03.054 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T12:05:03.085 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T12:05:03.187 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T12:05:03.244 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T12:05:03.570 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:03.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:05:03.622 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:05:03.711 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:05:03.713 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:05:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:05:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:05:03.714 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:03.740 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:05:03.959 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T12:05:04.001 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T12:05:04.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T12:05:04.135 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T12:05:04.182 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T12:05:04.226 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T12:05:04.306 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T12:05:04.346 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T12:05:04.539 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T12:05:04.569 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T12:05:04.645 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T12:05:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:05:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:05:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:05:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:05:05.288 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T12:05:05.391 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T12:05:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:05:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:05:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:05:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:05:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:05:06.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:05:06.130 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:05:06.201 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:05:06.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:05:06.608 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T12:05:06.689 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T12:05:06.716 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T12:05:06.750 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T12:05:07.059 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T12:05:07.110 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:05:07.187 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T12:05:07.218 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T12:05:07.253 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T12:05:07.730 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T12:05:07.766 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:05:07.838 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T12:05:07.867 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T12:05:08.513 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:08.545 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:09.122 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:05:09.248 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:05:09.248 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:05:09.249 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:05:09.249 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:09.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:05:10.195 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:10.231 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:10.777 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T12:05:10.834 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:05:10.927 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T12:05:10.928 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T12:05:10.928 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T12:05:10.928 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:10.960 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:05:15.671 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:05:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-12T12:05:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-12T12:05:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-12T12:05:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-12T12:05:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-12T12:05:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-12T12:05:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-12T12:05:15.672 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:15.856 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:05:15.873 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:05:15.873 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:15.873 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:05:15.873 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:17.351 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:05:17.378 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:05:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:05:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:05:17.378 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:05:17.378 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:17.602 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:05:17.625 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:05:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:05:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:05:17.628 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:05:17.628 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:18.086 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:05:18.109 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:05:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:05:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:05:18.110 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:05:18.110 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:18.216 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:05:18.273 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:05:18.329 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:05:18.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:05:18.570 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:05:18.641 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:05:18.729 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:05:18.868 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:05:18.913 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:05:18.953 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:05:18.989 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:05:19.449 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:05:19.480 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:05:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:05:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:05:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:05:20.649 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:05:20.688 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:05:21.192 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-12T12:05:21.193 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:21.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:05:21.386 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:05:21.387 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:21.387 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:05:21.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:21.655 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:05:21.688 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:05:21.791 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:05:21.951 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:05:21.982 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:05:22.006 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:05:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:05:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:05:22.006 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:05:22.006 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:22.058 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:05:22.070 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:05:22.170 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:05:22.215 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:05:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:05:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:05:22.900 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:22.900 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:05:22.900 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:05:22.900 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:05:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:23.045 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-09-12T12:05:23.046 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:23.124 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:05:23.138 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:05:23.147 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:05:23.147 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.147 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:05:23.147 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:05:23.148 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:05:23.148 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:23.170 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:05:23.193 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:05:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:05:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:05:23.193 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:05:23.193 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:23.222 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:05:23.239 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T12:05:23.240 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.240 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T12:05:23.240 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:23.245 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:05:23.268 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:05:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.268 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:05:23.268 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:23.312 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:05:23.336 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:05:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:05:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:05:23.336 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:05:23.336 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:23.584 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:05:23.606 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:05:23.606 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.606 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:05:23.607 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:05:23.607 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:05:23.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:23.638 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:05:23.662 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:05:23.662 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:23.662 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:05:23.662 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:05:23.662 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:05:23.662 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:23.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:05:23.778 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:05:23.833 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:05:24.018 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:05:24.067 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:05:24.153 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:05:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:05:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:05:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:05:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:05:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:05:24.749 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:05:24.776 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T12:05:24.776 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:24.776 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T12:05:24.777 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:05:24.777 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T12:05:24.777 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:24.969 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:05:25.000 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:05:25.008 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:05:25.032 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T12:05:25.032 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:25.032 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T12:05:25.032 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:05:25.032 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T12:05:25.032 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:25.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:05:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:05:25.132 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:05:25.467 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:05:25.491 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T12:05:25.491 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:25.491 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T12:05:25.491 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:05:25.491 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T12:05:25.492 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:25.598 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T12:05:25.655 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T12:05:25.709 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T12:05:25.903 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T12:05:25.951 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T12:05:26.020 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T12:05:26.109 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T12:05:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:05:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:05:26.240 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T12:05:26.285 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T12:05:26.316 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T12:05:26.353 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T12:05:26.828 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:05:26.859 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T12:05:26.891 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T12:05:26.953 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T12:05:26.982 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:05:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:05:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:05:27.311 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:05:27.479 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:05:27.511 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:05:27.534 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:05:27.534 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:27.535 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:05:27.535 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:05:27.535 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:05:27.535 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:27.587 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:05:27.598 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:05:27.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:05:27.775 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:05:28.024 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T12:05:28.059 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:05:28.226 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:05:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:05:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:05:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:05:28.368 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:05:28.551 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:05:28.598 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:05:28.637 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:05:28.666 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:05:28.688 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:05:28.713 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:05:28.723 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:05:28.746 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:05:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:05:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:05:28.747 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:05:28.747 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:28.790 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:05:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:05:28.813 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:28.813 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:05:28.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:28.866 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:05:28.889 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:05:28.889 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:28.889 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:05:28.889 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:05:28.889 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:05:28.890 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:29.026 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T12:05:29.060 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:05:29.162 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T12:05:29.191 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:05:29.215 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:05:29.215 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:29.215 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:05:29.215 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:05:29.215 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:05:29.215 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:29.319 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:29.325 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T12:05:29.353 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:05:29.361 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:29.378 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T12:05:29.378 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:29.378 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T12:05:29.378 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:05:29.378 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T12:05:29.378 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:29.382 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:29.429 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:05:29.441 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T12:05:29.538 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T12:05:29.585 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T12:05:30.236 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:05:30.325 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:05:30.366 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:05:30.457 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:05:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:05:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:05:30.528 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T12:05:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:05:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:05:30.564 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:05:30.589 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T12:05:30.589 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:30.589 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T12:05:30.589 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:05:30.589 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T12:05:30.589 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:05:30.631 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:05:30.632 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:05:30.655 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T12:05:30.655 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:30.655 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T12:05:30.655 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:30.699 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:05:30.715 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:05:30.723 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T12:05:30.723 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:30.723 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T12:05:30.723 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:05:30.723 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T12:05:30.723 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:30.740 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:05:30.745 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:30.745 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:30.925 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:30.926 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:05:31.010 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:05:31.033 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:05:31.057 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T12:05:31.057 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T12:05:31.057 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T12:05:31.057 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:05:31.057 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T12:05:31.057 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:31.073 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:33.786 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:05:33.828 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:05:33.869 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:05:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:05:33.928 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:05:34.137 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:05:34.175 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:05:34.205 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:05:34.234 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:05:34.306 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:05:34.934 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:34.971 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:34.990 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:35.595 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T12:05:35.636 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T12:05:35.677 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T12:05:35.709 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T12:05:35.737 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T12:05:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:05:35.917 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T12:05:35.917 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:05:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:05:35.987 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T12:05:36.005 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T12:05:36.035 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T12:05:36.060 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:05:36.081 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T12:05:36.095 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:05:36.121 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:05:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:05:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:05:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:05:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:05:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:05:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:05:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:36.550 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:05:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:05:36.679 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:36.698 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:36.720 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:36.741 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T12:05:36.952 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:36.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:05:36.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:05:36.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:05:36.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:05:36.952 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:05:36.953 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:05:36.954 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:05:36.955 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:05:36.956 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:05:36.957 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:05:36.958 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:05:36.959 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:05:36.960 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:05:36.961 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:05:36.962 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:05:36.963 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:05:36.964 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:05:37.572 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T12:05:37.667 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T12:05:37.708 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T12:05:37.788 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T12:05:37.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T12:05:37.887 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T12:05:37.921 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T12:05:37.921 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:05:38.014 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T12:05:38.014 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:05:38.098 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T12:05:38.122 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T12:05:38.128 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:38.128 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:38.307 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T12:05:38.308 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:05:38.401 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T12:05:38.471 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:39.706 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:39.706 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:39.706 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-12T12:05:39.706 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:39.706 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:39.706 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.708 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:05:39.709 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:05:39.710 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:05:39.711 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:05:39.712 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:05:39.713 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:05:39.714 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:05:39.715 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:05:39.716 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:05:39.717 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:05:39.718 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:05:39.719 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:05:39.719 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:05:39.719 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-12T12:05:40.175 DEBUG:teuthology.parallel:result is None 2024-09-12T12:05:42.377 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:05:42.378 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:05:42.379 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:05:42.380 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:05:42.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:05:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:05:42.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:05:42.394 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:05:42.395 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:05:42.396 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:05:42.397 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:05:42.398 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:05:42.399 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:05:42.400 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:05:42.400 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:05:42.400 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:05:42.400 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:05:42.400 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:05:42.401 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:05:42.402 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:05:44.039 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T12:05:44.040 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T12:05:44.041 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T12:05:44.042 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T12:05:44.042 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T12:05:44.042 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T12:05:44.042 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T12:05:44.042 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T12:05:44.042 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T12:05:44.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T12:05:44.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T12:05:44.056 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T12:05:44.057 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T12:05:44.058 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T12:05:44.059 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T12:05:44.060 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T12:05:44.061 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T12:05:44.062 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T12:05:44.063 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T12:05:44.064 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T12:05:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:44.978 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-12T12:05:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:05:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:05:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:05:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:05:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:05:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:05:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:05:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:05:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:05:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:05:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:05:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:05:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:05:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:05:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:05:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:05:44.992 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-12T12:05:45.446 DEBUG:teuthology.parallel:result is None 2024-09-12T12:05:46.957 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T12:05:46.957 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:46.957 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-09-12T12:05:46.957 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:46.957 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:46.957 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.958 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.959 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T12:05:46.960 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T12:05:46.961 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T12:05:46.962 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T12:05:46.963 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T12:05:46.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T12:05:46.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T12:05:46.966 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.967 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T12:05:46.968 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.969 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.970 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T12:05:46.970 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T12:05:46.970 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T12:05:46.970 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T12:05:46.970 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T12:05:46.970 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T12:05:46.971 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T12:05:46.971 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T12:05:46.971 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:05:46.971 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-09-12T12:05:47.385 DEBUG:teuthology.parallel:result is None 2024-09-12T12:05:47.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:47.535 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:05:47.562 INFO:teuthology.orchestra.run.smithi081.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:05:47.563 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:05:47.563 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:05:47.565 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:47.715 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:05:47.742 INFO:teuthology.orchestra.run.smithi103.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:05:47.742 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:05:47.742 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:05:47.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:47.886 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T12:05:47.909 INFO:teuthology.orchestra.run.smithi173.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T12:05:47.909 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T12:05:47.910 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T12:05:47.911 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T12:05:47.912 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:05:47.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:05:47.945 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:05:47.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:05:47.978 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:05:47.978 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T12:05:48.006 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T12:05:48.007 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:05:48.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:05:48.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:05:48.104 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:05:48.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:05:48.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:05:48.205 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:05:48.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T12:05:48.231 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T12:05:48.298 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T12:05:48.299 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:05:48.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:05:48.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:05:48.398 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:05:48.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:05:48.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:05:48.500 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:05:48.500 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T12:05:48.527 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T12:05:48.593 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T12:05:48.594 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:05:48.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:05:48.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:05:48.693 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:05:48.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:05:48.723 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:05:48.793 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:05:48.794 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T12:05:48.821 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T12:05:48.889 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T12:05:48.994 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-12T12:05:48.994 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:48.994 INFO:tasks.cephadm:Cluster fsid is 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:05:48.994 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T12:05:48.995 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.81', 'mon.b': '172.21.15.103', 'mon.c': '172.21.15.173'} 2024-09-12T12:05:48.995 INFO:tasks.cephadm:First mon is mon.a on smithi081 2024-09-12T12:05:48.995 INFO:tasks.cephadm:First mgr is x 2024-09-12T12:05:48.995 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T12:05:48.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-09-12T12:05:49.025 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-09-12T12:05:49.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-09-12T12:05:49.083 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T12:05:49.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:49.231 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T12:05:49.374 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:05:49.376 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T12:05:49.376 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T12:05:49.376 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:49.749 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:05 /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:49.749 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.115 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:05 /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.116 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.503 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 12:05 /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.504 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.524 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.543 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T12:05:50.579 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T12:05:50.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:05:50.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:05:50.586 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T12:05:52.143 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:05:52.181 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:05:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:06:18.828 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:06:18.828 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:06:18.828 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:06:18.828 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-09-12T12:06:18.828 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:06:18.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:06:18.829 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-09-12T12:06:46.051 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T12:06:46.060 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T12:06:46.060 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T12:06:46.060 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T12:06:46.061 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-09-12T12:06:46.061 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T12:06:46.061 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T12:06:46.061 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T12:06:46.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-09-12T12:06:46.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-09-12T12:06:46.145 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-09-12T12:06:46.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-09-12T12:06:46.202 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-09-12T12:06:46.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-09-12T12:06:46.252 INFO:tasks.cephadm:Writing seed config... 2024-09-12T12:06:46.253 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-12T12:06:46.253 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T12:06:46.254 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T12:06:46.255 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T12:06:46.256 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T12:06:46.257 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-12T12:06:46.258 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:06:46.258 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T12:06:46.274 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 595bfb7a-70ff-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T12:06:46.274 DEBUG:teuthology.orchestra.run.smithi081:mon.a> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T12:06:46.316 DEBUG:teuthology.orchestra.run.smithi081:mgr.x> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T12:06:46.360 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T12:06:46.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:06:46.565 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-12T12:06:46.565 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '595bfb7a-70ff-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-09-12T12:06:46.565 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T12:06:46.565 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-09-12T12:06:46.596 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-12T12:06:46.596 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-09-12T12:06:46.597 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-09-12T12:06:46.605 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T12:06:46.605 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T12:06:46.613 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T12:06:46.613 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T12:06:46.641 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-12T12:06:46.648 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-12T12:06:46.648 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-12T12:06:46.648 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-09-12T12:06:46.672 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 5.2.2 2024-09-12T12:06:46.672 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T12:06:46.672 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-09-12T12:06:46.672 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-09-12T12:06:46.678 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T12:06:46.678 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T12:06:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T12:06:46.685 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T12:06:46.692 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-09-12T12:06:46.701 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-09-12T12:06:46.701 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-09-12T12:06:46.701 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-09-12T12:06:46.701 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:06:46.701 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 139916175287296 on /run/cephadm/595bfb7a-70ff-11ef-bcea-c7b262605968.lock 2024-09-12T12:06:46.702 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 139916175287296 acquired on /run/cephadm/595bfb7a-70ff-11ef-bcea-c7b262605968.lock 2024-09-12T12:06:46.702 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-09-12T12:06:46.702 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-09-12T12:06:46.702 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-12T12:06:46.704 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.81 metric 100 2024-09-12T12:06:46.704 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-09-12T12:06:46.706 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T12:06:46.707 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T12:06:46.707 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T12:06:46.709 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T12:06:46.709 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T12:06:46.710 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T12:06:46.710 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T12:06:46.710 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-12T12:06:46.710 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T12:06:46.711 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-12T12:06:46.711 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-09-12T12:06:46.711 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T12:06:46.711 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T12:06:46.711 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:06:47.194 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T12:06:47.194 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T12:06:47.194 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T12:06:47.194 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T12:06:47.195 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T12:06:47.195 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T12:06:47.195 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T12:06:48.114 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T12:06:48.115 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T12:06:48.115 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T12:06:49.029 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-09-12T12:06:49.029 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-09-12T12:06:49.985 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBZ2eJmHf+oExAAmexV8d0NKCvgxek1wKTzCQ== 2024-09-12T12:06:58.561 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBc2eJmFJIHCRAA5BI0iuDJqXqWdVVDdT3ozA== 2024-09-12T12:06:59.474 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQBi2eJmprpANBAAYv4k4PrpBup8ZE0k5m2Ulw== 2024-09-12T12:06:59.475 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-09-12T12:07:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T12:07:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T12:07:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T12:07:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for a [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T12:07:00.382 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-12T12:07:00.382 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:00.382 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T12:07:00.382 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:00.382 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-09-12T12:07:01.329 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.a on 2024-09-12T12:07:01.529 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T12:07:01.678 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T12:07:01.863 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968.target. 2024-09-12T12:07:01.863 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968.target. 2024-09-12T12:07:02.131 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a 2024-09-12T12:07:02.131 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T12:07:02.311 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968.target.wants/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@.service. 2024-09-12T12:07:02.879 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:07:02.879 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T12:07:02.886 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:07:02.886 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T12:07:02.886 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T12:07:02.886 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T12:07:02.887 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-09-12T12:07:02.887 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.541601s) 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T12:07:04.281 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.286+0000 7f30236dd640 1 Processor -- start 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.286+0000 7f30236dd640 1 -- start start 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.286+0000 7f30236dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.286+0000 7f30236dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f301c106600 con 0x7f301c105c30 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.287+0000 7f3021479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.287+0000 7f3021479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48022/0 (socket says 172.21.15.81:48022) 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.287+0000 7f3021479640 1 -- 172.21.15.81:0/617802684 learned_addr learned my addr 172.21.15.81:0/617802684 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.287+0000 7f3021479640 1 -- 172.21.15.81:0/617802684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c108c10 con 0x7f301c105c30 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.289+0000 7f3021479640 1 --2- 172.21.15.81:0/617802684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c106030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3018009820 tx=0x7f301802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d52ee44c9e849ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.289+0000 7f3013fff640 1 -- 172.21.15.81:0/617802684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3018037070 con 0x7f301c105c30 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.289+0000 7f3013fff640 1 -- 172.21.15.81:0/617802684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018032440 con 0x7f301c105c30 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.289+0000 7f3013fff640 1 -- 172.21.15.81:0/617802684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3018032740 con 0x7f301c105c30 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 -- 172.21.15.81:0/617802684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 msgr2=0x7f301c106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 --2- 172.21.15.81:0/617802684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c106030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3018009820 tx=0x7f301802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 -- 172.21.15.81:0/617802684 shutdown_connections 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 --2- 172.21.15.81:0/617802684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c106030 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 -- 172.21.15.81:0/617802684 >> 172.21.15.81:0/617802684 conn(0x7f301c1017a0 msgr2=0x7f301c103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 -- 172.21.15.81:0/617802684 shutdown_connections 2024-09-12T12:07:04.283 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 -- 172.21.15.81:0/617802684 wait complete. 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 Processor -- start 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.290+0000 7f30236dd640 1 -- start start 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30236dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30236dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f301c109030 con 0x7f301c105c30 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f3021479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f3021479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48024/0 (socket says 172.21.15.81:48024) 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f3021479640 1 -- 172.21.15.81:0/3061448884 learned_addr learned my addr 172.21.15.81:0/3061448884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f3021479640 1 -- 172.21.15.81:0/3061448884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c1089d0 con 0x7f301c105c30 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f3021479640 1 --2- 172.21.15.81:0/3061448884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c108490 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f30180090b0 tx=0x7f30180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3018041070 con 0x7f301c105c30 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301803c7a0 con 0x7f301c105c30 2024-09-12T12:07:04.284 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3018037040 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301c106bc0 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.291+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f301c107100 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.292+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3018044070 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.292+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f301803d3f0 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.292+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301c1060b0 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.295+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3018046450 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.353+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f301c194040 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.353+0000 7f30127fc640 1 -- 172.21.15.81:0/3061448884 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f3018046630 con 0x7f301c105c30 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 msgr2=0x7f301c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 --2- 172.21.15.81:0/3061448884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c108490 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f30180090b0 tx=0x7f30180046c0 comp rx=0 tx=0).stop 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 shutdown_connections 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 --2- 172.21.15.81:0/3061448884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c105c30 0x7f301c108490 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:04.285 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 >> 172.21.15.81:0/3061448884 conn(0x7f301c1017a0 msgr2=0x7f301c18f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:04.286 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 shutdown_connections 2024-09-12T12:07:04.286 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:03.354+0000 7f30236dd640 1 -- 172.21.15.81:0/3061448884 wait complete. 2024-09-12T12:07:04.286 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-09-12T12:07:04.286 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T12:07:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.747+0000 7f767cd10640 1 Processor -- start 2024-09-12T12:07:05.430 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.748+0000 7f767cd10640 1 -- start start 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.748+0000 7f767cd10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f7678107d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.748+0000 7f767cd10640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7678108340 con 0x7f7678107970 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.748+0000 7f767659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f7678107d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.748+0000 7f767659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f7678107d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48026/0 (socket says 172.21.15.81:48026) 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.748+0000 7f767659c640 1 -- 172.21.15.81:0/905282915 learned_addr learned my addr 172.21.15.81:0/905282915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.749+0000 7f767659c640 1 -- 172.21.15.81:0/905282915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7678108b70 con 0x7f7678107970 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.749+0000 7f767659c640 1 --2- 172.21.15.81:0/905282915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f7678107d70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7668009820 tx=0x7f766802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b97ba1e9e2ab32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.749+0000 7f767559a640 1 -- 172.21.15.81:0/905282915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7668037070 con 0x7f7678107970 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.749+0000 7f767559a640 1 -- 172.21.15.81:0/905282915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7668032440 con 0x7f7678107970 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.749+0000 7f767559a640 1 -- 172.21.15.81:0/905282915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7668032740 con 0x7f7678107970 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 -- 172.21.15.81:0/905282915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 msgr2=0x7f7678107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:05.431 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 --2- 172.21.15.81:0/905282915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f7678107d70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7668009820 tx=0x7f766802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 -- 172.21.15.81:0/905282915 shutdown_connections 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 --2- 172.21.15.81:0/905282915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f7678107d70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 -- 172.21.15.81:0/905282915 >> 172.21.15.81:0/905282915 conn(0x7f7678103100 msgr2=0x7f7678105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 -- 172.21.15.81:0/905282915 shutdown_connections 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.750+0000 7f767cd10640 1 -- 172.21.15.81:0/905282915 wait complete. 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767cd10640 1 Processor -- start 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767cd10640 1 -- start start 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767cd10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f767819b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767cd10640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7678109110 con 0x7f7678107970 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f767819b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f767819b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48036/0 (socket says 172.21.15.81:48036) 2024-09-12T12:07:05.432 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767659c640 1 -- 172.21.15.81:0/2908928390 learned_addr learned my addr 172.21.15.81:0/2908928390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.751+0000 7f767659c640 1 -- 172.21.15.81:0/2908928390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767819b680 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f767659c640 1 --2- 172.21.15.81:0/2908928390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f767819b140 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f76680090b0 tx=0x7f76680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7668041070 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766803c7a0 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767819b910 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7668037040 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767819e600 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7668044070 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.752+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f766803d3f0 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.753+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7678109760 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.755+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7668046450 con 0x7f7678107970 2024-09-12T12:07:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.812+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f767819fcd0 con 0x7f7678107970 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.815+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f7668046630 con 0x7f7678107970 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.815+0000 7f766f7fe640 1 -- 172.21.15.81:0/2908928390 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7668056070 con 0x7f7678107970 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 msgr2=0x7f767819b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 --2- 172.21.15.81:0/2908928390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f767819b140 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f76680090b0 tx=0x7f76680046c0 comp rx=0 tx=0).stop 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 shutdown_connections 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 --2- 172.21.15.81:0/2908928390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678107970 0x7f767819b140 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 >> 172.21.15.81:0/2908928390 conn(0x7f7678103100 msgr2=0x7f767818f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 shutdown_connections 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:04.816+0000 7f767cd10640 1 -- 172.21.15.81:0/2908928390 wait complete. 2024-09-12T12:07:05.434 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-09-12T12:07:06.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:05 smithi081 ceph-mon[30585]: from='client.? 172.21.15.81:0/3010534004' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:07:06.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b4e39c640 1 Processor -- start 2024-09-12T12:07:06.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b4e39c640 1 -- start start 2024-09-12T12:07:06.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b4e39c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b48107df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b4e39c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b481083c0 con 0x7f2b481079f0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b48107df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b48107df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48050/0 (socket says 172.21.15.81:48050) 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b47fff640 1 -- 172.21.15.81:0/3311117736 learned_addr learned my addr 172.21.15.81:0/3311117736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.833+0000 7f2b47fff640 1 -- 172.21.15.81:0/3311117736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b48108b50 con 0x7f2b481079f0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.834+0000 7f2b47fff640 1 --2- 172.21.15.81:0/3311117736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b48107df0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009820 tx=0x7f2b3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb324352d524338 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.834+0000 7f2b46ffd640 1 -- 172.21.15.81:0/3311117736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38037070 con 0x7f2b481079f0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.834+0000 7f2b46ffd640 1 -- 172.21.15.81:0/3311117736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2b38032920 con 0x7f2b481079f0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.834+0000 7f2b46ffd640 1 -- 172.21.15.81:0/3311117736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38030950 con 0x7f2b481079f0 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3311117736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 msgr2=0x7f2b48107df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 --2- 172.21.15.81:0/3311117736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b48107df0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009820 tx=0x7f2b3802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:06.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3311117736 shutdown_connections 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 --2- 172.21.15.81:0/3311117736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b48107df0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3311117736 >> 172.21.15.81:0/3311117736 conn(0x7f2b481031e0 msgr2=0x7f2b48105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3311117736 shutdown_connections 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.835+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3311117736 wait complete. 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b4e39c640 1 Processor -- start 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b4e39c640 1 -- start start 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b4e39c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b4819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b4e39c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4810bf00 con 0x7f2b481079f0 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b4819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b4819b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48064/0 (socket says 172.21.15.81:48064) 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b47fff640 1 -- 172.21.15.81:0/3010534004 learned_addr learned my addr 172.21.15.81:0/3010534004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b47fff640 1 -- 172.21.15.81:0/3010534004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4819bf20 con 0x7f2b481079f0 2024-09-12T12:07:06.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b47fff640 1 --2- 172.21.15.81:0/3010534004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b4819b9e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009940 tx=0x7f2b38032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38042070 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2b380326b0 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4819c1b0 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.836+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38037040 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.837+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4819eea0 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.837+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b38045070 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.837+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b38047bc0 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.837+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b48107e70 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.840+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2b3803dbf0 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.897+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f2b4819f410 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.897+0000 7f2b457fa640 1 -- 172.21.15.81:0/3010534004 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f2b3803d430 con 0x7f2b481079f0 2024-09-12T12:07:06.420 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 msgr2=0x7f2b4819b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 --2- 172.21.15.81:0/3010534004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b4819b9e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009940 tx=0x7f2b38032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 shutdown_connections 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 --2- 172.21.15.81:0/3010534004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481079f0 0x7f2b4819b9e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 >> 172.21.15.81:0/3010534004 conn(0x7f2b481031e0 msgr2=0x7f2b48103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 shutdown_connections 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:05.898+0000 7f2b4e39c640 1 -- 172.21.15.81:0/3010534004 wait complete. 2024-09-12T12:07:06.421 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-09-12T12:07:06.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:06 smithi081 systemd[1]: Stopping Ceph mon.a for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:07:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:06 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a[30581]: 2024-09-12T12:07:06.713+0000 7fa7aac05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:07:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:06 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a[30581]: 2024-09-12T12:07:06.713+0000 7fa7aac05640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T12:07:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:06 smithi081 podman[30828]: 2024-09-12 12:07:06.847066329 +0000 UTC m=+0.269396973 container died ce3b0b2c7ad11bac29e1315f8475a01095b5e1a2019e5d37c571a7912170cf43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T12:07:07.464 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 podman[30828]: 2024-09-12 12:07:07.197046314 +0000 UTC m=+0.619376957 container cleanup ce3b0b2c7ad11bac29e1315f8475a01095b5e1a2019e5d37c571a7912170cf43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:07:07.464 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 bash[30828]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a 2024-09-12T12:07:07.806 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 podman[30839]: 2024-09-12 12:07:07.464737922 +0000 UTC m=+0.612099937 container remove ce3b0b2c7ad11bac29e1315f8475a01095b5e1a2019e5d37c571a7912170cf43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T12:07:07.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 systemd[1]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T12:07:07.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 systemd[1]: Stopped Ceph mon.a for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:07:07.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 systemd[1]: Starting Ceph mon.a for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:07:08.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 podman[30929]: 2024-09-12 12:07:07.807395949 +0000 UTC m=+0.105777475 container create 7a932bbc29bfb216e90a65f40df06f5666b3b3350911f873b2d9209bc939f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:07:08.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:07 smithi081 podman[30929]: 2024-09-12 12:07:07.717209667 +0000 UTC m=+0.015591199 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T12:07:08.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 podman[30929]: 2024-09-12 12:07:08.054483601 +0000 UTC m=+0.352865126 container init 7a932bbc29bfb216e90a65f40df06f5666b3b3350911f873b2d9209bc939f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T12:07:08.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 podman[30929]: 2024-09-12 12:07:08.057662245 +0000 UTC m=+0.356043771 container start 7a932bbc29bfb216e90a65f40df06f5666b3b3350911f873b2d9209bc939f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T12:07:08.138 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T12:07:08.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T12:07:08.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: pidfile_write: ignore empty --pid-file 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: load: jerasure load: lrc 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: RocksDB version: 7.9.2 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Git sha 0 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: DB SUMMARY 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: DB Session ID: QOVFE4K0EV1J3K112CT6 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: CURRENT file: CURRENT 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 107142 ; 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.error_if_exists: 0 2024-09-12T12:07:08.338 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.create_if_missing: 0 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.paranoid_checks: 1 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.env: 0x559a70cdf940 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.info_log: 0x559a71ec36e0 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.statistics: (nil) 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.use_fsync: 0 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_log_file_size: 0 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T12:07:08.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.allow_fallocate: 1 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.use_direct_reads: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.db_log_dir: 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.wal_dir: 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T12:07:08.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.write_buffer_manager: 0x559a71ed2dc0 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T12:07:08.341 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.unordered_write: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.row_cache: None 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.wal_filter: None 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.two_write_queues: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T12:07:08.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.wal_compression: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.atomic_flush: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.log_readahead_size: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T12:07:08.343 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_background_jobs: 2 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_background_compactions: -1 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_subcompactions: 1 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_open_files: -1 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T12:07:08.344 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_background_flushes: -1 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Compression algorithms supported: 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kZSTD supported: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kXpressCompression supported: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kBZip2Compression supported: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kLZ4Compression supported: 1 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kZlibCompression supported: 1 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T12:07:08.345 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: kSnappyCompression supported: 1 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.merge_operator: 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_filter: None 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559a71ec3320) 2024-09-12T12:07:08.346 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-09-12T12:07:08.347 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_type: 0 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_index_type: 0 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_shortening: 1 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: checksum: 4 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: no_block_cache: 0 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache: 0x559a71eb71f0 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_options: 2024-09-12T12:07:08.348 INFO:journalctl@ceph.mon.a.smithi081.stdout: capacity : 536870912 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_shard_bits : 4 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: strict_capacity_limit : 0 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_compressed: (nil) 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: persistent_cache: (nil) 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size: 4096 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size_deviation: 10 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_restart_interval: 16 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_block_restart_interval: 1 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: metadata_block_size: 4096 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: partition_filters: 0 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: use_delta_encoding: 1 2024-09-12T12:07:08.349 INFO:journalctl@ceph.mon.a.smithi081.stdout: filter_policy: bloomfilter 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: whole_key_filtering: 1 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: verify_compression: 0 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: format_version: 5 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_index_compression: 1 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_align: 0 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: max_auto_readahead_size: 262144 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: prepopulate_block_cache: 0 2024-09-12T12:07:08.350 INFO:journalctl@ceph.mon.a.smithi081.stdout: initial_auto_readahead_size: 8192 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression: NoCompression 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.num_levels: 7 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T12:07:08.351 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T12:07:08.352 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T12:07:08.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T12:07:08.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T12:07:08.355 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.inplace_update_support: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.bloom_locality: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.max_successive_merges: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.ttl: 2592000 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T12:07:08.356 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.enable_blob_files: false 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.min_blob_size: 0 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T12:07:08.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 381c4c40-37cd-42c2-9225-14fcd34e6870 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726142828083999, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726142828085006, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101963, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 99848, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14768, "raw_average_key_size": 50, "raw_value_size": 91929, "raw_average_value_size": 311, "num_data_blocks": 12, "num_entries": 295, "num_filter_entries": 295, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726142828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "381c4c40-37cd-42c2-9225-14fcd34e6870", "db_session_id": "QOVFE4K0EV1J3K112CT6", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726142828085101, "job": 1, "event": "recovery_finished"} 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559a71ee4e00 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: DB pointer 0x559a71fe0000 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** DB Stats ** 2024-09-12T12:07:08.358 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: L0 2/0 101.43 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Sum 2/0 101.43 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:07:08.359 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 152.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T12:07:08.360 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative compaction: 0.00 GB write, 30.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval compaction: 0.00 GB write, 30.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache BinnedLRUCache@0x559a71eb71f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: starting mon.a rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???) e1 preinit fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).mds e1 new map 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).mds e1 print_map 2024-09-12T12:07:08.361 INFO:journalctl@ceph.mon.a.smithi081.stdout: e1 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout: btime 2024-09-12T12:07:02:813206+0000 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout: legacy client fscid: -1 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout: No filesystems configured 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 bash[30929]: 7a932bbc29bfb216e90a65f40df06f5666b3b3350911f873b2d9209bc939f3aa 2024-09-12T12:07:08.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 systemd[1]: Started Ceph mon.a for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: monmap epoch 1 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: last_changed 2024-09-12T12:06:59.805503+0000 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: created 2024-09-12T12:06:59.805503+0000 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: min_mon_release 19 (squid) 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: election_strategy: 1 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: fsmap 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T12:07:08.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:08 smithi081 ceph-mon[30948]: mgrmap e1: no daemons active 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.525+0000 7f72e2fae640 1 Processor -- start 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.525+0000 7f72e2fae640 1 -- start start 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.525+0000 7f72e2fae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc108250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.525+0000 7f72e2fae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc108820 con 0x7f72dc107e50 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.525+0000 7f72e0d4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc108250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.526+0000 7f72e0d4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc108250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48070/0 (socket says 172.21.15.81:48070) 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.526+0000 7f72e0d4a640 1 -- 172.21.15.81:0/3348864144 learned_addr learned my addr 172.21.15.81:0/3348864144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.526+0000 7f72e0d4a640 1 -- 172.21.15.81:0/3348864144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc106b00 con 0x7f72dc107e50 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72e0d4a640 1 --2- 172.21.15.81:0/3348864144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc108250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009820 tx=0x7f72d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57901a160d3eb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72db7fe640 1 -- 172.21.15.81:0/3348864144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d0037070 con 0x7f72dc107e50 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72db7fe640 1 -- 172.21.15.81:0/3348864144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f72d0032920 con 0x7f72dc107e50 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72db7fe640 1 -- 172.21.15.81:0/3348864144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d0030950 con 0x7f72dc107e50 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72e2fae640 1 -- 172.21.15.81:0/3348864144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 msgr2=0x7f72dc108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72e2fae640 1 --2- 172.21.15.81:0/3348864144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc108250 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009820 tx=0x7f72d002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72e2fae640 1 -- 172.21.15.81:0/3348864144 shutdown_connections 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72e2fae640 1 --2- 172.21.15.81:0/3348864144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc108250 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.528+0000 7f72e2fae640 1 -- 172.21.15.81:0/3348864144 >> 172.21.15.81:0/3348864144 conn(0x7f72dc1017a0 msgr2=0x7f72dc103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e2fae640 1 -- 172.21.15.81:0/3348864144 shutdown_connections 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e2fae640 1 -- 172.21.15.81:0/3348864144 wait complete. 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e2fae640 1 Processor -- start 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e2fae640 1 -- start start 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e2fae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc106470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e2fae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc10ad40 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e0d4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e0d4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc106470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48074/0 (socket says 172.21.15.81:48074) 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.529+0000 7f72e0d4a640 1 -- 172.21.15.81:0/387479758 learned_addr learned my addr 172.21.15.81:0/387479758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72e0d4a640 1 -- 172.21.15.81:0/387479758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc19e770 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72e0d4a640 1 --2- 172.21.15.81:0/387479758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc106470 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009940 tx=0x7f72d0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d0042070 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f72d00325f0 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72dc19e940 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72d0037040 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72dc19ece0 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72d0045070 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.530+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f72d0047bd0 con 0x7f72dc107e50 2024-09-12T12:07:09.133 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.531+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72dc1082d0 con 0x7f72dc107e50 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.533+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f72d003c840 con 0x7f72dc107e50 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.590+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f72dc19f1b0 con 0x7f72dc107e50 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.595+0000 7f72d9ffb640 1 -- 172.21.15.81:0/387479758 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f72d003ca20 con 0x7f72dc107e50 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.595+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 msgr2=0x7f72dc106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.595+0000 7f72e2fae640 1 --2- 172.21.15.81:0/387479758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc106470 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009940 tx=0x7f72d0032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.595+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 shutdown_connections 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.595+0000 7f72e2fae640 1 --2- 172.21.15.81:0/387479758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72dc107e50 0x7f72dc106470 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.595+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 >> 172.21.15.81:0/387479758 conn(0x7f72dc1017a0 msgr2=0x7f72dc102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.596+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 shutdown_connections 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:08.596+0000 7f72e2fae640 1 -- 172.21.15.81:0/387479758 wait complete. 2024-09-12T12:07:09.134 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T12:07:09.149 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:07:09.149 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-09-12T12:07:09.152 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T12:07:09.152 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T12:07:09.413 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x 2024-09-12T12:07:09.413 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T12:07:09.564 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968.target.wants/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@.service. 2024-09-12T12:07:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:09 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/387479758' entity='client.admin' 2024-09-12T12:07:09.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:09 smithi081 podman[31161]: 2024-09-12 12:07:09.802000159 +0000 UTC m=+0.118168541 container create 100e314494c1f6424dbad09ed1161451ed20cd9bcfc0b0dd78253ce1d1ab6a73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T12:07:10.126 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:07:10.127 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T12:07:10.133 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:07:10.134 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T12:07:10.134 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T12:07:10.134 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T12:07:10.142 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:07:10.143 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T12:07:10.150 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:07:10.150 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T12:07:10.150 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T12:07:10.150 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T12:07:10.150 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-09-12T12:07:10.150 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-09-12T12:07:10.202 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 podman[31161]: 2024-09-12 12:07:10.012697486 +0000 UTC m=+0.328865871 container init 100e314494c1f6424dbad09ed1161451ed20cd9bcfc0b0dd78253ce1d1ab6a73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T12:07:10.203 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 podman[31161]: 2024-09-12 12:07:10.015371278 +0000 UTC m=+0.331539666 container start 100e314494c1f6424dbad09ed1161451ed20cd9bcfc0b0dd78253ce1d1ab6a73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:07:10.203 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 bash[31161]: 100e314494c1f6424dbad09ed1161451ed20cd9bcfc0b0dd78253ce1d1ab6a73 2024-09-12T12:07:10.203 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 systemd[1]: Started Ceph mgr.x for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:07:10.203 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:10.135+0000 7f0b022cf040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:07:10.203 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:10.201+0000 7f0b022cf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:07:10.516 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:10.351+0000 7f0b022cf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:07:10.516 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:10.419+0000 7f0b022cf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:07:10.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3604224548' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:07:10.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:10.569+0000 7f0b022cf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:07:10.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:10.718+0000 7f0b022cf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:07:11.252 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:11.038+0000 7f0b022cf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:07:11.252 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:11.099+0000 7f0b022cf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:07:11.254 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:11.257 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:11.257 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:07:11.257 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:07:11.257 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:07:11.257 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:11.258 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:07:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:07:11.266 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:07:11.266 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:07:11.267 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:07:02:813206+0000", 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:07:11.268 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:07:02.815853+0000", 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.594+0000 7efc9abe9640 1 Processor -- start 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.594+0000 7efc9abe9640 1 -- start start 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.594+0000 7efc9abe9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9410a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.594+0000 7efc9abe9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc94063510 con 0x7efc941083b0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.595+0000 7efc98985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9410a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.595+0000 7efc98985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9410a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48118/0 (socket says 172.21.15.81:48118) 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.595+0000 7efc98985640 1 -- 172.21.15.81:0/3952906625 learned_addr learned my addr 172.21.15.81:0/3952906625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.595+0000 7efc98985640 1 -- 172.21.15.81:0/3952906625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9410ace0 con 0x7efc941083b0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.596+0000 7efc98985640 1 --2- 172.21.15.81:0/3952906625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9410a7a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc88009820 tx=0x7efc8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8375c53043f4e243 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.596+0000 7efc937fe640 1 -- 172.21.15.81:0/3952906625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc88037070 con 0x7efc941083b0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.596+0000 7efc937fe640 1 -- 172.21.15.81:0/3952906625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efc88032920 con 0x7efc941083b0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.596+0000 7efc937fe640 1 -- 172.21.15.81:0/3952906625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc88030950 con 0x7efc941083b0 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 -- 172.21.15.81:0/3952906625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 msgr2=0x7efc9410a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 --2- 172.21.15.81:0/3952906625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9410a7a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc88009820 tx=0x7efc8802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 -- 172.21.15.81:0/3952906625 shutdown_connections 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 --2- 172.21.15.81:0/3952906625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9410a7a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 -- 172.21.15.81:0/3952906625 >> 172.21.15.81:0/3952906625 conn(0x7efc941020b0 msgr2=0x7efc941044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 -- 172.21.15.81:0/3952906625 shutdown_connections 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 -- 172.21.15.81:0/3952906625 wait complete. 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 Processor -- start 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.597+0000 7efc9abe9640 1 -- start start 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc9abe9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc9abe9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc9410bde0 con 0x7efc941083b0 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc98985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc98985640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48122/0 (socket says 172.21.15.81:48122) 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc98985640 1 -- 172.21.15.81:0/3604224548 learned_addr learned my addr 172.21.15.81:0/3604224548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc98985640 1 -- 172.21.15.81:0/3604224548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9419beb0 con 0x7efc941083b0 2024-09-12T12:07:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc98985640 1 --2- 172.21.15.81:0/3604224548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9419b970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efc88031000 tx=0x7efc88032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc88042070 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efc880326b0 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9419c140 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.598+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc88037040 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.599+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9419ee30 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.599+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc88045070 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.599+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efc88047bc0 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.600+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9419c620 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.602+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efc9419c620 con 0x7efc941083b0 2024-09-12T12:07:11.272 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.663+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efc9419f000 con 0x7efc941083b0 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.663+0000 7efc91ffb640 1 -- 172.21.15.81:0/3604224548 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7efc8803dbf0 con 0x7efc941083b0 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 msgr2=0x7efc9419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 --2- 172.21.15.81:0/3604224548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9419b970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efc88031000 tx=0x7efc88032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 shutdown_connections 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 --2- 172.21.15.81:0/3604224548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc941083b0 0x7efc9419b970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 >> 172.21.15.81:0/3604224548 conn(0x7efc941020b0 msgr2=0x7efc94102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 shutdown_connections 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:10.664+0000 7efc9abe9640 1 -- 172.21.15.81:0/3604224548 wait complete. 2024-09-12T12:07:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-09-12T12:07:11.609 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:11.290+0000 7f0b022cf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:07:12.609 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:12.156+0000 7f0b022cf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:07:12.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:12.222+0000 7f0b022cf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:07:13.223 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:12.940+0000 7f0b022cf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:07:13.223 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.081+0000 7f0b022cf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:07:13.224 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.223+0000 7f0b022cf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:07:13.507 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.287+0000 7f0b022cf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:07:13.507 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.438+0000 7f0b022cf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:07:13.507 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.506+0000 7f0b022cf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:07:13.757 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.572+0000 7f0b022cf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:07:13.758 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.734+0000 7f0b022cf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:07:14.015 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2635145127' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:07:14.015 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.803+0000 7f0b022cf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:07:14.015 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.874+0000 7f0b022cf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:07:14.015 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:13.955+0000 7f0b022cf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:07:14.015 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:14.014+0000 7f0b022cf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:07:14.359 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:14.074+0000 7f0b022cf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:07:14.484 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:14.484 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:14.484 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:07:14.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:07:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:07:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:07:02:813206+0000", 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T12:07:14.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:07:02.815853+0000", 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:07:14.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4cd15640 1 Processor -- start 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4cd15640 1 -- start start 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4cd15640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4810a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4cd15640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b48063510 con 0x7f2b481083b0 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4810a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4810a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55058/0 (socket says 172.21.15.81:55058) 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.752+0000 7f2b4659c640 1 -- 172.21.15.81:0/174317237 learned_addr learned my addr 172.21.15.81:0/174317237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.753+0000 7f2b4659c640 1 -- 172.21.15.81:0/174317237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4810ace0 con 0x7f2b481083b0 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.753+0000 7f2b4659c640 1 --2- 172.21.15.81:0/174317237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4810a7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009820 tx=0x7f2b3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a34f718edc1f73b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:14.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.753+0000 7f2b4559a640 1 -- 172.21.15.81:0/174317237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38037070 con 0x7f2b481083b0 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.753+0000 7f2b4559a640 1 -- 172.21.15.81:0/174317237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2b38032920 con 0x7f2b481083b0 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.753+0000 7f2b4559a640 1 -- 172.21.15.81:0/174317237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38030950 con 0x7f2b481083b0 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 -- 172.21.15.81:0/174317237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 msgr2=0x7f2b4810a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 --2- 172.21.15.81:0/174317237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4810a7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009820 tx=0x7f2b3802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 -- 172.21.15.81:0/174317237 shutdown_connections 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 --2- 172.21.15.81:0/174317237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4810a7a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 -- 172.21.15.81:0/174317237 >> 172.21.15.81:0/174317237 conn(0x7f2b481020b0 msgr2=0x7f2b481044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 -- 172.21.15.81:0/174317237 shutdown_connections 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.754+0000 7f2b4cd15640 1 -- 172.21.15.81:0/174317237 wait complete. 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4cd15640 1 Processor -- start 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4cd15640 1 -- start start 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4cd15640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:14.491 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4cd15640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4810bde0 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55064/0 (socket says 172.21.15.81:55064) 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.755+0000 7f2b4659c640 1 -- 172.21.15.81:0/2635145127 learned_addr learned my addr 172.21.15.81:0/2635145127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b4659c640 1 -- 172.21.15.81:0/2635145127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4819beb0 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b4659c640 1 --2- 172.21.15.81:0/2635145127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4819b970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b38031000 tx=0x7f2b38032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38042070 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2b380326b0 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4819c140 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b38037040 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4819ee30 con 0x7f2b481083b0 2024-09-12T12:07:14.492 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2b38045070 con 0x7f2b481083b0 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.756+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b38047bd0 con 0x7f2b481083b0 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.757+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b48108810 con 0x7f2b481083b0 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.761+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2b3803dbf0 con 0x7f2b481083b0 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.822+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2b4819f000 con 0x7f2b481083b0 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.822+0000 7f2b377fe640 1 -- 172.21.15.81:0/2635145127 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f2b3803d430 con 0x7f2b481083b0 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 msgr2=0x7f2b4819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 --2- 172.21.15.81:0/2635145127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4819b970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b38031000 tx=0x7f2b38032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 shutdown_connections 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 --2- 172.21.15.81:0/2635145127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b481083b0 0x7f2b4819b970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 >> 172.21.15.81:0/2635145127 conn(0x7f2b481020b0 msgr2=0x7f2b48102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 shutdown_connections 2024-09-12T12:07:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:13.823+0000 7f2b4cd15640 1 -- 172.21.15.81:0/2635145127 wait complete. 2024-09-12T12:07:14.494 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (2/15)... 2024-09-12T12:07:15.359 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:14.860+0000 7f0b022cf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: Activating manager daemon x 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: mgrmap e2: x(active, starting, since 0.00280046s) 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:07:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:14 smithi081 ceph-mon[30948]: Manager daemon x is now available 2024-09-12T12:07:16.261 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:15 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:07:16.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:15 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:07:16.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:15 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' 2024-09-12T12:07:16.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:15 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' 2024-09-12T12:07:16.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:15 smithi081 ceph-mon[30948]: from='mgr.14100 172.21.15.81:0/491256659' entity='mgr.x' 2024-09-12T12:07:16.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:15 smithi081 ceph-mon[30948]: mgrmap e3: x(active, since 1.00672s) 2024-09-12T12:07:17.729 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T12:07:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T12:07:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T12:07:17.732 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T12:07:02:813206+0000", 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T12:07:17.733 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T12:07:02.815853+0000", 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.873+0000 7f8fbc22d640 1 Processor -- start 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fbc22d640 1 -- start start 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fbc22d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb410a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fbc22d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40634d0 con 0x7f8fb41083f0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fb9fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb410a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fb9fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb410a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55142/0 (socket says 172.21.15.81:55142) 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fb9fc9640 1 -- 172.21.15.81:0/3866306147 learned_addr learned my addr 172.21.15.81:0/3866306147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.874+0000 7f8fb9fc9640 1 -- 172.21.15.81:0/3866306147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb410ad20 con 0x7f8fb41083f0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.875+0000 7f8fb9fc9640 1 --2- 172.21.15.81:0/3866306147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb410a7e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009820 tx=0x7f8fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6bc7577c2c3755 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.875+0000 7f8fb8fc7640 1 -- 172.21.15.81:0/3866306147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0037070 con 0x7f8fb41083f0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.875+0000 7f8fb8fc7640 1 -- 172.21.15.81:0/3866306147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8fb0032920 con 0x7f8fb41083f0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.875+0000 7f8fb8fc7640 1 -- 172.21.15.81:0/3866306147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0030950 con 0x7f8fb41083f0 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3866306147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 msgr2=0x7f8fb410a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 --2- 172.21.15.81:0/3866306147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb410a7e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009820 tx=0x7f8fb002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3866306147 shutdown_connections 2024-09-12T12:07:17.735 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 --2- 172.21.15.81:0/3866306147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb410a7e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3866306147 >> 172.21.15.81:0/3866306147 conn(0x7f8fb41020b0 msgr2=0x7f8fb41044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3866306147 shutdown_connections 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3866306147 wait complete. 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 Processor -- start 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.876+0000 7f8fbc22d640 1 -- start start 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fbc22d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb4107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fbc22d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb410bdc0 con 0x7f8fb41083f0 2024-09-12T12:07:17.736 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fb9fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb4107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fb9fc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb4107c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55158/0 (socket says 172.21.15.81:55158) 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fb9fc9640 1 -- 172.21.15.81:0/3525645313 learned_addr learned my addr 172.21.15.81:0/3525645313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fb9fc9640 1 -- 172.21.15.81:0/3525645313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb41081b0 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.877+0000 7f8fb9fc9640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb4107c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0006f10 tx=0x7f8fb00327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.878+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb0037040 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.878+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb41063a0 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.878+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8fb0040070 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.878+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb003a630 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.878+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41068e0 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.879+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb4108850 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.881+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f8fb003ba70 con 0x7f8fb41083f0 2024-09-12T12:07:17.737 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.881+0000 7f8faaffd640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f8fa0038f70 0x7f8fa003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.881+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8fb006c6d0 con 0x7f8fb41083f0 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.882+0000 7f8fb97c8640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f8fa0038f70 0x7f8fa003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.882+0000 7f8fb97c8640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f8fa0038f70 0x7f8fa003b430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40098c0 tx=0x7f8fa4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:16.886+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fb0043c60 con 0x7f8fb41083f0 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.125+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8fb4106cc0 con 0x7f8fb41083f0 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.126+0000 7f8faaffd640 1 -- 172.21.15.81:0/3525645313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f8fb00328e0 con 0x7f8fb41083f0 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f8fa0038f70 msgr2=0x7f8fa003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f8fa0038f70 0x7f8fa003b430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40098c0 tx=0x7f8fa4006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 msgr2=0x7f8fb4107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb4107c70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0006f10 tx=0x7f8fb00327d0 comp rx=0 tx=0).stop 2024-09-12T12:07:17.738 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 shutdown_connections 2024-09-12T12:07:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f8fa0038f70 0x7f8fa003b430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 --2- 172.21.15.81:0/3525645313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb41083f0 0x7f8fb4107c70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 >> 172.21.15.81:0/3525645313 conn(0x7f8fb41020b0 msgr2=0x7f8fb4102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 shutdown_connections 2024-09-12T12:07:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:17.128+0000 7f8fbc22d640 1 -- 172.21.15.81:0/3525645313 wait complete. 2024-09-12T12:07:17.739 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-09-12T12:07:18.094 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:17 smithi081 ceph-mon[30948]: mgrmap e4: x(active, since 2s) 2024-09-12T12:07:18.094 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:17 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3525645313' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T12:07:19.073 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:18 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2772158647' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T12:07:19.076 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T12:07:19.083 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T12:07:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa831e84640 1 Processor -- start 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa831e84640 1 -- start start 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa831e84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c107de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa831e84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c108320 con 0x7fa82c1079e0 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa82b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa82b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c107de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55168/0 (socket says 172.21.15.81:55168) 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.170+0000 7fa82b7fe640 1 -- 172.21.15.81:0/1933965835 learned_addr learned my addr 172.21.15.81:0/1933965835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.171+0000 7fa82b7fe640 1 -- 172.21.15.81:0/1933965835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c1084a0 con 0x7fa82c1079e0 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.171+0000 7fa82b7fe640 1 --2- 172.21.15.81:0/1933965835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c107de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa820009820 tx=0x7fa82002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e5c1ac7488a821 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.171+0000 7fa82a7fc640 1 -- 172.21.15.81:0/1933965835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820037070 con 0x7fa82c1079e0 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.171+0000 7fa82a7fc640 1 -- 172.21.15.81:0/1933965835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa820032920 con 0x7fa82c1079e0 2024-09-12T12:07:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.171+0000 7fa82a7fc640 1 -- 172.21.15.81:0/1933965835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820030950 con 0x7fa82c1079e0 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 -- 172.21.15.81:0/1933965835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 msgr2=0x7fa82c107de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 --2- 172.21.15.81:0/1933965835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c107de0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa820009820 tx=0x7fa82002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 -- 172.21.15.81:0/1933965835 shutdown_connections 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 --2- 172.21.15.81:0/1933965835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c107de0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 -- 172.21.15.81:0/1933965835 >> 172.21.15.81:0/1933965835 conn(0x7fa82c103250 msgr2=0x7fa82c105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 -- 172.21.15.81:0/1933965835 shutdown_connections 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.172+0000 7fa831e84640 1 -- 172.21.15.81:0/1933965835 wait complete. 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa831e84640 1 Processor -- start 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa831e84640 1 -- start start 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa831e84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa831e84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c10be00 con 0x7fa82c1079e0 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa82b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa82b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55184/0 (socket says 172.21.15.81:55184) 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa82b7fe640 1 -- 172.21.15.81:0/2772158647 learned_addr learned my addr 172.21.15.81:0/2772158647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa82b7fe640 1 -- 172.21.15.81:0/2772158647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c19bf00 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.173+0000 7fa82b7fe640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c19b9c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa820031000 tx=0x7fa820032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.174+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820042070 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.174+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa8200325f0 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.174+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c19c190 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.174+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820037040 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.174+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c19ee80 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.174+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fa820045070 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.175+0000 7fa828ff9640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fa814038f70 0x7fa81403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.175+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c107e60 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.175+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa82006bfe0 con 0x7fa82c1079e0 2024-09-12T12:07:19.087 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.175+0000 7fa82affd640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fa814038f70 0x7fa81403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.175+0000 7fa82affd640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fa814038f70 0x7fa81403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0098c0 tx=0x7fa81c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.179+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa820042210 con 0x7fa82c1079e0 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.347+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa82c19f050 con 0x7fa82c1079e0 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.348+0000 7fa828ff9640 1 -- 172.21.15.81:0/2772158647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fa82c19f050 con 0x7fa82c1079e0 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fa814038f70 msgr2=0x7fa81403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fa814038f70 0x7fa81403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0098c0 tx=0x7fa81c006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 msgr2=0x7fa82c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c19b9c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa820031000 tx=0x7fa820032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 shutdown_connections 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fa814038f70 0x7fa81403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 --2- 172.21.15.81:0/2772158647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c1079e0 0x7fa82c19b9c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 >> 172.21.15.81:0/2772158647 conn(0x7fa82c103250 msgr2=0x7fa82c103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:19.088 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 shutdown_connections 2024-09-12T12:07:19.089 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:18.350+0000 7fa831e84640 1 -- 172.21.15.81:0/2772158647 wait complete. 2024-09-12T12:07:19.089 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-09-12T12:07:19.927 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:19 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3787075003' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T12:07:20.229 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ignoring --setuser ceph since I am not root 2024-09-12T12:07:20.229 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ignoring --setgroup ceph since I am not root 2024-09-12T12:07:20.229 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.021+0000 7f87d4e41040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:07:20.229 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.077+0000 7f87d4e41040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:07:20.229 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.226+0000 7f87d4e41040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:07:20.538 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.293+0000 7f87d4e41040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:07:20.538 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.439+0000 7f87d4e41040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.441+0000 7efced69f640 1 Processor -- start 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.441+0000 7efced69f640 1 -- start start 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.441+0000 7efced69f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce8106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.441+0000 7efced69f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efce8106600 con 0x7efce8105c30 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.441+0000 7efce6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce8106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.441+0000 7efce6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce8106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55198/0 (socket says 172.21.15.81:55198) 2024-09-12T12:07:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.442+0000 7efce6ffd640 1 -- 172.21.15.81:0/1809188034 learned_addr learned my addr 172.21.15.81:0/1809188034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.442+0000 7efce6ffd640 1 -- 172.21.15.81:0/1809188034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce81069a0 con 0x7efce8105c30 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.442+0000 7efce6ffd640 1 --2- 172.21.15.81:0/1809188034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce8106030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009820 tx=0x7efcd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d728bfcc0c064ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efce67fc640 1 -- 172.21.15.81:0/1809188034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8037070 con 0x7efce8105c30 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efce67fc640 1 -- 172.21.15.81:0/1809188034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efcd8032920 con 0x7efce8105c30 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efce67fc640 1 -- 172.21.15.81:0/1809188034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8030950 con 0x7efce8105c30 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 -- 172.21.15.81:0/1809188034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 msgr2=0x7efce8106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 --2- 172.21.15.81:0/1809188034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce8106030 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009820 tx=0x7efcd802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 -- 172.21.15.81:0/1809188034 shutdown_connections 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 --2- 172.21.15.81:0/1809188034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce8106030 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 -- 172.21.15.81:0/1809188034 >> 172.21.15.81:0/1809188034 conn(0x7efce8101800 msgr2=0x7efce8103c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 -- 172.21.15.81:0/1809188034 shutdown_connections 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.443+0000 7efced69f640 1 -- 172.21.15.81:0/1809188034 wait complete. 2024-09-12T12:07:20.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efced69f640 1 Processor -- start 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efced69f640 1 -- start start 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efced69f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efced69f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efce8107be0 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efce6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efce6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55202/0 (socket says 172.21.15.81:55202) 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.444+0000 7efce6ffd640 1 -- 172.21.15.81:0/3787075003 learned_addr learned my addr 172.21.15.81:0/3787075003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efce6ffd640 1 -- 172.21.15.81:0/3787075003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce819e110 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efce6ffd640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce819dbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097f0 tx=0x7efcd8032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8037040 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce819e3a0 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efcd8040070 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd803a6d0 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.445+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce81a1090 con 0x7efce8105c30 2024-09-12T12:07:20.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.446+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7efcd803b420 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.446+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce81060b0 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.446+0000 7efce4ff9640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7efcd4038f20 0x7efcd403b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.446+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efcd806c090 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.446+0000 7efcde7fc640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7efcd4038f20 0x7efcd403b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.447+0000 7efcde7fc640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7efcd4038f20 0x7efcd403b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efcd00098c0 tx=0x7efcd0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.451+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcd804a200 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.660+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7efce8197090 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.882+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7efcd8031e80 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.883+0000 7efce4ff9640 1 -- 172.21.15.81:0/3787075003 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7efcd803a8c0 con 0x7efce8105c30 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7efcd4038f20 msgr2=0x7efcd403b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7efcd4038f20 0x7efcd403b3e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efcd00098c0 tx=0x7efcd0006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 msgr2=0x7efce819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce819dbd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097f0 tx=0x7efcd8032d00 comp rx=0 tx=0).stop 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 shutdown_connections 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7efcd4038f20 0x7efcd403b3e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 --2- 172.21.15.81:0/3787075003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce8105c30 0x7efce819dbd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 >> 172.21.15.81:0/3787075003 conn(0x7efce8101800 msgr2=0x7efce81941e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 shutdown_connections 2024-09-12T12:07:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:19.885+0000 7efced69f640 1 -- 172.21.15.81:0/3787075003 wait complete. 2024-09-12T12:07:20.796 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.584+0000 7f87d4e41040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:07:21.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3787075003' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T12:07:21.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-mon[30948]: mgrmap e5: x(active, since 5s) 2024-09-12T12:07:21.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.903+0000 7f87d4e41040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:07:21.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:20.967+0000 7f87d4e41040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:07:21.527 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:21.160+0000 7f87d4e41040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:07:21.835 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:21.835 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T12:07:21.836 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:07:21.836 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T12:07:21.836 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T12:07:21.836 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:21.836 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f83061cf640 1 Processor -- start 2024-09-12T12:07:21.837 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f83061cf640 1 -- start start 2024-09-12T12:07:21.837 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f83061cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f8300106600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:21.837 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f83061cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83000634b0 con 0x7f8300106200 2024-09-12T12:07:21.837 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f8300106600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:21.837 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f8300106600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55222/0 (socket says 172.21.15.81:55222) 2024-09-12T12:07:21.838 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f82ff7fe640 1 -- 172.21.15.81:0/4287011250 learned_addr learned my addr 172.21.15.81:0/4287011250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:21.838 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.977+0000 7f82ff7fe640 1 -- 172.21.15.81:0/4287011250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8300106b40 con 0x7f8300106200 2024-09-12T12:07:21.838 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.978+0000 7f82ff7fe640 1 --2- 172.21.15.81:0/4287011250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f8300106600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009820 tx=0x7f82f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dd557672b8c019 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:21.838 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.978+0000 7f82fe7fc640 1 -- 172.21.15.81:0/4287011250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0037070 con 0x7f8300106200 2024-09-12T12:07:21.838 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.978+0000 7f82fe7fc640 1 -- 172.21.15.81:0/4287011250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f82f0032920 con 0x7f8300106200 2024-09-12T12:07:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.978+0000 7f82fe7fc640 1 -- 172.21.15.81:0/4287011250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0030950 con 0x7f8300106200 2024-09-12T12:07:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 -- 172.21.15.81:0/4287011250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 msgr2=0x7f8300106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 --2- 172.21.15.81:0/4287011250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f8300106600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009820 tx=0x7f82f002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 -- 172.21.15.81:0/4287011250 shutdown_connections 2024-09-12T12:07:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 --2- 172.21.15.81:0/4287011250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f8300106600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:21.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 -- 172.21.15.81:0/4287011250 >> 172.21.15.81:0/4287011250 conn(0x7f83001020b0 msgr2=0x7f83001044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:21.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 -- 172.21.15.81:0/4287011250 shutdown_connections 2024-09-12T12:07:21.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 -- 172.21.15.81:0/4287011250 wait complete. 2024-09-12T12:07:21.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.979+0000 7f83061cf640 1 Processor -- start 2024-09-12T12:07:21.840 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f83061cf640 1 -- start start 2024-09-12T12:07:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f83061cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f830019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f83061cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8300107ca0 con 0x7f8300106200 2024-09-12T12:07:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f830019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f830019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55230/0 (socket says 172.21.15.81:55230) 2024-09-12T12:07:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82ff7fe640 1 -- 172.21.15.81:0/1021992422 learned_addr learned my addr 172.21.15.81:0/1021992422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:21.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82ff7fe640 1 -- 172.21.15.81:0/1021992422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830019e080 con 0x7f8300106200 2024-09-12T12:07:21.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82ff7fe640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f830019db40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82f0031000 tx=0x7f82f0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:21.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0042070 con 0x7f8300106200 2024-09-12T12:07:21.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f82f00326b0 con 0x7f8300106200 2024-09-12T12:07:21.842 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830019e310 con 0x7f8300106200 2024-09-12T12:07:21.843 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0037040 con 0x7f8300106200 2024-09-12T12:07:21.843 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.980+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83001a1000 con 0x7f8300106200 2024-09-12T12:07:21.843 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.981+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f82f0045070 con 0x7f8300106200 2024-09-12T12:07:21.843 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.981+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8300106600 con 0x7f8300106200 2024-09-12T12:07:21.843 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.982+0000 7f82fcff9640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 0x7f82e803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:21.844 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.982+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f82f006bf80 con 0x7f8300106200 2024-09-12T12:07:21.844 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.982+0000 7f82feffd640 1 -- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 msgr2=0x7f82e803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2716402580 2024-09-12T12:07:21.844 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.982+0000 7f82feffd640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 0x7f82e803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:07:21.844 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:20.986+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f82f006b9a0 con 0x7f8300106200 2024-09-12T12:07:21.844 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.183+0000 7f82feffd640 1 -- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 msgr2=0x7f82e803b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2716402580 2024-09-12T12:07:21.845 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.183+0000 7f82feffd640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 0x7f82e803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:07:21.845 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.207+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8300196fb0 con 0x7f8300106200 2024-09-12T12:07:21.845 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.207+0000 7f82fcff9640 1 -- 172.21.15.81:0/1021992422 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f82f003c800 con 0x7f8300106200 2024-09-12T12:07:21.845 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 msgr2=0x7f82e803b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:07:21.845 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 0x7f82e803b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 msgr2=0x7f830019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f830019db40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82f0031000 tx=0x7f82f0032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 shutdown_connections 2024-09-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7f82e8038f70 0x7f82e803b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 --2- 172.21.15.81:0/1021992422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300106200 0x7f830019db40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 >> 172.21.15.81:0/1021992422 conn(0x7f83001020b0 msgr2=0x7f8300191e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:21.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 shutdown_connections 2024-09-12T12:07:21.847 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:21.209+0000 7f83061cf640 1 -- 172.21.15.81:0/1021992422 wait complete. 2024-09-12T12:07:21.847 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-12T12:07:21.847 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-09-12T12:07:22.079 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:21 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1021992422' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T12:07:22.359 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:22.079+0000 7f87d4e41040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:07:22.360 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:22.150+0000 7f87d4e41040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:07:23.118 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:22.863+0000 7f87d4e41040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:07:23.118 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:22.977+0000 7f87d4e41040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:07:23.393 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.118+0000 7f87d4e41040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:07:23.393 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.180+0000 7f87d4e41040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:07:23.393 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.325+0000 7f87d4e41040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:07:23.393 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.393+0000 7f87d4e41040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:07:23.675 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.452+0000 7f87d4e41040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:07:23.675 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.608+0000 7f87d4e41040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:07:23.675 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.674+0000 7f87d4e41040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:07:23.940 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.741+0000 7f87d4e41040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:07:23.941 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.823+0000 7f87d4e41040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:07:23.941 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.881+0000 7f87d4e41040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:07:23.941 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:23.940+0000 7f87d4e41040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:07:25.109 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:24.722+0000 7f87d4e41040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: Active manager daemon x restarted 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: Activating manager daemon x 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: mgrmap e6: x(active, starting, since 0.00374173s) 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:07:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: Manager daemon x is now available 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:07:25.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:24 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:07:26.076 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:25 smithi081 ceph-mon[30948]: Found migration_current of "None". Setting to last migration. 2024-09-12T12:07:26.076 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:25 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:26.076 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:25 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:26.076 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:25 smithi081 ceph-mon[30948]: mgrmap e7: x(active, since 1.00585s) 2024-09-12T12:07:26.343 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.275+0000 7fdc875d3640 1 Processor -- start 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc875d3640 1 -- start start 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc875d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc8010a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc875d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80063510 con 0x7fdc801083b0 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc8536f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc8010a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc8536f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc8010a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54936/0 (socket says 172.21.15.81:54936) 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc8536f640 1 -- 172.21.15.81:0/2826478089 learned_addr learned my addr 172.21.15.81:0/2826478089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:26.344 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.276+0000 7fdc8536f640 1 -- 172.21.15.81:0/2826478089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8010ace0 con 0x7fdc801083b0 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.277+0000 7fdc8536f640 1 --2- 172.21.15.81:0/2826478089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc8010a7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009820 tx=0x7fdc7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc08ebd98b85252 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.277+0000 7fdc77fff640 1 -- 172.21.15.81:0/2826478089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c037070 con 0x7fdc801083b0 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.277+0000 7fdc77fff640 1 -- 172.21.15.81:0/2826478089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdc7c032920 con 0x7fdc801083b0 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.277+0000 7fdc77fff640 1 -- 172.21.15.81:0/2826478089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c030950 con 0x7fdc801083b0 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 -- 172.21.15.81:0/2826478089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 msgr2=0x7fdc8010a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2826478089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc8010a7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009820 tx=0x7fdc7c02a270 comp rx=0 tx=0).stop 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 -- 172.21.15.81:0/2826478089 shutdown_connections 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2826478089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc8010a7a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 -- 172.21.15.81:0/2826478089 >> 172.21.15.81:0/2826478089 conn(0x7fdc801020b0 msgr2=0x7fdc801044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 -- 172.21.15.81:0/2826478089 shutdown_connections 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 -- 172.21.15.81:0/2826478089 wait complete. 2024-09-12T12:07:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.278+0000 7fdc875d3640 1 Processor -- start 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc875d3640 1 -- start start 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc875d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc80107c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc875d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8010bde0 con 0x7fdc801083b0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc8536f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc80107c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc8536f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc80107c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54950/0 (socket says 172.21.15.81:54950) 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc8536f640 1 -- 172.21.15.81:0/2300393555 learned_addr learned my addr 172.21.15.81:0/2300393555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc8536f640 1 -- 172.21.15.81:0/2300393555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc80108170 con 0x7fdc801083b0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc8536f640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc80107c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c006f10 tx=0x7fdc7c0327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c037040 con 0x7fdc801083b0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fdc7c040070 con 0x7fdc801083b0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc80106360 con 0x7fdc801083b0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7c03a630 con 0x7fdc801083b0 2024-09-12T12:07:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.279+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc801068a0 con 0x7fdc801083b0 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.280+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fdc7c03a820 con 0x7fdc801083b0 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.280+0000 7fdc767fc640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.280+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 --> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdc80108810 con 0x7fdc6c038fc0 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.280+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc7c06c380 con 0x7fdc801083b0 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.280+0000 7fdc84b6e640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 msgr2=0x7fdc6c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2716402580 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.280+0000 7fdc84b6e640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.481+0000 7fdc84b6e640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 msgr2=0x7fdc6c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2716402580 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.481+0000 7fdc84b6e640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.882+0000 7fdc84b6e640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 msgr2=0x7fdc6c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2716402580 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:22.882+0000 7fdc84b6e640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:23.683+0000 7fdc84b6e640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 msgr2=0x7fdc6c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2716402580 2024-09-12T12:07:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:23.683+0000 7fdc84b6e640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:24.726+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fdc7c06b180 con 0x7fdc801083b0 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:24.726+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 msgr2=0x7fdc6c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:24.726+0000 7fdc767fc640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.727+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fdc7c045460 con 0x7fdc801083b0 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.727+0000 7fdc767fc640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fdc6c03c700 0x7fdc6c03eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.727+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdc80108810 con 0x7fdc6c03c700 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.727+0000 7fdc84b6e640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fdc6c03c700 0x7fdc6c03eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.728+0000 7fdc84b6e640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fdc6c03c700 0x7fdc6c03eaf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdc70003980 tx=0x7fdc700092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.729+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fdc80108810 con 0x7fdc6c03c700 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.735+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fdc80103310 con 0x7fdc6c03c700 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc767fc640 1 -- 172.21.15.81:0/2300393555 <== mgr.14118 v2:172.21.15.81:6800/2203121669 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fdc80103310 con 0x7fdc6c03c700 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fdc6c03c700 msgr2=0x7fdc6c03eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:26.348 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fdc6c03c700 0x7fdc6c03eaf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdc70003980 tx=0x7fdc700092b0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 msgr2=0x7fdc80107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc80107c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c006f10 tx=0x7fdc7c0327d0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 shutdown_connections 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fdc6c03c700 0x7fdc6c03eaf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:6800/2716402580,v1:172.21.15.81:6801/2716402580] conn(0x7fdc6c038fc0 0x7fdc6c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 --2- 172.21.15.81:0/2300393555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc801083b0 0x7fdc80107c30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 >> 172.21.15.81:0/2300393555 conn(0x7fdc801020b0 msgr2=0x7fdc80102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 shutdown_connections 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:25.736+0000 7fdc875d3640 1 -- 172.21.15.81:0/2300393555 wait complete. 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-09-12T12:07:26.349 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-09-12T12:07:26.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-mon[30948]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-mon[30948]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:26.664+0000 7f873c19b640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:07:26] ENGINE Error in HTTPServer.serve 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: Traceback (most recent call last): 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._connections.run(self.expiration_interval) 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._run(expiration_interval) 2024-09-12T12:07:26.860 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: s = self.context.wrap_socket( 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: return self.sslsocket_class._create( 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self.do_handshake() 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._sslobj.do_handshake() 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:07:26.861 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:27.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125c627640 1 Processor -- start 2024-09-12T12:07:27.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125c627640 1 -- start start 2024-09-12T12:07:27.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125c627640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f1254107df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125c627640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12541083c0 con 0x7f12541079f0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125a3c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f1254107df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125a3c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f1254107df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55044/0 (socket says 172.21.15.81:55044) 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.791+0000 7f125a3c3640 1 -- 172.21.15.81:0/2389074455 learned_addr learned my addr 172.21.15.81:0/2389074455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.792+0000 7f125a3c3640 1 -- 172.21.15.81:0/2389074455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1254108b50 con 0x7f12541079f0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.792+0000 7f125a3c3640 1 --2- 172.21.15.81:0/2389074455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f1254107df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1250009820 tx=0x7f125002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122735eb4fed6cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.792+0000 7f12593c1640 1 -- 172.21.15.81:0/2389074455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250037070 con 0x7f12541079f0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.792+0000 7f12593c1640 1 -- 172.21.15.81:0/2389074455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1250032920 con 0x7f12541079f0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.792+0000 7f12593c1640 1 -- 172.21.15.81:0/2389074455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250030950 con 0x7f12541079f0 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 -- 172.21.15.81:0/2389074455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 msgr2=0x7f1254107df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 --2- 172.21.15.81:0/2389074455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f1254107df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1250009820 tx=0x7f125002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 -- 172.21.15.81:0/2389074455 shutdown_connections 2024-09-12T12:07:27.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 --2- 172.21.15.81:0/2389074455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f1254107df0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 -- 172.21.15.81:0/2389074455 >> 172.21.15.81:0/2389074455 conn(0x7f12541031e0 msgr2=0x7f1254105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 -- 172.21.15.81:0/2389074455 shutdown_connections 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.793+0000 7f125c627640 1 -- 172.21.15.81:0/2389074455 wait complete. 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125c627640 1 Processor -- start 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125c627640 1 -- start start 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125c627640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f125419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125c627640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f125410bf00 con 0x7f12541079f0 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125a3c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f125419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125a3c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f125419b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55060/0 (socket says 172.21.15.81:55060) 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125a3c3640 1 -- 172.21.15.81:0/14044263 learned_addr learned my addr 172.21.15.81:0/14044263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125a3c3640 1 -- 172.21.15.81:0/14044263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125419bf20 con 0x7f12541079f0 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125a3c3640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f125419b9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1250006f10 tx=0x7f12500327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:27.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1250037040 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1250040070 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125419c1b0 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125003a610 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.794+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125419eea0 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.795+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f125003a800 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.795+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1254107e70 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.795+0000 7f124b7fe640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f1240038fc0 0x7f124003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.796+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f125006c4a0 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.796+0000 7f1259bc2640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f1240038fc0 0x7f124003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.796+0000 7f1259bc2640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f1240038fc0 0x7f124003b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f12440098c0 tx=0x7f1244006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.800+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12500439b0 con 0x7f12541079f0 2024-09-12T12:07:27.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.983+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f12541044f0 con 0x7f1240038fc0 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.988+0000 7f124b7fe640 1 -- 172.21.15.81:0/14044263 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f12541044f0 con 0x7f1240038fc0 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f1240038fc0 msgr2=0x7f124003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f1240038fc0 0x7f124003b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f12440098c0 tx=0x7f1244006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 msgr2=0x7f125419b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f125419b9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1250006f10 tx=0x7f12500327d0 comp rx=0 tx=0).stop 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 shutdown_connections 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f1240038fc0 0x7f124003b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 --2- 172.21.15.81:0/14044263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12541079f0 0x7f125419b9e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 >> 172.21.15.81:0/14044263 conn(0x7f12541031e0 msgr2=0x7f1254103de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 shutdown_connections 2024-09-12T12:07:27.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:26.991+0000 7f125c627640 1 -- 172.21.15.81:0/14044263 wait complete. 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:26] ENGINE Bus STARTING 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:26] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:26] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:26] ENGINE Bus STARTED 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:26] ENGINE Error in HTTPServer.serve 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:07:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-12T12:07:27.861 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:07:27.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: mgrmap e8: x(active, since 2s) 2024-09-12T12:07:27.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:27.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:27 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd7e636640 1 Processor -- start 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd7e636640 1 -- start start 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd7e636640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7810a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd7e636640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78063450 con 0x7fbd78108470 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7810a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7810a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55068/0 (socket says 172.21.15.81:55068) 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd77fff640 1 -- 172.21.15.81:0/2055294209 learned_addr learned my addr 172.21.15.81:0/2055294209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.998+0000 7fbd77fff640 1 -- 172.21.15.81:0/2055294209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7810ada0 con 0x7fbd78108470 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.999+0000 7fbd77fff640 1 --2- 172.21.15.81:0/2055294209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7810a860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009820 tx=0x7fbd6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574a7087531b3dce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:28.758 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.999+0000 7fbd76ffd640 1 -- 172.21.15.81:0/2055294209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd68037070 con 0x7fbd78108470 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.999+0000 7fbd76ffd640 1 -- 172.21.15.81:0/2055294209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fbd68032920 con 0x7fbd78108470 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:27.999+0000 7fbd76ffd640 1 -- 172.21.15.81:0/2055294209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd68030950 con 0x7fbd78108470 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 -- 172.21.15.81:0/2055294209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 msgr2=0x7fbd7810a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 --2- 172.21.15.81:0/2055294209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7810a860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009820 tx=0x7fbd6802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 -- 172.21.15.81:0/2055294209 shutdown_connections 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 --2- 172.21.15.81:0/2055294209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7810a860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 -- 172.21.15.81:0/2055294209 >> 172.21.15.81:0/2055294209 conn(0x7fbd781020b0 msgr2=0x7fbd781044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 -- 172.21.15.81:0/2055294209 shutdown_connections 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.000+0000 7fbd7e636640 1 -- 172.21.15.81:0/2055294209 wait complete. 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd7e636640 1 Processor -- start 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd7e636640 1 -- start start 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd7e636640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:28.759 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd7e636640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7810bde0 con 0x7fbd78108470 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55082/0 (socket says 172.21.15.81:55082) 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd77fff640 1 -- 172.21.15.81:0/728895090 learned_addr learned my addr 172.21.15.81:0/728895090 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.001+0000 7fbd77fff640 1 -- 172.21.15.81:0/728895090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7819beb0 con 0x7fbd78108470 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.002+0000 7fbd77fff640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7819b970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbd68006f10 tx=0x7fbd680327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.002+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd68037040 con 0x7fbd78108470 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.002+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7819c140 con 0x7fbd78108470 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.002+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fbd68040070 con 0x7fbd78108470 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.002+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6803a630 con 0x7fbd78108470 2024-09-12T12:07:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.002+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7819ee30 con 0x7fbd78108470 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.003+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbd6803a870 con 0x7fbd78108470 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.003+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd781088d0 con 0x7fbd78108470 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.003+0000 7fbd757fa640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fbd60038f70 0x7fbd6003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.003+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbd6806c590 con 0x7fbd78108470 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.003+0000 7fbd777fe640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fbd60038f70 0x7fbd6003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.003+0000 7fbd777fe640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fbd60038f70 0x7fbd6003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0098c0 tx=0x7fbd6c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.008+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd68044c70 con 0x7fbd78108470 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.177+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fbd781033a0 con 0x7fbd60038f70 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.178+0000 7fbd757fa640 1 -- 172.21.15.81:0/728895090 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fbd781033a0 con 0x7fbd60038f70 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fbd60038f70 msgr2=0x7fbd6003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fbd60038f70 0x7fbd6003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0098c0 tx=0x7fbd6c006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:28.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 msgr2=0x7fbd7819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7819b970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbd68006f10 tx=0x7fbd680327d0 comp rx=0 tx=0).stop 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 shutdown_connections 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fbd60038f70 0x7fbd6003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 --2- 172.21.15.81:0/728895090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd78108470 0x7fbd7819b970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 >> 172.21.15.81:0/728895090 conn(0x7fbd781020b0 msgr2=0x7fbd78102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 shutdown_connections 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:28.180+0000 7fbd7e636640 1 -- 172.21.15.81:0/728895090 wait complete. 2024-09-12T12:07:28.762 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-09-12T12:07:29.070 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:28 smithi081 ceph-mon[30948]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: Generating public/private rsa key pair. 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: Your identification has been saved in /tmp/tmpd4jk0223/key 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: Your public key has been saved in /tmp/tmpd4jk0223/key.pub 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: The key fingerprint is: 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: SHA256:BvrSz0vU211RW45VeVN0EyDPw5w3kFiA3882DwLUDoo ceph-595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: The key's randomart image is: 2024-09-12T12:07:29.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: +---[RSA 3072]----+ 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | .+++o+&| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | .o.B.o*B| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | .. o.o.B.=+| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | .E.......o o| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | . S .. o .| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | o o o...* | 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | . o . . ..o.o| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | . + .| 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: | +. | 2024-09-12T12:07:29.611 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: +----[SHA256]-----+ 2024-09-12T12:07:30.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-mon[30948]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:30.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:30.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:29 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:30.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c4640f640 1 Processor -- start 2024-09-12T12:07:30.222 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c4640f640 1 -- start start 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c4640f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c40107df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c4640f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401083c0 con 0x7f2c401079f0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c3ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c40107df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c3ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c40107df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55092/0 (socket says 172.21.15.81:55092) 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.146+0000 7f2c3ffff640 1 -- 172.21.15.81:0/804629311 learned_addr learned my addr 172.21.15.81:0/804629311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.147+0000 7f2c3ffff640 1 -- 172.21.15.81:0/804629311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c40108b50 con 0x7f2c401079f0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.147+0000 7f2c3ffff640 1 --2- 172.21.15.81:0/804629311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c40107df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009820 tx=0x7f2c3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0646318dbbd325a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.147+0000 7f2c3effd640 1 -- 172.21.15.81:0/804629311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c30037070 con 0x7f2c401079f0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.147+0000 7f2c3effd640 1 -- 172.21.15.81:0/804629311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2c30032920 con 0x7f2c401079f0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.147+0000 7f2c3effd640 1 -- 172.21.15.81:0/804629311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c30030950 con 0x7f2c401079f0 2024-09-12T12:07:30.223 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 -- 172.21.15.81:0/804629311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 msgr2=0x7f2c40107df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 --2- 172.21.15.81:0/804629311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c40107df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009820 tx=0x7f2c3002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 -- 172.21.15.81:0/804629311 shutdown_connections 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 --2- 172.21.15.81:0/804629311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c40107df0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 -- 172.21.15.81:0/804629311 >> 172.21.15.81:0/804629311 conn(0x7f2c401031e0 msgr2=0x7f2c40105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 -- 172.21.15.81:0/804629311 shutdown_connections 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.148+0000 7f2c4640f640 1 -- 172.21.15.81:0/804629311 wait complete. 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c4640f640 1 Processor -- start 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c4640f640 1 -- start start 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c4640f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c4007db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c4640f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4010bf00 con 0x7f2c401079f0 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c3ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c4007db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c3ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c4007db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55100/0 (socket says 172.21.15.81:55100) 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c3ffff640 1 -- 172.21.15.81:0/3077250621 learned_addr learned my addr 172.21.15.81:0/3077250621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.149+0000 7f2c3ffff640 1 -- 172.21.15.81:0/3077250621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4007e0c0 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.150+0000 7f2c3ffff640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c4007db80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c30006f10 tx=0x7f2c300327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.150+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c30037040 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.150+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f2c30040070 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.150+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4007c2b0 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.150+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c3003a610 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.150+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4007c7f0 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.151+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2c3003b420 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.151+0000 7f2c3d7fa640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f2c28038fc0 0x7f2c2803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.151+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2c3006c300 con 0x7f2c401079f0 2024-09-12T12:07:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.151+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c40107e70 con 0x7f2c401079f0 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.151+0000 7f2c3f7fe640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f2c28038fc0 0x7f2c2803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.151+0000 7f2c3f7fe640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f2c28038fc0 0x7f2c2803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c340098c0 tx=0x7f2c34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.156+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c30032d00 con 0x7f2c401079f0 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.325+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2c40104530 con 0x7f2c28038fc0 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.468+0000 7f2c3d7fa640 1 -- 172.21.15.81:0/3077250621 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c40104530 con 0x7f2c28038fc0 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.470+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f2c28038fc0 msgr2=0x7f2c2803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.470+0000 7f2c4640f640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f2c28038fc0 0x7f2c2803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c340098c0 tx=0x7f2c34006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.470+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 msgr2=0x7f2c4007db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.470+0000 7f2c4640f640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c4007db80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2c30006f10 tx=0x7f2c300327d0 comp rx=0 tx=0).stop 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.471+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 shutdown_connections 2024-09-12T12:07:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.471+0000 7f2c4640f640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f2c28038fc0 0x7f2c2803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:30.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.471+0000 7f2c4640f640 1 --2- 172.21.15.81:0/3077250621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401079f0 0x7f2c4007db80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:30.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.471+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 >> 172.21.15.81:0/3077250621 conn(0x7f2c401031e0 msgr2=0x7f2c40103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:30.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.471+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 shutdown_connections 2024-09-12T12:07:30.227 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:29.471+0000 7f2c4640f640 1 -- 172.21.15.81:0/3077250621 wait complete. 2024-09-12T12:07:30.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:30 smithi081 ceph-mon[30948]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:30.800 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:30 smithi081 ceph-mon[30948]: Generating ssh key... 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.621+0000 7f8313734640 1 Processor -- start 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.621+0000 7f8313734640 1 -- start start 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.621+0000 7f8313734640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c107de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.621+0000 7f8313734640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f830c108320 con 0x7f830c1079e0 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.622+0000 7f83114d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c107de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.622+0000 7f83114d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c107de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55102/0 (socket says 172.21.15.81:55102) 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.622+0000 7f83114d0640 1 -- 172.21.15.81:0/3076402232 learned_addr learned my addr 172.21.15.81:0/3076402232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.622+0000 7f83114d0640 1 -- 172.21.15.81:0/3076402232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c1084a0 con 0x7f830c1079e0 2024-09-12T12:07:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f83114d0640 1 --2- 172.21.15.81:0/3076402232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c107de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8308009820 tx=0x7f830802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abedefb074794b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8303fff640 1 -- 172.21.15.81:0/3076402232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308037070 con 0x7f830c1079e0 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8303fff640 1 -- 172.21.15.81:0/3076402232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8308032920 con 0x7f830c1079e0 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8303fff640 1 -- 172.21.15.81:0/3076402232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308030950 con 0x7f830c1079e0 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 -- 172.21.15.81:0/3076402232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 msgr2=0x7f830c107de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 --2- 172.21.15.81:0/3076402232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c107de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8308009820 tx=0x7f830802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 -- 172.21.15.81:0/3076402232 shutdown_connections 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 --2- 172.21.15.81:0/3076402232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c107de0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 -- 172.21.15.81:0/3076402232 >> 172.21.15.81:0/3076402232 conn(0x7f830c103250 msgr2=0x7f830c105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 -- 172.21.15.81:0/3076402232 shutdown_connections 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.623+0000 7f8313734640 1 -- 172.21.15.81:0/3076402232 wait complete. 2024-09-12T12:07:31.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f8313734640 1 Processor -- start 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f8313734640 1 -- start start 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f8313734640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f8313734640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f830c10be00 con 0x7f830c1079e0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f83114d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f83114d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55118/0 (socket says 172.21.15.81:55118) 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f83114d0640 1 -- 172.21.15.81:0/2433968388 learned_addr learned my addr 172.21.15.81:0/2433968388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.624+0000 7f83114d0640 1 -- 172.21.15.81:0/2433968388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830c19bf00 con 0x7f830c1079e0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.625+0000 7f83114d0640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c19b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8308031000 tx=0x7f8308032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.625+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308042070 con 0x7f830c1079e0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.625+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830c19c190 con 0x7f830c1079e0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.625+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f83080325f0 con 0x7f830c1079e0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.625+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8308037040 con 0x7f830c1079e0 2024-09-12T12:07:31.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.625+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830c19ee80 con 0x7f830c1079e0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.626+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f8308045070 con 0x7f830c1079e0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.626+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830c107e60 con 0x7f830c1079e0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.626+0000 7f83027fc640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f82f8038f70 0x7f82f803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.626+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f830806c210 con 0x7f830c1079e0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.626+0000 7f8310ccf640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f82f8038f70 0x7f82f803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.626+0000 7f8310ccf640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f82f8038f70 0x7f82f803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0098c0 tx=0x7f82fc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.631+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f830803a780 con 0x7f830c1079e0 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.799+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f830c104550 con 0x7f82f8038f70 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.800+0000 7f83027fc640 1 -- 172.21.15.81:0/2433968388 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f830c104550 con 0x7f82f8038f70 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f82f8038f70 msgr2=0x7f82f803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f82f8038f70 0x7f82f803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0098c0 tx=0x7f82fc006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 msgr2=0x7f830c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c19b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8308031000 tx=0x7f8308032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:31.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 shutdown_connections 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f82f8038f70 0x7f82f803b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 --2- 172.21.15.81:0/2433968388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c1079e0 0x7f830c19b9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.802+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 >> 172.21.15.81:0/2433968388 conn(0x7f830c103250 msgr2=0x7f830c103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.803+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 shutdown_connections 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:30.803+0000 7f8313734640 1 -- 172.21.15.81:0/2433968388 wait complete. 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T12:07:31.468 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-09-12T12:07:31.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:31 smithi081 ceph-mon[30948]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:33.093 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:32 smithi081 ceph-mon[30948]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:34.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:33 smithi081 ceph-mon[30948]: Deploying cephadm binary to smithi081 2024-09-12T12:07:35.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-09-12T12:07:35.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.880+0000 7fabe9742640 1 Processor -- start 2024-09-12T12:07:35.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.880+0000 7fabe9742640 1 -- start start 2024-09-12T12:07:35.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.880+0000 7fabe9742640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe410a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.880+0000 7fabe9742640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4063510 con 0x7fabe41083b0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.880+0000 7fabe2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe410a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.881+0000 7fabe2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe410a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55130/0 (socket says 172.21.15.81:55130) 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.881+0000 7fabe2ffd640 1 -- 172.21.15.81:0/1383709378 learned_addr learned my addr 172.21.15.81:0/1383709378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.881+0000 7fabe2ffd640 1 -- 172.21.15.81:0/1383709378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe410ace0 con 0x7fabe41083b0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.881+0000 7fabe2ffd640 1 --2- 172.21.15.81:0/1383709378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe410a7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009e80 tx=0x7fabd402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f36dd3f591e375 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe1ffb640 1 -- 172.21.15.81:0/1383709378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd4036070 con 0x7fabe41083b0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe1ffb640 1 -- 172.21.15.81:0/1383709378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fabd40318e0 con 0x7fabe41083b0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe1ffb640 1 -- 172.21.15.81:0/1383709378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd4007b00 con 0x7fabe41083b0 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 -- 172.21.15.81:0/1383709378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 msgr2=0x7fabe410a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 --2- 172.21.15.81:0/1383709378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe410a7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009e80 tx=0x7fabd402a7a0 comp rx=0 tx=0).stop 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 -- 172.21.15.81:0/1383709378 shutdown_connections 2024-09-12T12:07:35.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 --2- 172.21.15.81:0/1383709378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe410a7a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 -- 172.21.15.81:0/1383709378 >> 172.21.15.81:0/1383709378 conn(0x7fabe41020b0 msgr2=0x7fabe41044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 -- 172.21.15.81:0/1383709378 shutdown_connections 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.882+0000 7fabe9742640 1 -- 172.21.15.81:0/1383709378 wait complete. 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe9742640 1 Processor -- start 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe9742640 1 -- start start 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe9742640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe9742640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe410bde0 con 0x7fabe41083b0 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe419b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55134/0 (socket says 172.21.15.81:55134) 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe2ffd640 1 -- 172.21.15.81:0/2359529985 learned_addr learned my addr 172.21.15.81:0/2359529985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.883+0000 7fabe2ffd640 1 -- 172.21.15.81:0/2359529985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe419beb0 con 0x7fabe41083b0 2024-09-12T12:07:35.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.884+0000 7fabe2ffd640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe419b970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabd402acc0 tx=0x7fabd4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.884+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd4041020 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.884+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fabd4031c40 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.884+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe419c140 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.884+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabd4036040 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.884+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe419ee30 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.885+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fabd4044020 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.885+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe4108810 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.885+0000 7fabcbfff640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fabcc038fc0 0x7fabcc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.885+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fabd4007e00 con 0x7fabe41083b0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.885+0000 7fabe27fc640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fabcc038fc0 0x7fabcc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.885+0000 7fabe27fc640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fabcc038fc0 0x7fabcc03b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098c0 tx=0x7fabd8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:35.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:31.889+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabd404b020 con 0x7fabe41083b0 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:32.057+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}) -- 0x7fabe4103360 con 0x7fabcc038fc0 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.184+0000 7fabcbfff640 1 -- 172.21.15.81:0/2359529985 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fabe4103360 con 0x7fabcc038fc0 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fabcc038fc0 msgr2=0x7fabcc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fabcc038fc0 0x7fabcc03b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098c0 tx=0x7fabd8006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 msgr2=0x7fabe419b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe419b970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fabd402acc0 tx=0x7fabd4031700 comp rx=0 tx=0).stop 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 shutdown_connections 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fabcc038fc0 0x7fabcc03b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 --2- 172.21.15.81:0/2359529985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe41083b0 0x7fabe419b970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 >> 172.21.15.81:0/2359529985 conn(0x7fabe41020b0 msgr2=0x7fabe4102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 shutdown_connections 2024-09-12T12:07:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:35.188+0000 7fabe9742640 1 -- 172.21.15.81:0/2359529985 wait complete. 2024-09-12T12:07:35.726 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mon service... 2024-09-12T12:07:36.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:36 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:36.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:36 smithi081 ceph-mon[30948]: Added host smithi081 2024-09-12T12:07:36.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:36 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e31f8640 1 Processor -- start 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e31f8640 1 -- start start 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e31f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc10a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e31f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc07bec0 con 0x7f98dc1083f0 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e0f94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc10a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e0f94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc10a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40600/0 (socket says 172.21.15.81:40600) 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.111+0000 7f98e0f94640 1 -- 172.21.15.81:0/4234599301 learned_addr learned my addr 172.21.15.81:0/4234599301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.112+0000 7f98e0f94640 1 -- 172.21.15.81:0/4234599301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc10ad20 con 0x7f98dc1083f0 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.112+0000 7f98e0f94640 1 --2- 172.21.15.81:0/4234599301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc10a7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009820 tx=0x7f98d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9851ed8bf7faf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.112+0000 7f98db7fe640 1 -- 172.21.15.81:0/4234599301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0037070 con 0x7f98dc1083f0 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98db7fe640 1 -- 172.21.15.81:0/4234599301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f98d0032920 con 0x7f98dc1083f0 2024-09-12T12:07:37.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98db7fe640 1 -- 172.21.15.81:0/4234599301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0030950 con 0x7f98dc1083f0 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 -- 172.21.15.81:0/4234599301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 msgr2=0x7f98dc10a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 --2- 172.21.15.81:0/4234599301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc10a7e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98d0009820 tx=0x7f98d002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 -- 172.21.15.81:0/4234599301 shutdown_connections 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 --2- 172.21.15.81:0/4234599301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc10a7e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 -- 172.21.15.81:0/4234599301 >> 172.21.15.81:0/4234599301 conn(0x7f98dc101ff0 msgr2=0x7f98dc104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 -- 172.21.15.81:0/4234599301 shutdown_connections 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.113+0000 7f98e31f8640 1 -- 172.21.15.81:0/4234599301 wait complete. 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e31f8640 1 Processor -- start 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e31f8640 1 -- start start 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e31f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e31f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98dc10be20 con 0x7f98dc1083f0 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e0f94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e0f94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc107c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40612/0 (socket says 172.21.15.81:40612) 2024-09-12T12:07:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e0f94640 1 -- 172.21.15.81:0/1953630815 learned_addr learned my addr 172.21.15.81:0/1953630815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e0f94640 1 -- 172.21.15.81:0/1953630815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98dc1081b0 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98e0f94640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc107c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f98d0031000 tx=0x7f98d0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.114+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0042070 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.115+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f98d00326b0 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.115+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98dc1063a0 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.115+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98d0037040 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.115+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98dc1068e0 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.116+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f98d0045070 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.116+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98dc108850 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.116+0000 7f98d9ffb640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f98cc038f70 0x7f98cc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.116+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f98d006c0a0 con 0x7f98dc1083f0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.116+0000 7f98dbfff640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f98cc038f70 0x7f98cc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.116+0000 7f98dbfff640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f98cc038f70 0x7f98cc03b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f98c80098c0 tx=0x7f98c8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:37.099 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.121+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98d003c800 con 0x7f98dc1083f0 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.304+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f98dc107230 con 0x7f98cc038f70 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.309+0000 7f98d9ffb640 1 -- 172.21.15.81:0/1953630815 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f98dc107230 con 0x7f98cc038f70 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f98cc038f70 msgr2=0x7f98cc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f98cc038f70 0x7f98cc03b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f98c80098c0 tx=0x7f98c8006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 msgr2=0x7f98dc107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc107c70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f98d0031000 tx=0x7f98d0032e40 comp rx=0 tx=0).stop 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 shutdown_connections 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f98cc038f70 0x7f98cc03b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 --2- 172.21.15.81:0/1953630815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98dc1083f0 0x7f98dc107c70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 >> 172.21.15.81:0/1953630815 conn(0x7f98dc101ff0 msgr2=0x7f98dc102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 shutdown_connections 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:36.311+0000 7f98e31f8640 1 -- 172.21.15.81:0/1953630815 wait complete. 2024-09-12T12:07:37.100 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mgr service... 2024-09-12T12:07:37.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:37 smithi081 ceph-mon[30948]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:37 smithi081 ceph-mon[30948]: Saving service mon spec with placement count:5 2024-09-12T12:07:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:37 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:39.319 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T12:07:39.319 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.528+0000 7fda5f3a2640 1 Processor -- start 2024-09-12T12:07:39.319 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.528+0000 7fda5f3a2640 1 -- start start 2024-09-12T12:07:39.319 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.528+0000 7fda5f3a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda58106c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.528+0000 7fda5f3a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda58107210 con 0x7fda58106840 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.529+0000 7fda5d13e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda58106c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.529+0000 7fda5d13e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda58106c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40624/0 (socket says 172.21.15.81:40624) 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.529+0000 7fda5d13e640 1 -- 172.21.15.81:0/2799401449 learned_addr learned my addr 172.21.15.81:0/2799401449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.529+0000 7fda5d13e640 1 -- 172.21.15.81:0/2799401449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda58107a40 con 0x7fda58106840 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.529+0000 7fda5d13e640 1 --2- 172.21.15.81:0/2799401449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda58106c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda54009820 tx=0x7fda5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b75eaed074defcc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda4ffff640 1 -- 172.21.15.81:0/2799401449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda54037070 con 0x7fda58106840 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda4ffff640 1 -- 172.21.15.81:0/2799401449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda54032940 con 0x7fda58106840 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda4ffff640 1 -- 172.21.15.81:0/2799401449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda540308b0 con 0x7fda58106840 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 -- 172.21.15.81:0/2799401449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 msgr2=0x7fda58106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:39.320 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 --2- 172.21.15.81:0/2799401449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda58106c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda54009820 tx=0x7fda5402a270 comp rx=0 tx=0).stop 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 -- 172.21.15.81:0/2799401449 shutdown_connections 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 --2- 172.21.15.81:0/2799401449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda58106c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 -- 172.21.15.81:0/2799401449 >> 172.21.15.81:0/2799401449 conn(0x7fda581020b0 msgr2=0x7fda581044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 -- 172.21.15.81:0/2799401449 shutdown_connections 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.530+0000 7fda5f3a2640 1 -- 172.21.15.81:0/2799401449 wait complete. 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5f3a2640 1 Processor -- start 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5f3a2640 1 -- start start 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5f3a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda5819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5f3a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda5810adf0 con 0x7fda58106840 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5d13e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda5819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5d13e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda5819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40634/0 (socket says 172.21.15.81:40634) 2024-09-12T12:07:39.321 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.531+0000 7fda5d13e640 1 -- 172.21.15.81:0/3345933959 learned_addr learned my addr 172.21.15.81:0/3345933959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda5d13e640 1 -- 172.21.15.81:0/3345933959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5819bed0 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda5d13e640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda5819b990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda540097f0 tx=0x7fda54032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda54042070 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda5403d930 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5819c160 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda54037040 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.532+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5819ee50 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.533+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fda54045070 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.533+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda58106cc0 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.533+0000 7fda4e7fc640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fda44038f70 0x7fda4403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.533+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fda5406c1a0 con 0x7fda58106840 2024-09-12T12:07:39.322 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.533+0000 7fda5c93d640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fda44038f70 0x7fda4403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.534+0000 7fda5c93d640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fda44038f70 0x7fda4403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda480098c0 tx=0x7fda48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.538+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda54045760 con 0x7fda58106840 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.726+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fda5802da20 con 0x7fda44038f70 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.731+0000 7fda4e7fc640 1 -- 172.21.15.81:0/3345933959 <== mgr.14118 v2:172.21.15.81:6800/2203121669 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fda5802da20 con 0x7fda44038f70 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fda44038f70 msgr2=0x7fda4403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fda44038f70 0x7fda4403b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda480098c0 tx=0x7fda48006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 msgr2=0x7fda5819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda5819b990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda540097f0 tx=0x7fda54032670 comp rx=0 tx=0).stop 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 shutdown_connections 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fda44038f70 0x7fda4403b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 --2- 172.21.15.81:0/3345933959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda58106840 0x7fda5819b990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:39.323 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 >> 172.21.15.81:0/3345933959 conn(0x7fda581020b0 msgr2=0x7fda58102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:39.324 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 shutdown_connections 2024-09-12T12:07:39.324 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:38.733+0000 7fda5f3a2640 1 -- 172.21.15.81:0/3345933959 wait complete. 2024-09-12T12:07:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:39 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:39 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:39 smithi081 ceph-mon[30948]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:39 smithi081 ceph-mon[30948]: Saving service mgr spec with placement count:2 2024-09-12T12:07:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:39 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448f846640 1 Processor -- start 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448f846640 1 -- start start 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448f846640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448807c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448f846640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f448807e170 con 0x7f448807dd70 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448d5e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448807c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448d5e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448807c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40636/0 (socket says 172.21.15.81:40636) 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448d5e2640 1 -- 172.21.15.81:0/3193019013 learned_addr learned my addr 172.21.15.81:0/3193019013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.710+0000 7f448d5e2640 1 -- 172.21.15.81:0/3193019013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448807c870 con 0x7f448807dd70 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.711+0000 7f448d5e2640 1 --2- 172.21.15.81:0/3193019013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448807c330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4484009820 tx=0x7f448402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82890087d6e1cf1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.711+0000 7f447ffff640 1 -- 172.21.15.81:0/3193019013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4484037070 con 0x7f448807dd70 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.711+0000 7f447ffff640 1 -- 172.21.15.81:0/3193019013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4484032940 con 0x7f448807dd70 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.711+0000 7f447ffff640 1 -- 172.21.15.81:0/3193019013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44840308b0 con 0x7f448807dd70 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 -- 172.21.15.81:0/3193019013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 msgr2=0x7f448807c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 --2- 172.21.15.81:0/3193019013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448807c330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4484009820 tx=0x7f448402a270 comp rx=0 tx=0).stop 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 -- 172.21.15.81:0/3193019013 shutdown_connections 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 --2- 172.21.15.81:0/3193019013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448807c330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 -- 172.21.15.81:0/3193019013 >> 172.21.15.81:0/3193019013 conn(0x7f4488103250 msgr2=0x7f4488105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 -- 172.21.15.81:0/3193019013 shutdown_connections 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.712+0000 7f448f846640 1 -- 172.21.15.81:0/3193019013 wait complete. 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448f846640 1 Processor -- start 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448f846640 1 -- start start 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448f846640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448f846640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f448810df40 con 0x7f448807dd70 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448d5e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448d5e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40644/0 (socket says 172.21.15.81:40644) 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448d5e2640 1 -- 172.21.15.81:0/1629193103 learned_addr learned my addr 172.21.15.81:0/1629193103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448d5e2640 1 -- 172.21.15.81:0/1629193103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448819e130 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.713+0000 7f448d5e2640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448819dbf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f44840097f0 tx=0x7f4484032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.714+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4484037040 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.714+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4484040070 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.714+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448819e3c0 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.714+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f448403a520 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.714+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881a10b0 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.714+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f448403a7d0 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.715+0000 7f447e7fc640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f4474038f70 0x7f447403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.715+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f448406c5f0 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.715+0000 7f448cde1640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f4474038f70 0x7f447403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.715+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448807c3b0 con 0x7f448807dd70 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.715+0000 7f448cde1640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f4474038f70 0x7f447403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44780098c0 tx=0x7f4478006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.720+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4484044c70 con 0x7f448807dd70 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.919+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f44881a15d0 con 0x7f448807dd70 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.922+0000 7f447e7fc640 1 -- 172.21.15.81:0/1629193103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f4484042e30 con 0x7f448807dd70 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f4474038f70 msgr2=0x7f447403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f4474038f70 0x7f447403b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f44780098c0 tx=0x7f4478006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 msgr2=0x7f448819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448819dbf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f44840097f0 tx=0x7f4484032e60 comp rx=0 tx=0).stop 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 shutdown_connections 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f4474038f70 0x7f447403b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 --2- 172.21.15.81:0/1629193103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448807dd70 0x7f448819dbf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.925+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 >> 172.21.15.81:0/1629193103 conn(0x7f4488103250 msgr2=0x7f4488103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.926+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 shutdown_connections 2024-09-12T12:07:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:39.926+0000 7f448f846640 1 -- 172.21.15.81:0/1629193103 wait complete. 2024-09-12T12:07:41.089 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:40 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1629193103' entity='client.admin' 2024-09-12T12:07:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.168+0000 7f2824bce640 1 Processor -- start 2024-09-12T12:07:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f2824bce640 1 -- start start 2024-09-12T12:07:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f2824bce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282010a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f2824bce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f282007be60 con 0x7f2820108450 2024-09-12T12:07:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f281e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282010a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f281e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282010a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40646/0 (socket says 172.21.15.81:40646) 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f281e59c640 1 -- 172.21.15.81:0/3413348952 learned_addr learned my addr 172.21.15.81:0/3413348952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.169+0000 7f281e59c640 1 -- 172.21.15.81:0/3413348952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282010ad80 con 0x7f2820108450 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.170+0000 7f281e59c640 1 --2- 172.21.15.81:0/3413348952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282010a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2810009820 tx=0x7f281002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefc8e0d91b55d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.170+0000 7f281dd9b640 1 -- 172.21.15.81:0/3413348952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810037070 con 0x7f2820108450 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.170+0000 7f281dd9b640 1 -- 172.21.15.81:0/3413348952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2810032940 con 0x7f2820108450 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.170+0000 7f281dd9b640 1 -- 172.21.15.81:0/3413348952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28100308b0 con 0x7f2820108450 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.170+0000 7f2824bce640 1 -- 172.21.15.81:0/3413348952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 msgr2=0x7f282010a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.170+0000 7f2824bce640 1 --2- 172.21.15.81:0/3413348952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282010a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2810009820 tx=0x7f281002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 -- 172.21.15.81:0/3413348952 shutdown_connections 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 --2- 172.21.15.81:0/3413348952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282010a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 -- 172.21.15.81:0/3413348952 >> 172.21.15.81:0/3413348952 conn(0x7f2820101ff0 msgr2=0x7f2820104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 -- 172.21.15.81:0/3413348952 shutdown_connections 2024-09-12T12:07:42.052 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 -- 172.21.15.81:0/3413348952 wait complete. 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 Processor -- start 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 -- start start 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.171+0000 7f2824bce640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f282010be60 con 0x7f2820108450 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f281e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f281e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282019b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40652/0 (socket says 172.21.15.81:40652) 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f281e59c640 1 -- 172.21.15.81:0/2375991110 learned_addr learned my addr 172.21.15.81:0/2375991110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f281e59c640 1 -- 172.21.15.81:0/2375991110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282019bf00 con 0x7f2820108450 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f281e59c640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282019b9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2810032670 tx=0x7f28100326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810042070 con 0x7f2820108450 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f281003d930 con 0x7f2820108450 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282019c190 con 0x7f2820108450 2024-09-12T12:07:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810037040 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.172+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282019ee80 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.173+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2810045070 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.173+0000 7f28177fe640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f280c038f70 0x7f280c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.173+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28201088b0 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.173+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f281006c120 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.173+0000 7f2817fff640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f280c038f70 0x7f280c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.174+0000 7f2817fff640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f280c038f70 0x7f280c03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28080098c0 tx=0x7f2808006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.178+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f281004b170 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.344+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f282019f050 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.347+0000 7f28177fe640 1 -- 172.21.15.81:0/2375991110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f281002fd90 con 0x7f2820108450 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f280c038f70 msgr2=0x7f280c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f280c038f70 0x7f280c03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f28080098c0 tx=0x7f2808006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 msgr2=0x7f282019b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282019b9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2810032670 tx=0x7f28100326a0 comp rx=0 tx=0).stop 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 shutdown_connections 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7f280c038f70 0x7f280c03b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 --2- 172.21.15.81:0/2375991110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2820108450 0x7f282019b9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 >> 172.21.15.81:0/2375991110 conn(0x7f2820101ff0 msgr2=0x7f2820102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 shutdown_connections 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:41.349+0000 7f2824bce640 1 -- 172.21.15.81:0/2375991110 wait complete. 2024-09-12T12:07:42.055 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-09-12T12:07:42.467 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:42 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2375991110' entity='client.admin' 2024-09-12T12:07:42.468 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:42 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:43.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3702606945' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T12:07:43.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-mon[30948]: from='mgr.14118 172.21.15.81:0/2329090414' entity='mgr.x' 2024-09-12T12:07:43.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ignoring --setuser ceph since I am not root 2024-09-12T12:07:43.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ignoring --setgroup ceph since I am not root 2024-09-12T12:07:43.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:43.506+0000 7fd2c0d03040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:07:43.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:43.562+0000 7fd2c0d03040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:07:44.070 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:43.710+0000 7fd2c0d03040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:07:44.070 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:43.776+0000 7fd2c0d03040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:07:44.070 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:43.928+0000 7fd2c0d03040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:07:44.070 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:44 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:44.069+0000 7fd2c0d03040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:07:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.467+0000 7fd99adf3640 1 Processor -- start 2024-09-12T12:07:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.467+0000 7fd99adf3640 1 -- start start 2024-09-12T12:07:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.467+0000 7fd99adf3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd994106020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.467+0000 7fd99adf3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9941065f0 con 0x7fd994105c20 2024-09-12T12:07:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.468+0000 7fd998b8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd994106020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.468+0000 7fd998b8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd994106020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39026/0 (socket says 172.21.15.81:39026) 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.468+0000 7fd998b8f640 1 -- 172.21.15.81:0/207673519 learned_addr learned my addr 172.21.15.81:0/207673519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.468+0000 7fd998b8f640 1 -- 172.21.15.81:0/207673519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd994108c00 con 0x7fd994105c20 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.468+0000 7fd998b8f640 1 --2- 172.21.15.81:0/207673519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd994106020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd988009820 tx=0x7fd98802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4488038ee9243f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd9937fe640 1 -- 172.21.15.81:0/207673519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988037070 con 0x7fd994105c20 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd9937fe640 1 -- 172.21.15.81:0/207673519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd988032940 con 0x7fd994105c20 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd9937fe640 1 -- 172.21.15.81:0/207673519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9880308b0 con 0x7fd994105c20 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 -- 172.21.15.81:0/207673519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 msgr2=0x7fd994106020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 --2- 172.21.15.81:0/207673519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd994106020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd988009820 tx=0x7fd98802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 -- 172.21.15.81:0/207673519 shutdown_connections 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 --2- 172.21.15.81:0/207673519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd994106020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:44.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 -- 172.21.15.81:0/207673519 >> 172.21.15.81:0/207673519 conn(0x7fd9941017d0 msgr2=0x7fd994103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 -- 172.21.15.81:0/207673519 shutdown_connections 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.469+0000 7fd99adf3640 1 -- 172.21.15.81:0/207673519 wait complete. 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd99adf3640 1 Processor -- start 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd99adf3640 1 -- start start 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd99adf3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd99419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd99adf3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd99410bfb0 con 0x7fd994105c20 2024-09-12T12:07:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd998b8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd99419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:44.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd998b8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd99419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39032/0 (socket says 172.21.15.81:39032) 2024-09-12T12:07:44.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd998b8f640 1 -- 172.21.15.81:0/3702606945 learned_addr learned my addr 172.21.15.81:0/3702606945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:44.577 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.470+0000 7fd998b8f640 1 -- 172.21.15.81:0/3702606945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99419bf00 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.471+0000 7fd998b8f640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd99419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd988009940 tx=0x7fd988032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.471+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988042070 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.471+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99419c190 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.471+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd98803d930 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.471+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd988037040 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.471+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99419ee80 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.472+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9941060a0 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.472+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd988045070 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.472+0000 7fd991ffb640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fd984038f70 0x7fd98403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.473+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd98806c430 con 0x7fd994105c20 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.473+0000 7fd993fff640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fd984038f70 0x7fd98403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.473+0000 7fd993fff640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fd984038f70 0x7fd98403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9800098c0 tx=0x7fd980006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.478+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd98803cd70 con 0x7fd994105c20 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:42.700+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd99419f470 con 0x7fd994105c20 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.352+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd98803db50 con 0x7fd994105c20 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.353+0000 7fd991ffb640 1 -- 172.21.15.81:0/3702606945 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd988003610 con 0x7fd994105c20 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.354+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fd984038f70 msgr2=0x7fd98403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.354+0000 7fd99adf3640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fd984038f70 0x7fd98403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd9800098c0 tx=0x7fd980006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 msgr2=0x7fd99419b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd99419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd988009940 tx=0x7fd988032670 comp rx=0 tx=0).stop 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 shutdown_connections 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fd984038f70 0x7fd98403b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 --2- 172.21.15.81:0/3702606945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd994105c20 0x7fd99419b9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 >> 172.21.15.81:0/3702606945 conn(0x7fd9941017d0 msgr2=0x7fd994102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 shutdown_connections 2024-09-12T12:07:44.579 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:43.355+0000 7fd99adf3640 1 -- 172.21.15.81:0/3702606945 wait complete. 2024-09-12T12:07:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:44 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3702606945' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T12:07:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:44 smithi081 ceph-mon[30948]: mgrmap e9: x(active, since 18s) 2024-09-12T12:07:44.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:44 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:44.384+0000 7fd2c0d03040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:07:44.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:44 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:44.445+0000 7fd2c0d03040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:07:44.934 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:44 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:44.636+0000 7fd2c0d03040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:07:45.498 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:45 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2005345196' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T12:07:45.756 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:45 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:45.555+0000 7fd2c0d03040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:07:45.757 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:45 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:45.623+0000 7fd2c0d03040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb814d63640 1 Processor -- start 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb814d63640 1 -- start start 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb814d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81010a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb814d63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb810063510 con 0x7fb8101083b0 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb80e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81010a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:46.041 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb80e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81010a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39052/0 (socket says 172.21.15.81:39052) 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb80e59c640 1 -- 172.21.15.81:0/3641628269 learned_addr learned my addr 172.21.15.81:0/3641628269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.012+0000 7fb80e59c640 1 -- 172.21.15.81:0/3641628269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81010ace0 con 0x7fb8101083b0 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.013+0000 7fb80e59c640 1 --2- 172.21.15.81:0/3641628269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81010a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb800009820 tx=0x7fb80002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4e652ed870fb48 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.013+0000 7fb80d59a640 1 -- 172.21.15.81:0/3641628269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb800037070 con 0x7fb8101083b0 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.013+0000 7fb80d59a640 1 -- 172.21.15.81:0/3641628269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb800032940 con 0x7fb8101083b0 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.013+0000 7fb80d59a640 1 -- 172.21.15.81:0/3641628269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8000308b0 con 0x7fb8101083b0 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 -- 172.21.15.81:0/3641628269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 msgr2=0x7fb81010a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 --2- 172.21.15.81:0/3641628269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81010a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb800009820 tx=0x7fb80002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 -- 172.21.15.81:0/3641628269 shutdown_connections 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 --2- 172.21.15.81:0/3641628269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81010a7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 -- 172.21.15.81:0/3641628269 >> 172.21.15.81:0/3641628269 conn(0x7fb8101020b0 msgr2=0x7fb8101044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 -- 172.21.15.81:0/3641628269 shutdown_connections 2024-09-12T12:07:46.042 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.014+0000 7fb814d63640 1 -- 172.21.15.81:0/3641628269 wait complete. 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb814d63640 1 Processor -- start 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb814d63640 1 -- start start 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb814d63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb814d63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb81010be20 con 0x7fb8101083b0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb80e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb80e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81019b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39062/0 (socket says 172.21.15.81:39062) 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb80e59c640 1 -- 172.21.15.81:0/2005345196 learned_addr learned my addr 172.21.15.81:0/2005345196 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.015+0000 7fb80e59c640 1 -- 172.21.15.81:0/2005345196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81019bed0 con 0x7fb8101083b0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb80e59c640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81019b990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb800032670 tx=0x7fb8000326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb800042070 con 0x7fb8101083b0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb80003d930 con 0x7fb8101083b0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81019c160 con 0x7fb8101083b0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb800037040 con 0x7fb8101083b0 2024-09-12T12:07:46.043 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81019ee50 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.016+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fb800045070 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.017+0000 7fb7ff7fe640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 0x7fb7f803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.017+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb80006d200 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.017+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb810108810 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.017+0000 7fb80dd9b640 1 -- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 msgr2=0x7fb7f803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2203121669 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.017+0000 7fb80dd9b640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 0x7fb7f803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.022+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb80003cdf0 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.218+0000 7fb80dd9b640 1 -- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 msgr2=0x7fb7f803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2203121669 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.218+0000 7fb80dd9b640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 0x7fb7f803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.257+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb81019f440 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.257+0000 7fb7ff7fe640 1 -- 172.21.15.81:0/2005345196 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fb80003c920 con 0x7fb8101083b0 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 msgr2=0x7fb7f803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:07:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 0x7fb7f803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 msgr2=0x7fb81019b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81019b990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb800032670 tx=0x7fb8000326a0 comp rx=0 tx=0).stop 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 shutdown_connections 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fb7f8038fc0 0x7fb7f803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 --2- 172.21.15.81:0/2005345196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8101083b0 0x7fb81019b990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 >> 172.21.15.81:0/2005345196 conn(0x7fb8101020b0 msgr2=0x7fb810102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:46.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.259+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 shutdown_connections 2024-09-12T12:07:46.046 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:45.260+0000 7fb814d63640 1 -- 172.21.15.81:0/2005345196 wait complete. 2024-09-12T12:07:46.046 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-09-12T12:07:46.046 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-09-12T12:07:46.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.349+0000 7fd2c0d03040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:07:46.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.469+0000 7fd2c0d03040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:07:46.887 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.610+0000 7fd2c0d03040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:07:46.887 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.671+0000 7fd2c0d03040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:07:46.887 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.819+0000 7fd2c0d03040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:07:46.887 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.886+0000 7fd2c0d03040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:07:47.167 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:46.946+0000 7fd2c0d03040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:07:47.168 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:47.102+0000 7fd2c0d03040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:07:47.168 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:47.167+0000 7fd2c0d03040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:07:47.437 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:47.232+0000 7fd2c0d03040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:07:47.437 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:47.313+0000 7fd2c0d03040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:07:47.437 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:47.374+0000 7fd2c0d03040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:07:47.437 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:47.436+0000 7fd2c0d03040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:07:48.605 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:48.251+0000 7fd2c0d03040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:07:48.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: Active manager daemon x restarted 2024-09-12T12:07:48.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: Activating manager daemon x 2024-09-12T12:07:48.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T12:07:48.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: mgrmap e10: x(active, starting, since 0.00367537s) 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: Manager daemon x is now available 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:07:48.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:07:50.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:49.714+0000 7fd2267cc640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:07:49] ENGINE Error in HTTPServer.serve 2024-09-12T12:07:50.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: Traceback (most recent call last): 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._connections.run(self.expiration_interval) 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._run(expiration_interval) 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: s = self.context.wrap_socket( 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:07:50.111 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: return self.sslsocket_class._create( 2024-09-12T12:07:50.112 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:07:50.112 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self.do_handshake() 2024-09-12T12:07:50.112 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:07:50.112 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._sslobj.do_handshake() 2024-09-12T12:07:50.112 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:07:50.112 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:07:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc765bf0640 1 Processor -- start 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc765bf0640 1 -- start start 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc765bf0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc760109340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc765bf0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc760109910 con 0x7fc760108f40 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc760109340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc760109340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39066/0 (socket says 172.21.15.81:39066) 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.422+0000 7fc75f7fe640 1 -- 172.21.15.81:0/4107167416 learned_addr learned my addr 172.21.15.81:0/4107167416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.423+0000 7fc75f7fe640 1 -- 172.21.15.81:0/4107167416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760109a90 con 0x7fc760108f40 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.423+0000 7fc75f7fe640 1 --2- 172.21.15.81:0/4107167416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc760109340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc750009820 tx=0x7fc75002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d6afae0df589be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc75e7fc640 1 -- 172.21.15.81:0/4107167416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc750037070 con 0x7fc760108f40 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc75e7fc640 1 -- 172.21.15.81:0/4107167416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc750032940 con 0x7fc760108f40 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc75e7fc640 1 -- 172.21.15.81:0/4107167416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7500308b0 con 0x7fc760108f40 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 -- 172.21.15.81:0/4107167416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 msgr2=0x7fc760109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 --2- 172.21.15.81:0/4107167416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc760109340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc750009820 tx=0x7fc75002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 -- 172.21.15.81:0/4107167416 shutdown_connections 2024-09-12T12:07:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 --2- 172.21.15.81:0/4107167416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc760109340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 -- 172.21.15.81:0/4107167416 >> 172.21.15.81:0/4107167416 conn(0x7fc7601017d0 msgr2=0x7fc760103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 -- 172.21.15.81:0/4107167416 shutdown_connections 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.424+0000 7fc765bf0640 1 -- 172.21.15.81:0/4107167416 wait complete. 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc765bf0640 1 Processor -- start 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc765bf0640 1 -- start start 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc765bf0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc76019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc765bf0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc76010bf10 con 0x7fc760108f40 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc76019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc75f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc76019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39080/0 (socket says 172.21.15.81:39080) 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.425+0000 7fc75f7fe640 1 -- 172.21.15.81:0/898487266 learned_addr learned my addr 172.21.15.81:0/898487266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc75f7fe640 1 -- 172.21.15.81:0/898487266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76019bf10 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc75f7fe640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc76019b9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7500097f0 tx=0x7fc750032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc750042070 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc75003d930 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76019c1a0 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc750037040 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.426+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76019ee90 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.427+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fc750045070 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.427+0000 7fc75cff9640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.427+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 --> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7601093c0 con 0x7fc74c038fc0 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.427+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc75006c110 con 0x7fc760108f40 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.427+0000 7fc75effd640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 msgr2=0x7fc74c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2203121669 2024-09-12T12:07:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.427+0000 7fc75effd640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.628+0000 7fc75effd640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 msgr2=0x7fc74c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2203121669 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:46.628+0000 7fc75effd640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:47.029+0000 7fc75effd640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 msgr2=0x7fc74c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2203121669 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:47.029+0000 7fc75effd640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:47.830+0000 7fc75effd640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 msgr2=0x7fc74c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2203121669 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:47.830+0000 7fc75effd640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T12:07:50.180 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:48.255+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7fc75006abc0 con 0x7fc760108f40 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:48.255+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 msgr2=0x7fc74c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:48.255+0000 7fc75cff9640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.256+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fc75006de60 con 0x7fc760108f40 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.256+0000 7fc75cff9640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc74c03c890 0x7fc74c03ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.256+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc7500428c0 con 0x7fc74c03c890 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.257+0000 7fc75effd640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc74c03c890 0x7fc74c03ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.257+0000 7fc75effd640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc74c03c890 0x7fc74c03ec80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc748003980 tx=0x7fc748006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.258+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc7500428c0 con 0x7fc74c03c890 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc760102a60 con 0x7fc74c03c890 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc75cff9640 1 -- 172.21.15.81:0/898487266 <== mgr.14150 v2:172.21.15.81:6800/4236049851 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fc760102a60 con 0x7fc74c03c890 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc74c03c890 msgr2=0x7fc74c03ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc74c03c890 0x7fc74c03ec80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc748003980 tx=0x7fc748006e10 comp rx=0 tx=0).stop 2024-09-12T12:07:50.181 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 msgr2=0x7fc76019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc76019b9d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7500097f0 tx=0x7fc750032670 comp rx=0 tx=0).stop 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 shutdown_connections 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc74c03c890 0x7fc74c03ec80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:6800/2203121669,v1:172.21.15.81:6801/2203121669] conn(0x7fc74c038fc0 0x7fc74c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 --2- 172.21.15.81:0/898487266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc760108f40 0x7fc76019b9d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.265+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 >> 172.21.15.81:0/898487266 conn(0x7fc7601017d0 msgr2=0x7fc760102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.266+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 shutdown_connections 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:49.266+0000 7fc765bf0640 1 -- 172.21.15.81:0/898487266 wait complete. 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-09-12T12:07:50.182 INFO:teuthology.orchestra.run.smithi081.stdout:Generating a dashboard self-signed certificate... 2024-09-12T12:07:50.426 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:50 smithi081 ceph-mon[30948]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T12:07:50.426 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:50 smithi081 ceph-mon[30948]: mgrmap e11: x(active, since 1.00575s) 2024-09-12T12:07:50.427 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:50 smithi081 ceph-mon[30948]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T12:07:50.427 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:49] ENGINE Bus STARTING 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:49] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:49] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:49] ENGINE Bus STARTED 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: [12/Sep/2024:12:07:49] ENGINE Error in HTTPServer.serve 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:07:51.491 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-12T12:07:51.492 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:07:51.493 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-12T12:07:51.493 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:07:51.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:51.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: mgrmap e12: x(active, since 2s) 2024-09-12T12:07:51.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:51.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:52.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:52 smithi081 ceph-mon[30948]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:52.554 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.618+0000 7f2249b7a640 1 Processor -- start 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.618+0000 7f2249b7a640 1 -- start start 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.619+0000 7f2249b7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f2244106640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.619+0000 7f2249b7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2244063470 con 0x7f2244106240 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.619+0000 7f22437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f2244106640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.619+0000 7f22437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f2244106640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39138/0 (socket says 172.21.15.81:39138) 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.619+0000 7f22437fe640 1 -- 172.21.15.81:0/3986588955 learned_addr learned my addr 172.21.15.81:0/3986588955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.619+0000 7f22437fe640 1 -- 172.21.15.81:0/3986588955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2244106b80 con 0x7f2244106240 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.620+0000 7f22437fe640 1 --2- 172.21.15.81:0/3986588955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f2244106640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f223c009e80 tx=0x7f223c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f596680af4bb823a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.620+0000 7f22427fc640 1 -- 172.21.15.81:0/3986588955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c036070 con 0x7f2244106240 2024-09-12T12:07:52.555 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.620+0000 7f22427fc640 1 -- 172.21.15.81:0/3986588955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f223c031900 con 0x7f2244106240 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.620+0000 7f22427fc640 1 -- 172.21.15.81:0/3986588955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c007ab0 con 0x7f2244106240 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 -- 172.21.15.81:0/3986588955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 msgr2=0x7f2244106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 --2- 172.21.15.81:0/3986588955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f2244106640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f223c009e80 tx=0x7f223c02a7a0 comp rx=0 tx=0).stop 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 -- 172.21.15.81:0/3986588955 shutdown_connections 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 --2- 172.21.15.81:0/3986588955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f2244106640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 -- 172.21.15.81:0/3986588955 >> 172.21.15.81:0/3986588955 conn(0x7f22441020d0 msgr2=0x7f22441044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 -- 172.21.15.81:0/3986588955 shutdown_connections 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.621+0000 7f2249b7a640 1 -- 172.21.15.81:0/3986588955 wait complete. 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f2249b7a640 1 Processor -- start 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f2249b7a640 1 -- start start 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f2249b7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f224419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f2249b7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2244107d20 con 0x7f2244106240 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f22437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f224419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:52.556 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f22437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f224419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39152/0 (socket says 172.21.15.81:39152) 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f22437fe640 1 -- 172.21.15.81:0/3677030312 learned_addr learned my addr 172.21.15.81:0/3677030312 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.622+0000 7f22437fe640 1 -- 172.21.15.81:0/3677030312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224419e0b0 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.623+0000 7f22437fe640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f224419db70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f223c031d10 tx=0x7f223c031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.623+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c036050 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.623+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224419e340 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.623+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f223c042070 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.623+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c03da20 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.623+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22441a1030 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.624+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f223c03dcd0 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.624+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2244106640 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.624+0000 7f2240ff9640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2230038eb0 0x7f223003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.624+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f223c007e00 con 0x7f2244106240 2024-09-12T12:07:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.624+0000 7f2242ffd640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2230038eb0 0x7f223003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.625+0000 7f2242ffd640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2230038eb0 0x7f223003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f222c0098c0 tx=0x7f222c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.629+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f223c044310 con 0x7f2244106240 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.807+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f2244074ca0 con 0x7f2230038eb0 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.853+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f223c039300 con 0x7f2244106240 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.876+0000 7f2240ff9640 1 -- 172.21.15.81:0/3677030312 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f2244074ca0 con 0x7f2230038eb0 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.879+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2230038eb0 msgr2=0x7f223003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.879+0000 7f2249b7a640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2230038eb0 0x7f223003b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f222c0098c0 tx=0x7f222c006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.879+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 msgr2=0x7f224419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.879+0000 7f2249b7a640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f224419db70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f223c031d10 tx=0x7f223c031d40 comp rx=0 tx=0).stop 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.880+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 shutdown_connections 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.880+0000 7f2249b7a640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2230038eb0 0x7f223003b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.880+0000 7f2249b7a640 1 --2- 172.21.15.81:0/3677030312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2244106240 0x7f224419db70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:52.558 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.880+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 >> 172.21.15.81:0/3677030312 conn(0x7f22441020d0 msgr2=0x7f2244191e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:52.559 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.880+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 shutdown_connections 2024-09-12T12:07:52.559 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:50.880+0000 7f2249b7a640 1 -- 172.21.15.81:0/3677030312 wait complete. 2024-09-12T12:07:52.559 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$YQuZvAZNLr0iVAjCjHEgw.JCKsKTENmquv3SGI7ihgyg.QsT1G4w2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726142873, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.956+0000 7f6462de7640 1 Processor -- start 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6462de7640 1 -- start start 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6462de7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c106030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6462de7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f645c106600 con 0x7f645c105c30 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6460b83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c106030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6460b83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c106030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44560/0 (socket says 172.21.15.81:44560) 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6460b83640 1 -- 172.21.15.81:0/789270722 learned_addr learned my addr 172.21.15.81:0/789270722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.957+0000 7f6460b83640 1 -- 172.21.15.81:0/789270722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c108c10 con 0x7f645c105c30 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.958+0000 7f6460b83640 1 --2- 172.21.15.81:0/789270722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c106030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6450009820 tx=0x7f645002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d78453c504fb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.958+0000 7f645b7fe640 1 -- 172.21.15.81:0/789270722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6450037070 con 0x7f645c105c30 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.958+0000 7f645b7fe640 1 -- 172.21.15.81:0/789270722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6450032940 con 0x7f645c105c30 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.958+0000 7f645b7fe640 1 -- 172.21.15.81:0/789270722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64500308b0 con 0x7f645c105c30 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 -- 172.21.15.81:0/789270722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 msgr2=0x7f645c106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 --2- 172.21.15.81:0/789270722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c106030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6450009820 tx=0x7f645002a270 comp rx=0 tx=0).stop 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 -- 172.21.15.81:0/789270722 shutdown_connections 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 --2- 172.21.15.81:0/789270722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c106030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 -- 172.21.15.81:0/789270722 >> 172.21.15.81:0/789270722 conn(0x7f645c1017c0 msgr2=0x7f645c103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 -- 172.21.15.81:0/789270722 shutdown_connections 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 -- 172.21.15.81:0/789270722 wait complete. 2024-09-12T12:07:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 Processor -- start 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.959+0000 7f6462de7640 1 -- start start 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6462de7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6462de7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f645c10bfc0 con 0x7f645c105c30 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6460b83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6460b83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c108490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44564/0 (socket says 172.21.15.81:44564) 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6460b83640 1 -- 172.21.15.81:0/849262353 learned_addr learned my addr 172.21.15.81:0/849262353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6460b83640 1 -- 172.21.15.81:0/849262353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c1089d0 con 0x7f645c105c30 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6460b83640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c108490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6450009940 tx=0x7f6450032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6450042070 con 0x7f645c105c30 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f645003d930 con 0x7f645c105c30 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c106bc0 con 0x7f645c105c30 2024-09-12T12:07:53.980 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6450037040 con 0x7f645c105c30 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.960+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c107100 con 0x7f645c105c30 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.961+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f6450045070 con 0x7f645c105c30 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.962+0000 7f6459ffb640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f644c038fc0 0x7f644c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.962+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645c1060b0 con 0x7f645c105c30 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.962+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f645006c560 con 0x7f645c105c30 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.962+0000 7f645bfff640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f644c038fc0 0x7f644c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.962+0000 7f645bfff640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f644c038fc0 0x7f644c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f64480098c0 tx=0x7f6448006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:52.966+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f645003cdc0 con 0x7f645c105c30 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.147+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f645c107890 con 0x7f644c038fc0 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.369+0000 7f6459ffb640 1 -- 172.21.15.81:0/849262353 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f645c107890 con 0x7f644c038fc0 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f644c038fc0 msgr2=0x7f644c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:53.981 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f644c038fc0 0x7f644c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f64480098c0 tx=0x7f6448006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 msgr2=0x7f645c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c108490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6450009940 tx=0x7f6450032670 comp rx=0 tx=0).stop 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 shutdown_connections 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f644c038fc0 0x7f644c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 --2- 172.21.15.81:0/849262353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645c105c30 0x7f645c108490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.371+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 >> 172.21.15.81:0/849262353 conn(0x7f645c1017c0 msgr2=0x7f645c102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.372+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 shutdown_connections 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:53.372+0000 7f6462de7640 1 -- 172.21.15.81:0/849262353 wait complete. 2024-09-12T12:07:53.982 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-09-12T12:07:54.545 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:54 smithi081 ceph-mon[30948]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:07:54.546 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:54 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T12:07:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06dd4c4640 1 Processor -- start 2024-09-12T12:07:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06dd4c4640 1 -- start start 2024-09-12T12:07:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06dd4c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d807c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06dd4c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06d807c900 con 0x7f06d807de80 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d807c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d807c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44570/0 (socket says 172.21.15.81:44570) 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06d6ffd640 1 -- 172.21.15.81:0/2150052385 learned_addr learned my addr 172.21.15.81:0/2150052385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.367+0000 7f06d6ffd640 1 -- 172.21.15.81:0/2150052385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d807ca80 con 0x7f06d807de80 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.368+0000 7f06d6ffd640 1 --2- 172.21.15.81:0/2150052385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d807c330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009820 tx=0x7f06c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1e60e1385fab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06d5ffb640 1 -- 172.21.15.81:0/2150052385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c8037070 con 0x7f06d807de80 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06d5ffb640 1 -- 172.21.15.81:0/2150052385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06c8032940 con 0x7f06d807de80 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06d5ffb640 1 -- 172.21.15.81:0/2150052385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c80308b0 con 0x7f06d807de80 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 -- 172.21.15.81:0/2150052385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 msgr2=0x7f06d807c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 --2- 172.21.15.81:0/2150052385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d807c330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009820 tx=0x7f06c802a270 comp rx=0 tx=0).stop 2024-09-12T12:07:55.118 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 -- 172.21.15.81:0/2150052385 shutdown_connections 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 --2- 172.21.15.81:0/2150052385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d807c330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 -- 172.21.15.81:0/2150052385 >> 172.21.15.81:0/2150052385 conn(0x7f06d8103160 msgr2=0x7f06d8105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 -- 172.21.15.81:0/2150052385 shutdown_connections 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.371+0000 7f06dd4c4640 1 -- 172.21.15.81:0/2150052385 wait complete. 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.372+0000 7f06dd4c4640 1 Processor -- start 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.372+0000 7f06dd4c4640 1 -- start start 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.372+0000 7f06dd4c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.372+0000 7f06dd4c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06d810e040 con 0x7f06d807de80 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.373+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.373+0000 7f06d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44582/0 (socket says 172.21.15.81:44582) 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.373+0000 7f06d6ffd640 1 -- 172.21.15.81:0/3897440959 learned_addr learned my addr 172.21.15.81:0/3897440959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:55.119 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.373+0000 7f06d6ffd640 1 -- 172.21.15.81:0/3897440959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d819e0c0 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.373+0000 7f06d6ffd640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d819db80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097f0 tx=0x7f06c8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.374+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c8042070 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.374+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06c803d930 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.374+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c8037040 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.374+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d819e350 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.374+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81a1040 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.375+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f06c8045070 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.375+0000 7f06cffff640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f06c40390c0 0x7f06c403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.375+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f06c806c2b0 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.375+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d807c3b0 con 0x7f06d807de80 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.375+0000 7f06d67fc640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f06c40390c0 0x7f06c403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.375+0000 7f06d67fc640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f06c40390c0 0x7f06c403b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f06c00098c0 tx=0x7f06c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.380+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06c803cd80 con 0x7f06d807de80 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.545+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f06d81a1210 con 0x7f06d807de80 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.546+0000 7f06cffff640 1 -- 172.21.15.81:0/3897440959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f06c803c860 con 0x7f06d807de80 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f06c40390c0 msgr2=0x7f06c403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f06c40390c0 0x7f06c403b580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f06c00098c0 tx=0x7f06c0006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 msgr2=0x7f06d819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d819db80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097f0 tx=0x7f06c8032670 comp rx=0 tx=0).stop 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 shutdown_connections 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f06c40390c0 0x7f06c403b580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 --2- 172.21.15.81:0/3897440959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d807de80 0x7f06d819db80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 >> 172.21.15.81:0/3897440959 conn(0x7f06d8103160 msgr2=0x7f06d8103cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 shutdown_connections 2024-09-12T12:07:55.122 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:54.548+0000 7f06dd4c4640 1 -- 172.21.15.81:0/3897440959 wait complete. 2024-09-12T12:07:55.123 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T12:07:55.123 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-09-12T12:07:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T12:07:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-09-12T12:07:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-09-12T12:07:55.130 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T12:07:55.132 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-09-12T12:07:55.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:55.132 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-09-12T12:07:55.132 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-09-12T12:07:55.132 INFO:teuthology.orchestra.run.smithi081.stdout: Password: i9ffrsi1e3 2024-09-12T12:07:55.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:55.133 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config directory 2024-09-12T12:07:55.819 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:55 smithi081 ceph-mon[30948]: mgrmap e13: x(active, since 6s) 2024-09-12T12:07:55.819 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:55 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3897440959' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T12:07:56.414 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced7745640 1 Processor -- start 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced7745640 1 -- start start 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced7745640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced007c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced7745640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fced007c870 con 0x7fced007de30 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced54e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced007c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced54e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced007c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44598/0 (socket says 172.21.15.81:44598) 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.557+0000 7fced54e1640 1 -- 172.21.15.81:0/3462141820 learned_addr learned my addr 172.21.15.81:0/3462141820 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.558+0000 7fced54e1640 1 -- 172.21.15.81:0/3462141820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced007c9f0 con 0x7fced007de30 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.558+0000 7fced54e1640 1 --2- 172.21.15.81:0/3462141820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced007c330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009820 tx=0x7fcecc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dc73fbc116f71d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.558+0000 7fcec7fff640 1 -- 172.21.15.81:0/3462141820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc037070 con 0x7fced007de30 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.558+0000 7fcec7fff640 1 -- 172.21.15.81:0/3462141820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcecc032940 con 0x7fced007de30 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.558+0000 7fcec7fff640 1 -- 172.21.15.81:0/3462141820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc0308b0 con 0x7fced007de30 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 -- 172.21.15.81:0/3462141820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 msgr2=0x7fced007c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 --2- 172.21.15.81:0/3462141820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced007c330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009820 tx=0x7fcecc02a270 comp rx=0 tx=0).stop 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 -- 172.21.15.81:0/3462141820 shutdown_connections 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 --2- 172.21.15.81:0/3462141820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced007c330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 -- 172.21.15.81:0/3462141820 >> 172.21.15.81:0/3462141820 conn(0x7fced01031e0 msgr2=0x7fced0105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 -- 172.21.15.81:0/3462141820 shutdown_connections 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.559+0000 7fced7745640 1 -- 172.21.15.81:0/3462141820 wait complete. 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced7745640 1 Processor -- start 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced7745640 1 -- start start 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced7745640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced7745640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fced010e040 con 0x7fced007de30 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced54e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced54e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44604/0 (socket says 172.21.15.81:44604) 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced54e1640 1 -- 172.21.15.81:0/2307127999 learned_addr learned my addr 172.21.15.81:0/2307127999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced54e1640 1 -- 172.21.15.81:0/2307127999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced019e100 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced54e1640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced019dbc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcecc032670 tx=0x7fcecc0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc042070 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcecc03d930 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.560+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced019e390 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.561+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc037040 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.561+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced01a1080 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.561+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fcecc045070 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.561+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced007c3b0 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.561+0000 7fcec67fc640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcebc039060 0x7fcebc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.562+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcecc06c310 con 0x7fced007de30 2024-09-12T12:07:56.417 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.562+0000 7fced4ce0640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcebc039060 0x7fcebc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.562+0000 7fced4ce0640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcebc039060 0x7fcebc03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcec00098c0 tx=0x7fcec0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.566+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcecc04b170 con 0x7fced007de30 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.818+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fced01a1250 con 0x7fced007de30 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.821+0000 7fcec67fc640 1 -- 172.21.15.81:0/2307127999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fcecc02fd90 con 0x7fced007de30 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcebc039060 msgr2=0x7fcebc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcebc039060 0x7fcebc03b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcec00098c0 tx=0x7fcec0006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 msgr2=0x7fced019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced019dbc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcecc032670 tx=0x7fcecc0326a0 comp rx=0 tx=0).stop 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 shutdown_connections 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcebc039060 0x7fcebc03b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 --2- 172.21.15.81:0/2307127999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced007de30 0x7fced019dbc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:56.418 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 >> 172.21.15.81:0/2307127999 conn(0x7fced01031e0 msgr2=0x7fced0103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 shutdown_connections 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-09-12T12:07:55.823+0000 7fced7745640 1 -- 172.21.15.81:0/2307127999 wait complete. 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-09-12T12:07:56.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.420 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-09-12T12:07:56.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.420 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T12:07:56.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:07:56.420 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-09-12T12:07:56.450 INFO:tasks.cephadm:Fetching config... 2024-09-12T12:07:56.451 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:07:56.451 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T12:07:56.466 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T12:07:56.467 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:07:56.467 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T12:07:56.523 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T12:07:56.523 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:07:56.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T12:07:56.587 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T12:07:56.587 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:07:56.587 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T12:07:56.643 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T12:07:56.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:56.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:07:56.779 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:56.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T12:07:56.833 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCskBJGX6Lpgp5bTyYOcU+ICUEMxKPkT0OYwiGwrlAjH3ur9VEGqNNRTIXou1tXF752DoxUhGq1hkQOBgyGsdHhk2PrQX0qh1uQU7llBpD5uSsFSkaduKXunD1UmaXMruJVdV1dABS8stI0fcZRUDaq09dXu88wrFzsi1wE+ZyfCQj/WwyJszMn4HH+KwcyGRL/gLgsPWLti2Cw2IwleCOvxUanhSicW9DV/CqnB4ssRnQEjA+jHBzM/qnpadEYs5oLzKzZVsfjYOXRE4MQbAjgsXMBhjS32+v4BL+sqoOTsNNKDE91bDJ3GvqgfiJSy6SNKOROnzxxyX8qytNV3E4RkSpSyO6ysepaGcTGVeNJ9UvXFYcLevvX2miBd/ZNY975fSMUZbV/J8JhGIOdoUKWI02yjjfUNfYmbTb5ku/I7Wl/hztY+N1Z4Z21I8tIRPDwF9N8+Dft1lRGBBwsuetgz4PJT7dN1TayJTk/F5nz0gx2A6x5jh7Mwb+huKEf9yE= ceph-595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:07:56.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T12:07:57.090 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:07:57.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:56 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2307127999' entity='client.admin' 2024-09-12T12:07:57.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.555+0000 7ff2dce18640 1 -- 172.21.15.81:0/3891569252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 msgr2=0x7ff2d8100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.555+0000 7ff2dce18640 1 --2- 172.21.15.81:0/3891569252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8100910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009c20 tx=0x7ff2c802aa90 comp rx=0 tx=0).stop 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.555+0000 7ff2dce18640 1 -- 172.21.15.81:0/3891569252 shutdown_connections 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.555+0000 7ff2dce18640 1 --2- 172.21.15.81:0/3891569252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8100910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.555+0000 7ff2dce18640 1 -- 172.21.15.81:0/3891569252 >> 172.21.15.81:0/3891569252 conn(0x7ff2d80fbc80 msgr2=0x7ff2d80fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.556+0000 7ff2dce18640 1 -- 172.21.15.81:0/3891569252 shutdown_connections 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.556+0000 7ff2dce18640 1 -- 172.21.15.81:0/3891569252 wait complete. 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.556+0000 7ff2dce18640 1 Processor -- start 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.556+0000 7ff2dce18640 1 -- start start 2024-09-12T12:07:57.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.556+0000 7ff2dce18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.556+0000 7ff2dce18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d8106760 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2d659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44626/0 (socket says 172.21.15.81:44626) 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2d659c640 1 -- 172.21.15.81:0/504505100 learned_addr learned my addr 172.21.15.81:0/504505100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2d659c640 1 -- 172.21.15.81:0/504505100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d8197390 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2d659c640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8196e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005cc0 tx=0x7ff2c802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c8047070 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2c802e7d0 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d8197620 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c8033050 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.557+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d819a310 con 0x7ff2d8100510 2024-09-12T12:07:57.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.558+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff2c804a070 con 0x7ff2d8100510 2024-09-12T12:07:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.558+0000 7ff2c77fe640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff2c00390c0 0x7ff2c003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.558+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d8106ee0 con 0x7ff2d8100510 2024-09-12T12:07:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.558+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff2c803e030 con 0x7ff2d8100510 2024-09-12T12:07:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.558+0000 7ff2d5d9b640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff2c00390c0 0x7ff2c003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.559+0000 7ff2d5d9b640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff2c00390c0 0x7ff2c003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0098c0 tx=0x7ff2cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:57.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.563+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2c8051080 con 0x7ff2d8100510 2024-09-12T12:07:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.735+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff2d8100990 con 0x7ff2d8100510 2024-09-12T12:07:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.737+0000 7ff2c77fe640 1 -- 172.21.15.81:0/504505100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff2d8100990 con 0x7ff2d8100510 2024-09-12T12:07:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff2c00390c0 msgr2=0x7ff2c003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff2c00390c0 0x7ff2c003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0098c0 tx=0x7ff2cc006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 msgr2=0x7ff2d8196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8196e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8005cc0 tx=0x7ff2c802fbf0 comp rx=0 tx=0).stop 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 shutdown_connections 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff2c00390c0 0x7ff2c003b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 --2- 172.21.15.81:0/504505100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d8100510 0x7ff2d8196e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 >> 172.21.15.81:0/504505100 conn(0x7ff2d80fbc80 msgr2=0x7ff2d80fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 shutdown_connections 2024-09-12T12:07:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:57.739+0000 7ff2dce18640 1 -- 172.21.15.81:0/504505100 wait complete. 2024-09-12T12:07:58.755 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/504505100' entity='client.admin' 2024-09-12T12:07:58.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:58.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:58.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:07:58.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:58.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:07:58.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:07:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:07:58.782 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T12:07:58.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T12:07:59.324 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:07:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 -- 172.21.15.81:0/2714949346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 msgr2=0x7f62b4101fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 --2- 172.21.15.81:0/2714949346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4101fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009880 tx=0x7f62a402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:07:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 -- 172.21.15.81:0/2714949346 shutdown_connections 2024-09-12T12:07:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 --2- 172.21.15.81:0/2714949346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4101fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 -- 172.21.15.81:0/2714949346 >> 172.21.15.81:0/2714949346 conn(0x7f62b40fb450 msgr2=0x7f62b40fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 -- 172.21.15.81:0/2714949346 shutdown_connections 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 -- 172.21.15.81:0/2714949346 wait complete. 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 Processor -- start 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.774+0000 7f62baa58640 1 -- start start 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62baa58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62baa58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62b41067c0 con 0x7f62b4101bc0 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4100100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44640/0 (socket says 172.21.15.81:44640) 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62b3fff640 1 -- 172.21.15.81:0/2706389638 learned_addr learned my addr 172.21.15.81:0/2706389638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:07:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62b3fff640 1 -- 172.21.15.81:0/2706389638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b4199b70 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62b3fff640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4100100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009230 tx=0x7f62a4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.775+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a403f030 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.776+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b4199d40 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.776+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62a4003e30 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.776+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a4035070 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.776+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b419a0e0 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.776+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f62a4042030 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.777+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b4106f40 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.777+0000 7f62b17fa640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f629c039060 0x7f629c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.777+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f62a4040070 con 0x7f62b4101bc0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.777+0000 7f62b37fe640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f629c039060 0x7f629c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.777+0000 7f62b37fe640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f629c039060 0x7f629c03b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098c0 tx=0x7f62a8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:07:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.782+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62a404c350 con 0x7f62b4101bc0 2024-09-12T12:07:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.957+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f62b402da50 con 0x7f629c039060 2024-09-12T12:07:59.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.960+0000 7f62b17fa640 1 -- 172.21.15.81:0/2706389638 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f62b402da50 con 0x7f629c039060 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.962+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f629c039060 msgr2=0x7f629c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.962+0000 7f62baa58640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f629c039060 0x7f629c03b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098c0 tx=0x7f62a8006db0 comp rx=0 tx=0).stop 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.962+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 msgr2=0x7f62b4100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.962+0000 7f62baa58640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4100100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009230 tx=0x7f62a4032d00 comp rx=0 tx=0).stop 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.963+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 shutdown_connections 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.963+0000 7f62baa58640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f629c039060 0x7f629c03b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.963+0000 7f62baa58640 1 --2- 172.21.15.81:0/2706389638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62b4101bc0 0x7f62b4100100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.963+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 >> 172.21.15.81:0/2706389638 conn(0x7f62b40fb450 msgr2=0x7f62b40fbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:07:59.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.963+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 shutdown_connections 2024-09-12T12:07:59.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:07:59.963+0000 7f62baa58640 1 -- 172.21.15.81:0/2706389638 wait complete. 2024-09-12T12:08:00.817 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi103 2024-09-12T12:08:00.818 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:08:00.818 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.conf 2024-09-12T12:08:00.837 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:08:00.838 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:00.896 INFO:tasks.cephadm:Adding host smithi103 to orchestrator... 2024-09-12T12:08:00.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch host add smithi103 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:01.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:01.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:01.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:00 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:01.367 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 -- 172.21.15.81:0/3627700319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 msgr2=0x7fc650106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 --2- 172.21.15.81:0/3627700319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009810 tx=0x7fc64c02a540 comp rx=0 tx=0).stop 2024-09-12T12:08:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 -- 172.21.15.81:0/3627700319 shutdown_connections 2024-09-12T12:08:01.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 --2- 172.21.15.81:0/3627700319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 -- 172.21.15.81:0/3627700319 >> 172.21.15.81:0/3627700319 conn(0x7fc650077310 msgr2=0x7fc6500fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 -- 172.21.15.81:0/3627700319 shutdown_connections 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.799+0000 7fc657c5a640 1 -- 172.21.15.81:0/3627700319 wait complete. 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc657c5a640 1 Processor -- start 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc657c5a640 1 -- start start 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc657c5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc657c5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc65010acb0 con 0x7fc650106540 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc6559f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc6559f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44646/0 (socket says 172.21.15.81:44646) 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc6559f6640 1 -- 172.21.15.81:0/114592466 learned_addr learned my addr 172.21.15.81:0/114592466 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc6559f6640 1 -- 172.21.15.81:0/114592466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6501985d0 con 0x7fc650106540 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc6559f6640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650198090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0058e0 tx=0x7fc64c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:01.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc64c031400 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc64c0035f0 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc650198860 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc64c03c480 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.800+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc650198cc0 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.801+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fc64c039040 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.801+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc650101bb0 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.801+0000 7fc642ffd640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc63c039060 0x7fc63c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.802+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc64c06d5f0 con 0x7fc650106540 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.802+0000 7fc6551f5640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc63c039060 0x7fc63c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.802+0000 7fc6551f5640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc63c039060 0x7fc63c03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc64400ad30 tx=0x7fc6440093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:01.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.806+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc64c040030 con 0x7fc650106540 2024-09-12T12:08:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:01.980+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}) -- 0x7fc6501069a0 con 0x7fc63c039060 2024-09-12T12:08:02.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:01 smithi081 ceph-mon[30948]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:08:03.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:02 smithi081 ceph-mon[30948]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:04.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:03 smithi081 ceph-mon[30948]: Deploying cephadm binary to smithi103 2024-09-12T12:08:05.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.292+0000 7fc642ffd640 1 -- 172.21.15.81:0/114592466 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc6501069a0 con 0x7fc63c039060 2024-09-12T12:08:05.292 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi103' with addr '172.21.15.103' 2024-09-12T12:08:05.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc63c039060 msgr2=0x7fc63c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:05.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc63c039060 0x7fc63c03b520 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc64400ad30 tx=0x7fc6440093f0 comp rx=0 tx=0).stop 2024-09-12T12:08:05.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 msgr2=0x7fc650198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:05.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650198090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0058e0 tx=0x7fc64c0045e0 comp rx=0 tx=0).stop 2024-09-12T12:08:05.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 shutdown_connections 2024-09-12T12:08:05.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc63c039060 0x7fc63c03b520 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:05.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 --2- 172.21.15.81:0/114592466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc650106540 0x7fc650198090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:05.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 >> 172.21.15.81:0/114592466 conn(0x7fc650077310 msgr2=0x7fc6500feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:05.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 shutdown_connections 2024-09-12T12:08:05.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:05.294+0000 7fc657c5a640 1 -- 172.21.15.81:0/114592466 wait complete. 2024-09-12T12:08:05.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T12:08:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:06.498 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:06.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:06 smithi081 ceph-mon[30948]: Added host smithi103 2024-09-12T12:08:06.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:06.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:06.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 -- 172.21.15.81:0/2853436236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 msgr2=0x7f6c58106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 --2- 172.21.15.81:0/2853436236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009880 tx=0x7f6c5002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 -- 172.21.15.81:0/2853436236 shutdown_connections 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 --2- 172.21.15.81:0/2853436236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 -- 172.21.15.81:0/2853436236 >> 172.21.15.81:0/2853436236 conn(0x7f6c580fc1b0 msgr2=0x7f6c580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 -- 172.21.15.81:0/2853436236 shutdown_connections 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 -- 172.21.15.81:0/2853436236 wait complete. 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 Processor -- start 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.498+0000 7f6c5f144640 1 -- start start 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5f144640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58194fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:06.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5f144640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c58109bf0 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5cee0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58194fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5cee0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58194fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52978/0 (socket says 172.21.15.81:52978) 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5cee0640 1 -- 172.21.15.81:0/2049885301 learned_addr learned my addr 172.21.15.81:0/2049885301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5cee0640 1 -- 172.21.15.81:0/2049885301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c58195520 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5cee0640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58194fe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c50006010 tx=0x7f6c50003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c5003f070 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6c50031c20 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c581957b0 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.499+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c50035030 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.500+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c581998b0 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.500+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f6c50042070 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.501+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c58101bd0 con 0x7f6c58106560 2024-09-12T12:08:06.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.501+0000 7f6c55ffb640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f6c4403b2c0 0x7f6c4403d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:06.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.501+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6c5006ccb0 con 0x7f6c58106560 2024-09-12T12:08:06.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.501+0000 7f6c57fff640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f6c4403b2c0 0x7f6c4403d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:06.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.501+0000 7f6c57fff640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f6c4403b2c0 0x7f6c4403d780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800ad30 tx=0x7f6c480093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:06.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.506+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c5004c350 con 0x7f6c58106560 2024-09-12T12:08:06.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.677+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c58196340 con 0x7f6c4403b2c0 2024-09-12T12:08:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.678+0000 7f6c55ffb640 1 -- 172.21.15.81:0/2049885301 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f6c58196340 con 0x7f6c4403b2c0 2024-09-12T12:08:06.678 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:08:06.679 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}] 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f6c4403b2c0 msgr2=0x7f6c4403d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f6c4403b2c0 0x7f6c4403d780 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800ad30 tx=0x7f6c480093f0 comp rx=0 tx=0).stop 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 msgr2=0x7f6c58194fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58194fe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c50006010 tx=0x7f6c50003c00 comp rx=0 tx=0).stop 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 shutdown_connections 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f6c4403b2c0 0x7f6c4403d780 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 --2- 172.21.15.81:0/2049885301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c58106560 0x7f6c58194fe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.680+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 >> 172.21.15.81:0/2049885301 conn(0x7f6c580fc1b0 msgr2=0x7f6c580fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.681+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 shutdown_connections 2024-09-12T12:08:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:06.681+0000 7f6c5f144640 1 -- 172.21.15.81:0/2049885301 wait complete. 2024-09-12T12:08:07.307 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2024-09-12T12:08:07.307 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:08:07.308 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2024-09-12T12:08:07.326 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:08:07.327 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:07.385 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2024-09-12T12:08:07.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch host add smithi173 2024-09-12T12:08:07.627 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:07.890 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:07.891 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:07 smithi081 ceph-mon[30948]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:08:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.061+0000 7fab5c45b640 1 -- 172.21.15.81:0/887954234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 msgr2=0x7fab54107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.061+0000 7fab5c45b640 1 --2- 172.21.15.81:0/887954234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab54107a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fab50009880 tx=0x7fab5002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:08:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 -- 172.21.15.81:0/887954234 shutdown_connections 2024-09-12T12:08:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 --2- 172.21.15.81:0/887954234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab54107a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 -- 172.21.15.81:0/887954234 >> 172.21.15.81:0/887954234 conn(0x7fab540fd260 msgr2=0x7fab540ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:08.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 -- 172.21.15.81:0/887954234 shutdown_connections 2024-09-12T12:08:08.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 -- 172.21.15.81:0/887954234 wait complete. 2024-09-12T12:08:08.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 Processor -- start 2024-09-12T12:08:08.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 -- start start 2024-09-12T12:08:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5c45b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab5410bde0 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5a1f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.062+0000 7fab5a1f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53000/0 (socket says 172.21.15.81:53000) 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab5a1f7640 1 -- 172.21.15.81:0/3837073687 learned_addr learned my addr 172.21.15.81:0/3837073687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab5a1f7640 1 -- 172.21.15.81:0/3837073687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab540763e0 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab5a1f7640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab540744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab50006010 tx=0x7fab50003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab5003f070 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fab50031c20 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab54074a30 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab50035030 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.063+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab54074ef0 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.064+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fab50042070 con 0x7fab54107670 2024-09-12T12:08:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.064+0000 7fab4b7fe640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fab400390c0 0x7fab4003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.064+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fab5006c930 con 0x7fab54107670 2024-09-12T12:08:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.064+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab54102ce0 con 0x7fab54107670 2024-09-12T12:08:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.064+0000 7fab599f6640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fab400390c0 0x7fab4003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.065+0000 7fab599f6640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fab400390c0 0x7fab4003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab440098c0 tx=0x7fab44006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:08.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.069+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab5003b5f0 con 0x7fab54107670 2024-09-12T12:08:08.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:08.238+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}) -- 0x7fab54075a20 con 0x7fab400390c0 2024-09-12T12:08:09.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:09 smithi081 ceph-mon[30948]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:09.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:09 smithi081 ceph-mon[30948]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:10.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: Deploying cephadm binary to smithi173 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.396+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3837073687 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fab54075a20 con 0x7fab400390c0 2024-09-12T12:08:11.397 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi173' with addr '172.21.15.173' 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fab400390c0 msgr2=0x7fab4003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fab400390c0 0x7fab4003b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fab440098c0 tx=0x7fab44006db0 comp rx=0 tx=0).stop 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 msgr2=0x7fab540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab540744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fab50006010 tx=0x7fab50003c00 comp rx=0 tx=0).stop 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 shutdown_connections 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fab400390c0 0x7fab4003b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 --2- 172.21.15.81:0/3837073687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab54107670 0x7fab540744f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 >> 172.21.15.81:0/3837073687 conn(0x7fab540fd260 msgr2=0x7fab540feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 shutdown_connections 2024-09-12T12:08:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:11.399+0000 7fab5c45b640 1 -- 172.21.15.81:0/3837073687 wait complete. 2024-09-12T12:08:11.702 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:08:11.702 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:11.702 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:11.702 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:11.703 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:11.703 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:11.703 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:11.703 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:11.703 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:12.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T12:08:12.252 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:12.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:12 smithi081 ceph-mon[30948]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:08:12.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:12 smithi081 ceph-mon[30948]: Added host smithi173 2024-09-12T12:08:12.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:12.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 -- 172.21.15.81:0/3097150939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 msgr2=0x7f15e0102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 --2- 172.21.15.81:0/3097150939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e0102b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009880 tx=0x7f15d002a670 comp rx=0 tx=0).stop 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 -- 172.21.15.81:0/3097150939 shutdown_connections 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 --2- 172.21.15.81:0/3097150939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e0102b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 -- 172.21.15.81:0/3097150939 >> 172.21.15.81:0/3097150939 conn(0x7f15e00fc1b0 msgr2=0x7f15e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 -- 172.21.15.81:0/3097150939 shutdown_connections 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.702+0000 7f15e65c6640 1 -- 172.21.15.81:0/3097150939 wait complete. 2024-09-12T12:08:12.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15e65c6640 1 Processor -- start 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15e65c6640 1 -- start start 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15e65c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e01972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15e65c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e010be00 con 0x7f15e0102750 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e01972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e01972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42254/0 (socket says 172.21.15.81:42254) 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15dffff640 1 -- 172.21.15.81:0/2324609893 learned_addr learned my addr 172.21.15.81:0/2324609893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15dffff640 1 -- 172.21.15.81:0/2324609893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e0197820 con 0x7f15e0102750 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.703+0000 7f15dffff640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e01972e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f15d0006010 tx=0x7f15d0003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.704+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d003f070 con 0x7f15e0102750 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.704+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f15d0031c20 con 0x7f15e0102750 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.704+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15d0035030 con 0x7f15e0102750 2024-09-12T12:08:12.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.704+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e0197ab0 con 0x7f15e0102750 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.704+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e0197f10 con 0x7f15e0102750 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.704+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f15d0042070 con 0x7f15e0102750 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.705+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e006a7b0 con 0x7f15e0102750 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.705+0000 7f15dd7fa640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15c8039060 0x7f15c803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.705+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f15d006ce30 con 0x7f15e0102750 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.705+0000 7f15df7fe640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15c8039060 0x7f15c803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.705+0000 7f15df7fe640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15c8039060 0x7f15c803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098c0 tx=0x7f15d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:12.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.709+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15d004c350 con 0x7f15e0102750 2024-09-12T12:08:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.882+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15e0198640 con 0x7f15c8039060 2024-09-12T12:08:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.883+0000 7f15dd7fa640 1 -- 172.21.15.81:0/2324609893 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f15e0198640 con 0x7f15c8039060 2024-09-12T12:08:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:08:12.884 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15c8039060 msgr2=0x7f15c803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15c8039060 0x7f15c803b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f15d40098c0 tx=0x7f15d4006db0 comp rx=0 tx=0).stop 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 msgr2=0x7f15e01972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e01972e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f15d0006010 tx=0x7f15d0003c00 comp rx=0 tx=0).stop 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 shutdown_connections 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15c8039060 0x7f15c803b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 --2- 172.21.15.81:0/2324609893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e0102750 0x7f15e01972e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 >> 172.21.15.81:0/2324609893 conn(0x7f15e00fc1b0 msgr2=0x7f15e01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:12.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 shutdown_connections 2024-09-12T12:08:12.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:12.885+0000 7f15e65c6640 1 -- 172.21.15.81:0/2324609893 wait complete. 2024-09-12T12:08:13.436 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T12:08:13.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T12:08:13.675 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:13.795 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:13 smithi081 ceph-mon[30948]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:13.795 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 -- 172.21.15.81:0/1833111297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 msgr2=0x7fa28c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 --2- 172.21.15.81:0/1833111297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa280009880 tx=0x7fa28002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 -- 172.21.15.81:0/1833111297 shutdown_connections 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 --2- 172.21.15.81:0/1833111297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 -- 172.21.15.81:0/1833111297 >> 172.21.15.81:0/1833111297 conn(0x7fa28c0fc1b0 msgr2=0x7fa28c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 -- 172.21.15.81:0/1833111297 shutdown_connections 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.101+0000 7fa291117640 1 -- 172.21.15.81:0/1833111297 wait complete. 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa291117640 1 Processor -- start 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa291117640 1 -- start start 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa291117640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa291117640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa28c10acd0 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa28ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa28ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c1971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42276/0 (socket says 172.21.15.81:42276) 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa28ad9d640 1 -- 172.21.15.81:0/1980461566 learned_addr learned my addr 172.21.15.81:0/1980461566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.102+0000 7fa28ad9d640 1 -- 172.21.15.81:0/1980461566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28c197730 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.103+0000 7fa28ad9d640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c1971f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa280006010 tx=0x7fa280003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.103+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa28003f070 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.103+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28c1979c0 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.103+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa280031c20 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.103+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa280035030 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.103+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28c19bac0 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.104+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28c101bd0 con 0x7fa28c106560 2024-09-12T12:08:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.104+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa280042070 con 0x7fa28c106560 2024-09-12T12:08:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.104+0000 7fa273fff640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa274039060 0x7fa27403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.104+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa28006ccd0 con 0x7fa28c106560 2024-09-12T12:08:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.104+0000 7fa28a59c640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa274039060 0x7fa27403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.105+0000 7fa28a59c640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa274039060 0x7fa27403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0098c0 tx=0x7fa27c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.109+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa28004c350 con 0x7fa28c106560 2024-09-12T12:08:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.278+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa28c1069c0 con 0x7fa28c106560 2024-09-12T12:08:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.411+0000 7fa273fff640 1 -- 172.21.15.81:0/1980461566 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fa28003fde0 con 0x7fa28c106560 2024-09-12T12:08:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa274039060 msgr2=0x7fa27403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa274039060 0x7fa27403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0098c0 tx=0x7fa27c006db0 comp rx=0 tx=0).stop 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 msgr2=0x7fa28c1971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c1971f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa280006010 tx=0x7fa280003c00 comp rx=0 tx=0).stop 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 shutdown_connections 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa274039060 0x7fa27403b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 --2- 172.21.15.81:0/1980461566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c106560 0x7fa28c1971f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 >> 172.21.15.81:0/1980461566 conn(0x7fa28c0fc1b0 msgr2=0x7fa28c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 shutdown_connections 2024-09-12T12:08:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:14.413+0000 7fa291117640 1 -- 172.21.15.81:0/1980461566 wait complete. 2024-09-12T12:08:14.812 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:14 smithi081 ceph-mon[30948]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:08:14.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:14 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1980461566' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T12:08:15.027 INFO:tasks.cephadm:Adding mon.a on smithi081 2024-09-12T12:08:15.027 INFO:tasks.cephadm:Adding mon.b on smithi103 2024-09-12T12:08:15.027 INFO:tasks.cephadm:Adding mon.c on smithi173 2024-09-12T12:08:15.027 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi081:172.21.15.81=a;smithi103:172.21.15.103=b;smithi173:172.21.15.173=c' 2024-09-12T12:08:15.370 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T12:08:15.425 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1980461566' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:15 smithi081 ceph-mon[30948]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:08:15.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 -- 172.21.15.173:0/2946943770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 msgr2=0x7fbc5c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:15.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 --2- 172.21.15.173:0/2946943770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009880 tx=0x7fbc4c02a5d0 comp rx=0 tx=0).stop 2024-09-12T12:08:15.932 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 -- 172.21.15.173:0/2946943770 shutdown_connections 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 --2- 172.21.15.173:0/2946943770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 -- 172.21.15.173:0/2946943770 >> 172.21.15.173:0/2946943770 conn(0x7fbc5c0fbcd0 msgr2=0x7fbc5c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 -- 172.21.15.173:0/2946943770 shutdown_connections 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 -- 172.21.15.173:0/2946943770 wait complete. 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.909+0000 7fbc62207640 1 Processor -- start 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc62207640 1 -- start start 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc62207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c0fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc62207640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c106740 con 0x7fbc5c100540 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c0fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c0fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.173:53938/0 (socket says 172.21.15.173:53938) 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc5b7fe640 1 -- 172.21.15.173:0/625912888 learned_addr learned my addr 172.21.15.173:0/625912888 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:08:15.933 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.910+0000 7fbc5b7fe640 1 -- 172.21.15.173:0/625912888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c0fe0d0 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.911+0000 7fbc5b7fe640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c0fdb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009230 tx=0x7fbc4c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.911+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4c03f030 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.911+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc4c003e30 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.911+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc4c035070 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.911+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c0fc2c0 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.911+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c0fc800 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.912+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbc4c042030 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.912+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5c106ec0 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.912+0000 7fbc58ff9640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbc44039060 0x7fbc4403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.912+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbc4c040070 con 0x7fbc5c100540 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.912+0000 7fbc5affd640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbc44039060 0x7fbc4403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.913+0000 7fbc5affd640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbc44039060 0x7fbc4403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc500098c0 tx=0x7fbc50006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:15.934 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:15.917+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc4c0433c0 con 0x7fbc5c100540 2024-09-12T12:08:16.108 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.108+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi103:172.21.15.103=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}) -- 0x7fbc5c190390 con 0x7fbc44039060 2024-09-12T12:08:16.113 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.113+0000 7fbc58ff9640 1 -- 172.21.15.173:0/625912888 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbc5c190390 con 0x7fbc44039060 2024-09-12T12:08:16.114 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2024-09-12T12:08:16.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.115+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbc44039060 msgr2=0x7fbc4403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:16.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.115+0000 7fbc62207640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbc44039060 0x7fbc4403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc500098c0 tx=0x7fbc50006db0 comp rx=0 tx=0).stop 2024-09-12T12:08:16.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.115+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 msgr2=0x7fbc5c0fdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:16.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.115+0000 7fbc62207640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c0fdb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c009230 tx=0x7fbc4c032d00 comp rx=0 tx=0).stop 2024-09-12T12:08:16.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.116+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 shutdown_connections 2024-09-12T12:08:16.116 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.116+0000 7fbc62207640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbc44039060 0x7fbc4403b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:16.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.116+0000 7fbc62207640 1 --2- 172.21.15.173:0/625912888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc5c100540 0x7fbc5c0fdb90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:16.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.116+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 >> 172.21.15.173:0/625912888 conn(0x7fbc5c0fbcd0 msgr2=0x7fbc5c069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:16.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.116+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 shutdown_connections 2024-09-12T12:08:16.117 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:16.116+0000 7fbc62207640 1 -- 172.21.15.173:0/625912888 wait complete. 2024-09-12T12:08:16.765 DEBUG:teuthology.orchestra.run.smithi103:mon.b> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T12:08:16.768 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T12:08:16.770 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:08:16.770 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi103:172.21.15.103=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi103:172.21.15.103=b;smithi173:172.21.15.173=c;count:3 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:17.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:17.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:17.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:17.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:17.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: Deploying daemon mon.c on smithi173 2024-09-12T12:08:17.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:17 smithi081 ceph-mon[30948]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:17.902 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 -- 172.21.15.173:0/353202548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 msgr2=0x7fd80c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 --2- 172.21.15.173:0/353202548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c102b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009810 tx=0x7fd7fc02a540 comp rx=0 tx=0).stop 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 -- 172.21.15.173:0/353202548 shutdown_connections 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 --2- 172.21.15.173:0/353202548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c102b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 -- 172.21.15.173:0/353202548 >> 172.21.15.173:0/353202548 conn(0x7fd80c077310 msgr2=0x7fd80c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 -- 172.21.15.173:0/353202548 shutdown_connections 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.496+0000 7fd811c55640 1 -- 172.21.15.173:0/353202548 wait complete. 2024-09-12T12:08:19.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.497+0000 7fd811c55640 1 Processor -- start 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.498+0000 7fd811c55640 1 -- start start 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.498+0000 7fd811c55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.498+0000 7fd811c55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c10bdd0 con 0x7fd80c102730 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.498+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.498+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c1972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.173:53942/0 (socket says 172.21.15.173:53942) 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.498+0000 7fd80b7fe640 1 -- 172.21.15.173:0/2212210267 learned_addr learned my addr 172.21.15.173:0/2212210267 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd80b7fe640 1 -- 172.21.15.173:0/2212210267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c1977e0 con 0x7fd80c102730 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd80b7fe640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c1972a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0058e0 tx=0x7fd7fc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc031400 con 0x7fd80c102730 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd7fc0035f0 con 0x7fd80c102730 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80c197a70 con 0x7fd80c102730 2024-09-12T12:08:19.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7fc03c480 con 0x7fd80c102730 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.499+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80c197ed0 con 0x7fd80c102730 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.500+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd7fc039040 con 0x7fd80c102730 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.500+0000 7fd808ff9640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd7f4039060 0x7fd7f403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.500+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd7fc06d5a0 con 0x7fd80c102730 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.500+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd80c069f90 con 0x7fd80c102730 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.501+0000 7fd80affd640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd7f4039060 0x7fd7f403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.501+0000 7fd80affd640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd7f4039060 0x7fd7f403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098c0 tx=0x7fd800006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:19.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.506+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7fc040030 con 0x7fd80c102730 2024-09-12T12:08:19.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:19 smithi081 ceph-mon[30948]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:19.764 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.764+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd80c198600 con 0x7fd80c102730 2024-09-12T12:08:19.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.764+0000 7fd808ff9640 1 -- 172.21.15.173:0/2212210267 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fd7fc03aca0 con 0x7fd80c102730 2024-09-12T12:08:19.765 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:08:19.765 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","modified":"2024-09-12T12:06:59.805503Z","created":"2024-09-12T12:06:59.805503Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T12:08:19.765 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-09-12T12:08:19.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd7f4039060 msgr2=0x7fd7f403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd7f4039060 0x7fd7f403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098c0 tx=0x7fd800006db0 comp rx=0 tx=0).stop 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 msgr2=0x7fd80c1972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c1972a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0058e0 tx=0x7fd7fc0045e0 comp rx=0 tx=0).stop 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 shutdown_connections 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd7f4039060 0x7fd7f403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 --2- 172.21.15.173:0/2212210267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c102730 0x7fd80c1972a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 >> 172.21.15.173:0/2212210267 conn(0x7fd80c077310 msgr2=0x7fd80c1034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 shutdown_connections 2024-09-12T12:08:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:19.767+0000 7fd811c55640 1 -- 172.21.15.173:0/2212210267 wait complete. 2024-09-12T12:08:20.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:20 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/2212210267' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:21.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:20 smithi173 systemd[1]: Started Ceph mon.c for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:08:21.348 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:08:21.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:08:21.606 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:08:26.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:08:26.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: mon.a calling monitor election 2024-09-12T12:08:26.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:26.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: mon.c calling monitor election 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: monmap epoch 2 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: last_changed 2024-09-12T12:08:20.794154+0000 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: created 2024-09-12T12:06:59.805503+0000 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: min_mon_release 19 (squid) 2024-09-12T12:08:26.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: election_strategy: 1 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: fsmap 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: mgrmap e13: x(active, since 37s) 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: overall HEALTH_OK 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:26.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: mon.a calling monitor election 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: mon.c calling monitor election 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: monmap epoch 2 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: last_changed 2024-09-12T12:08:20.794154+0000 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: created 2024-09-12T12:06:59.805503+0000 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: min_mon_release 19 (squid) 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: election_strategy: 1 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: fsmap 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: mgrmap e13: x(active, since 37s) 2024-09-12T12:08:26.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: overall HEALTH_OK 2024-09-12T12:08:26.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:26.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:26.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:26.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:26.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 -- 172.21.15.173:0/1721779319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2c003530 msgr2=0x7fea2c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 --2- 172.21.15.173:0/1721779319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2c003530 0x7fea2c0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea441016a0 tx=0x7fea3402c490 comp rx=0 tx=0).stop 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 -- 172.21.15.173:0/1721779319 shutdown_connections 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 --2- 172.21.15.173:0/1721779319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2c003530 0x7fea2c0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 -- 172.21.15.173:0/1721779319 >> 172.21.15.173:0/1721779319 conn(0x7fea440fc220 msgr2=0x7fea440fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 -- 172.21.15.173:0/1721779319 shutdown_connections 2024-09-12T12:08:26.435 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.434+0000 7fea498d8640 1 -- 172.21.15.173:0/1721779319 wait complete. 2024-09-12T12:08:26.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.435+0000 7fea498d8640 1 Processor -- start 2024-09-12T12:08:26.437 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.435+0000 7fea498d8640 1 -- start start 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea498d8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea498d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea44197880 0x7fea4419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea498d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea441087c0 con 0x7fea44197880 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea498d8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fea44108640 con 0x7fea2c003530 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41786/0 (socket says 172.21.15.173:41786) 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 -- 172.21.15.173:0/4265174373 learned_addr learned my addr 172.21.15.173:0/4265174373 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea427fc640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea44197880 0x7fea4419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 -- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 msgr2=0x7fea44197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 -- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 msgr2=0x7fea44197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:08:26.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.436+0000 7fea42ffd640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea427fc640 1 -- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 msgr2=0x7fea44197340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea427fc640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea427fc640 1 -- 172.21.15.173:0/4265174373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea44197ea0 con 0x7fea44197880 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea427fc640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea44197880 0x7fea4419bc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b3d0 tx=0x7fea3800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fea38011630 con 0x7fea44197880 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea38011cd0 con 0x7fea44197880 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4419c150 con 0x7fea44197880 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fea3800f2e0 con 0x7fea44197880 2024-09-12T12:08:26.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.437+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea4419c710 con 0x7fea44197880 2024-09-12T12:08:26.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.438+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fea38018020 con 0x7fea44197880 2024-09-12T12:08:26.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.438+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4419ca20 con 0x7fea44197880 2024-09-12T12:08:26.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.438+0000 7fea488d6640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fea30038e00 0x7fea3003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:26.440 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.439+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fea3804bd80 con 0x7fea44197880 2024-09-12T12:08:26.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.439+0000 7fea42ffd640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fea30038e00 0x7fea3003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:26.441 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.439+0000 7fea42ffd640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fea30038e00 0x7fea3003b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea340129e0 tx=0x7fea34032f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:26.444 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.444+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea3801f020 con 0x7fea44197880 2024-09-12T12:08:26.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.679+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fea44198700 con 0x7fea44197880 2024-09-12T12:08:26.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.680+0000 7fea488d6640 1 -- 172.21.15.173:0/4265174373 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fea38018310 con 0x7fea44197880 2024-09-12T12:08:26.680 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:08:26.680 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","modified":"2024-09-12T12:08:20.794154Z","created":"2024-09-12T12:06:59.805503Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:08:26.680 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.681+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fea30038e00 msgr2=0x7fea3003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.681+0000 7fea498d8640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fea30038e00 0x7fea3003b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea340129e0 tx=0x7fea34032f60 comp rx=0 tx=0).stop 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea44197880 msgr2=0x7fea4419bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea44197880 0x7fea4419bc10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea3800b3d0 tx=0x7fea3800b890 comp rx=0 tx=0).stop 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 shutdown_connections 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fea30038e00 0x7fea3003b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea44197880 0x7fea4419bc10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 --2- 172.21.15.173:0/4265174373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea2c003530 0x7fea44197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 >> 172.21.15.173:0/4265174373 conn(0x7fea440fc220 msgr2=0x7fea4406a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:26.682 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 shutdown_connections 2024-09-12T12:08:26.683 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:26.682+0000 7fea498d8640 1 -- 172.21.15.173:0/4265174373 wait complete. 2024-09-12T12:08:27.028 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:26 smithi173 ceph-mon[35326]: Deploying daemon mon.b on smithi103 2024-09-12T12:08:27.028 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:26 smithi173 ceph-mon[35326]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:27.028 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:26 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/4265174373' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:27.028 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:27.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:26 smithi081 ceph-mon[30948]: Deploying daemon mon.b on smithi103 2024-09-12T12:08:27.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:26 smithi081 ceph-mon[30948]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:27.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:26 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/4265174373' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:27.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:28.315 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:08:28.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:08:28.569 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 -- 172.21.15.173:0/2396193108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 msgr2=0x7f2530107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 --2- 172.21.15.173:0/2396193108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2520009880 tx=0x7f252002a5d0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 -- 172.21.15.173:0/2396193108 shutdown_connections 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 --2- 172.21.15.173:0/2396193108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 -- 172.21.15.173:0/2396193108 >> 172.21.15.173:0/2396193108 conn(0x7f25300fd320 msgr2=0x7f25300ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 -- 172.21.15.173:0/2396193108 shutdown_connections 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.995+0000 7f2536327640 1 -- 172.21.15.173:0/2396193108 wait complete. 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f2536327640 1 Processor -- start 2024-09-12T12:08:29.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f2536327640 1 -- start start 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f2536327640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f2536327640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f2536327640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f253010be60 con 0x7f2530107660 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f2536327640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f253010bce0 con 0x7f2530197a80 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f252f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f252f7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41788/0 (socket says 172.21.15.173:41788) 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f252f7fe640 1 -- 172.21.15.173:0/3985310534 learned_addr learned my addr 172.21.15.173:0/3985310534 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.996+0000 7f252ffff640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252f7fe640 1 -- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 msgr2=0x7f253019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T12:08:29.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252f7fe640 1 -- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 msgr2=0x7f253019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252f7fe640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252f7fe640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252ffff640 1 -- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 msgr2=0x7f253019be10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252ffff640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252ffff640 1 -- 172.21.15.173:0/3985310534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25301980a0 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252ffff640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530197540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2520000c00 tx=0x7f2520004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2520035030 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25200053d0 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253019c350 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f2520031890 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.997+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253019c890 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.998+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f2520042070 con 0x7f2530107660 2024-09-12T12:08:29.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.998+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2530102da0 con 0x7f2530107660 2024-09-12T12:08:29.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.998+0000 7f252d7fa640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2518038e00 0x7f251803b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:29.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.999+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f252006ce00 con 0x7f2530107660 2024-09-12T12:08:29.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.999+0000 7f252f7fe640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2518038e00 0x7f251803b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:29.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:28.999+0000 7f252f7fe640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2518038e00 0x7f251803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2524009100 tx=0x7f2524008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:29.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.003+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2520005580 con 0x7f2530107660 2024-09-12T12:08:29.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.230+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f253019cb40 con 0x7f2530107660 2024-09-12T12:08:29.231 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.231+0000 7f252d7fa640 1 -- 172.21.15.173:0/3985310534 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f25200309e0 con 0x7f2530107660 2024-09-12T12:08:29.231 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:08:29.232 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","modified":"2024-09-12T12:08:20.794154Z","created":"2024-09-12T12:06:59.805503Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T12:08:29.232 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-09-12T12:08:29.233 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2518038e00 msgr2=0x7f251803b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2518038e00 0x7f251803b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2524009100 tx=0x7f2524008040 comp rx=0 tx=0).stop 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 msgr2=0x7f2530197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530197540 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2520000c00 tx=0x7f2520004ef0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 shutdown_connections 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f2518038e00 0x7f251803b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2530197a80 0x7f253019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 --2- 172.21.15.173:0/3985310534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2530107660 0x7f2530197540 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 >> 172.21.15.173:0/3985310534 conn(0x7f25300fd320 msgr2=0x7f25300fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 shutdown_connections 2024-09-12T12:08:29.234 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:29.233+0000 7f2536327640 1 -- 172.21.15.173:0/3985310534 wait complete. 2024-09-12T12:08:29.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:29 smithi081 ceph-mon[30948]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:29 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/3985310534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:29 smithi173 ceph-mon[35326]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:29 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/3985310534' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:30.872 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T12:08:30.872 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T12:08:31.124 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:08:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:08:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: mon.a calling monitor election 2024-09-12T12:08:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: mon.c calling monitor election 2024-09-12T12:08:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: mon.b calling monitor election 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: monmap epoch 3 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:08:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: last_changed 2024-09-12T12:08:29.826564+0000 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: created 2024-09-12T12:06:59.805503+0000 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: min_mon_release 19 (squid) 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: election_strategy: 1 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: fsmap 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: mgrmap e13: x(active, since 46s) 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: overall HEALTH_OK 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 -- 172.21.15.173:0/3411703496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabac003530 msgr2=0x7fabac0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 --2- 172.21.15.173:0/3411703496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabac003530 0x7fabac0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fabc01016c0 tx=0x7fabb002c3f0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 -- 172.21.15.173:0/3411703496 shutdown_connections 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 --2- 172.21.15.173:0/3411703496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabac003530 0x7fabac0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 -- 172.21.15.173:0/3411703496 >> 172.21.15.173:0/3411703496 conn(0x7fabc00fc280 msgr2=0x7fabc00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 -- 172.21.15.173:0/3411703496 shutdown_connections 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.162+0000 7fabc7762640 1 -- 172.21.15.173:0/3411703496 wait complete. 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 Processor -- start 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 -- start start 2024-09-12T12:08:35.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 0x7fabc01962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc0196820 0x7fabc019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabc01087e0 con 0x7fabc0196820 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0108660 con 0x7fabac003530 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.163+0000 7fabc7762640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabc0108960 con 0x7fabc019b0f0 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57030/0 (socket says 172.21.15.173:57030) 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 -- 172.21.15.173:0/4284061138 learned_addr learned my addr 172.21.15.173:0/4284061138 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc54fe640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 0x7fabc01962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 msgr2=0x7fabc019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 msgr2=0x7fabc019b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:08:35.166 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc0196820 0x7fabc019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc5cff640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc54fe640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 msgr2=0x7fabc01962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc54fe640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 msgr2=0x7fabc01962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc54fe640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 0x7fabc01962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc54fe640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 0x7fabc01962e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 msgr2=0x7fabc019b5a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 msgr2=0x7fabc01962e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 0x7fabc01962e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 -- 172.21.15.173:0/4284061138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc01a2e60 con 0x7fabc0196820 2024-09-12T12:08:35.167 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabc4cfd640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc0196820 0x7fabc019abb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00b450 tx=0x7fabbc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:35.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc004230 con 0x7fabc0196820 2024-09-12T12:08:35.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fabbc0043d0 con 0x7fabc0196820 2024-09-12T12:08:35.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.164+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc003dc0 con 0x7fabc0196820 2024-09-12T12:08:35.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.165+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc01a3090 con 0x7fabc0196820 2024-09-12T12:08:35.168 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.165+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc01a3620 con 0x7fabc0196820 2024-09-12T12:08:35.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.165+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc0101cc0 con 0x7fabc0196820 2024-09-12T12:08:35.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.166+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fabbc00f050 con 0x7fabc0196820 2024-09-12T12:08:35.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.166+0000 7fabb67fc640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faba40394f0 0x7faba403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:35.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.166+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fabbc04be90 con 0x7fabc0196820 2024-09-12T12:08:35.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.166+0000 7fabc54fe640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faba40394f0 0x7faba403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:35.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.167+0000 7fabc54fe640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faba40394f0 0x7faba403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fabb0014cc0 tx=0x7fabb0005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:35.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.171+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fabbc00d040 con 0x7fabc0196820 2024-09-12T12:08:35.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: mon.a calling monitor election 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: mon.c calling monitor election 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: mon.b calling monitor election 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: monmap epoch 3 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: last_changed 2024-09-12T12:08:29.826564+0000 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: created 2024-09-12T12:06:59.805503+0000 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: min_mon_release 19 (squid) 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: election_strategy: 1 2024-09-12T12:08:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: 0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: fsmap 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: mgrmap e13: x(active, since 46s) 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: overall HEALTH_OK 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:35.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.418+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fabc018ffb0 con 0x7fabc0196820 2024-09-12T12:08:35.419 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.419+0000 7fabb67fc640 1 -- 172.21.15.173:0/4284061138 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7fabbc00f5a0 con 0x7fabc0196820 2024-09-12T12:08:35.420 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:08:35.420 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","modified":"2024-09-12T12:08:29.826564Z","created":"2024-09-12T12:06:59.805503Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-12T12:08:35.420 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 3 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faba40394f0 msgr2=0x7faba403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faba40394f0 0x7faba403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fabb0014cc0 tx=0x7fabb0005f60 comp rx=0 tx=0).stop 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc0196820 msgr2=0x7fabc019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc0196820 0x7fabc019abb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fabbc00b450 tx=0x7fabbc00b910 comp rx=0 tx=0).stop 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 shutdown_connections 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faba40394f0 0x7faba403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc019b0f0 0x7fabc019b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc0196820 0x7fabc019abb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 --2- 172.21.15.173:0/4284061138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabac003530 0x7fabc01962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 >> 172.21.15.173:0/4284061138 conn(0x7fabc00fc280 msgr2=0x7fabc00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 shutdown_connections 2024-09-12T12:08:35.422 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:35.421+0000 7fabc7762640 1 -- 172.21.15.173:0/4284061138 wait complete. 2024-09-12T12:08:36.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:35 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:36.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:35 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/4284061138' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:36.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:35 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:36.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:35 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:36.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:35 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/4284061138' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:36.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:35 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:36.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:35 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:36.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:35 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/4284061138' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T12:08:36.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:35 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:08:36.530 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T12:08:36.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T12:08:36.783 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:37.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.157 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.158 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:37.159 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:36 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 -- 172.21.15.81:0/351845421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01027b0 msgr2=0x7faac0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 --2- 172.21.15.81:0/351845421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01027b0 0x7faac0102b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faab0009810 tx=0x7faab002a540 comp rx=0 tx=0).stop 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 -- 172.21.15.81:0/351845421 shutdown_connections 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 --2- 172.21.15.81:0/351845421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac01027b0 0x7faac0102b90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 -- 172.21.15.81:0/351845421 >> 172.21.15.81:0/351845421 conn(0x7faac0077310 msgr2=0x7faac00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 -- 172.21.15.81:0/351845421 shutdown_connections 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.235+0000 7faac5165640 1 -- 172.21.15.81:0/351845421 wait complete. 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 Processor -- start 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 -- start start 2024-09-12T12:08:37.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faac01027b0 0x7faac01974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0197a30 0x7faac019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 0x7faac019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faac010bd80 con 0x7faac019c300 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faac010bc00 con 0x7faac0197a30 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faac5165640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faac010bf00 con 0x7faac01027b0 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 0x7faac019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 0x7faac019c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46904/0 (socket says 172.21.15.81:46904) 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 -- 172.21.15.81:0/1878367271 learned_addr learned my addr 172.21.15.81:0/1878367271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabed9d640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faac01027b0 0x7faac01974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faab7fff640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0197a30 0x7faac019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 -- 172.21.15.81:0/1878367271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faac01027b0 msgr2=0x7faac01974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faac01027b0 0x7faac01974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 -- 172.21.15.81:0/1878367271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0197a30 msgr2=0x7faac019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0197a30 0x7faac019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.236+0000 7faabf59e640 1 -- 172.21.15.81:0/1878367271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac01a4070 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faab7fff640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0197a30 0x7faac019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faabf59e640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 0x7faac019c7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faab800ba50 tx=0x7faab800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8019070 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faab800cbe0 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac01a42a0 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8007750 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.237+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac01a4760 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.238+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7faab801c070 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.238+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac0069f10 con 0x7faac019c300 2024-09-12T12:08:37.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.238+0000 7faabcd99640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faaac0394f0 0x7faaac03b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.238+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7faab804bac0 con 0x7faac019c300 2024-09-12T12:08:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.238+0000 7faabed9d640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faaac0394f0 0x7faaac03b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.239+0000 7faabed9d640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faaac0394f0 0x7faaac03b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faab0009660 tx=0x7faab0005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:37.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.243+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faab80112a0 con 0x7faac019c300 2024-09-12T12:08:37.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:37.406 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:36 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.417+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7faac01a4ab0 con 0x7faac019c300 2024-09-12T12:08:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.418+0000 7faabcd99640 1 -- 172.21.15.81:0/1878367271 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7faab800e090 con 0x7faac019c300 2024-09-12T12:08:37.418 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:08:37.418 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-12T12:08:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:08:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-09-12T12:08:37.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faaac0394f0 msgr2=0x7faaac03b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:37.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faaac0394f0 0x7faaac03b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faab0009660 tx=0x7faab0005d80 comp rx=0 tx=0).stop 2024-09-12T12:08:37.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 msgr2=0x7faac019c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 0x7faac019c7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faab800ba50 tx=0x7faab800bf10 comp rx=0 tx=0).stop 2024-09-12T12:08:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 shutdown_connections 2024-09-12T12:08:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7faaac0394f0 0x7faaac03b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac019c300 0x7faac019c7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faac0197a30 0x7faac019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 --2- 172.21.15.81:0/1878367271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faac01027b0 0x7faac01974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 >> 172.21.15.81:0/1878367271 conn(0x7faac0077310 msgr2=0x7faac0103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 shutdown_connections 2024-09-12T12:08:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:37.420+0000 7faac5165640 1 -- 172.21.15.81:0/1878367271 wait complete. 2024-09-12T12:08:37.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:37.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:36 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:38.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:38 smithi081 ceph-mon[30948]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:08:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:38 smithi081 ceph-mon[30948]: Reconfiguring daemon mon.a on smithi081 2024-09-12T12:08:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:38 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1878367271' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:38.370 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:38 smithi173 ceph-mon[35326]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:08:38.370 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:38 smithi173 ceph-mon[35326]: Reconfiguring daemon mon.a on smithi081 2024-09-12T12:08:38.370 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:38 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1878367271' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:38.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:38 smithi103 ceph-mon[35094]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T12:08:38.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:38 smithi103 ceph-mon[35094]: Reconfiguring daemon mon.a on smithi081 2024-09-12T12:08:38.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:38 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1878367271' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:38.991 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T12:08:38.991 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:08:38.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:08:39.018 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:08:39.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:39.082 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:08:39.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:08:39.110 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:08:39.110 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:39.175 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:08:39.175 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T12:08:39.207 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:08:39.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:08:39.276 INFO:tasks.cephadm:Adding mgr.x on smithi081 2024-09-12T12:08:39.277 INFO:tasks.cephadm:Adding mgr.y on smithi103 2024-09-12T12:08:39.277 INFO:tasks.cephadm:Adding mgr.z on smithi173 2024-09-12T12:08:39.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi081=x;smithi103=y;smithi173=z' 2024-09-12T12:08:39.560 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:39.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:40.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 -- 172.21.15.173:0/2119512197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6381005e0 msgr2=0x7fe6381009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:40.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/2119512197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6381005e0 0x7fe6381009e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe634009880 tx=0x7fe63402a5d0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 -- 172.21.15.173:0/2119512197 shutdown_connections 2024-09-12T12:08:40.000 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/2119512197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6381005e0 0x7fe6381009e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 -- 172.21.15.173:0/2119512197 >> 172.21.15.173:0/2119512197 conn(0x7fe6380fbdb0 msgr2=0x7fe6380fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:40.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 -- 172.21.15.173:0/2119512197 shutdown_connections 2024-09-12T12:08:40.001 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 -- 172.21.15.173:0/2119512197 wait complete. 2024-09-12T12:08:40.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 Processor -- start 2024-09-12T12:08:40.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.000+0000 7fe63ec4a640 1 -- start start 2024-09-12T12:08:40.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63ec4a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 0x7fe6380fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:40.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63ec4a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6380fc350 0x7fe6380fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:40.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63ec4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380fcd10 0x7fe6381a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:40.003 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63ec4a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe638106800 con 0x7fe6380fcd10 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63ec4a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe638106680 con 0x7fe6380fc350 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63ec4a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe638106980 con 0x7fe6381005e0 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 0x7fe6380fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 0x7fe6380fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57034/0 (socket says 172.21.15.173:57034) 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 -- 172.21.15.173:0/4293414880 learned_addr learned my addr 172.21.15.173:0/4293414880 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe62ffff640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6380fc350 0x7fe6380fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63d1e7640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380fcd10 0x7fe6381a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 -- 172.21.15.173:0/4293414880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6380fc350 msgr2=0x7fe6380fc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6380fc350 0x7fe6380fc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 -- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380fcd10 msgr2=0x7fe6381a1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:40.004 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380fcd10 0x7fe6381a1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 -- 172.21.15.173:0/4293414880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6381a16a0 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe62ffff640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6380fc350 0x7fe6380fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.001+0000 7fe63c9e6640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 0x7fe6380fdd00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe634005ab0 tx=0x7fe634004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.002+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63403f030 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.002+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6381a1930 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.002+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe634003dc0 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.002+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634035070 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.002+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6381a1ee0 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.003+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe634042030 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.003+0000 7fe62dffb640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe6200394f0 0x7fe62003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.003+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe638190910 con 0x7fe6381005e0 2024-09-12T12:08:40.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.003+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe63406db20 con 0x7fe6381005e0 2024-09-12T12:08:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.003+0000 7fe62ffff640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe6200394f0 0x7fe62003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:40.006 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.004+0000 7fe62ffff640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe6200394f0 0x7fe62003b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6380fda80 tx=0x7fe628009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:40.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.008+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe63404c350 con 0x7fe6381005e0 2024-09-12T12:08:40.194 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.194+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi103=y;smithi173=z", "target": ["mon-mgr", ""]}) -- 0x7fe6380626c0 con 0x7fe6200394f0 2024-09-12T12:08:40.200 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.200+0000 7fe62dffb640 1 -- 172.21.15.173:0/4293414880 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe6380626c0 con 0x7fe6200394f0 2024-09-12T12:08:40.200 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mgr update... 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe6200394f0 msgr2=0x7fe62003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe6200394f0 0x7fe62003b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6380fda80 tx=0x7fe628009190 comp rx=0 tx=0).stop 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 msgr2=0x7fe6380fdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 0x7fe6380fdd00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe634005ab0 tx=0x7fe634004430 comp rx=0 tx=0).stop 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 shutdown_connections 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe6200394f0 0x7fe62003b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6380fcd10 0x7fe6381a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.203 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6380fc350 0x7fe6380fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 --2- 172.21.15.173:0/4293414880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe6381005e0 0x7fe6380fdd00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:40.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 >> 172.21.15.173:0/4293414880 conn(0x7fe6380fbdb0 msgr2=0x7fe63806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:40.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 shutdown_connections 2024-09-12T12:08:40.204 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:08:40.203+0000 7fe63ec4a640 1 -- 172.21.15.173:0/4293414880 wait complete. 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: Reconfiguring daemon mon.b on smithi103 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:40.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:08:40.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: Reconfiguring daemon mon.b on smithi103 2024-09-12T12:08:40.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:40.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:40.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:40.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: Reconfiguring mon.b (monmap changed)... 2024-09-12T12:08:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: Reconfiguring daemon mon.b on smithi103 2024-09-12T12:08:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T12:08:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T12:08:40.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:40.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:40.761 DEBUG:teuthology.orchestra.run.smithi103:mgr.y> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T12:08:40.764 DEBUG:teuthology.orchestra.run.smithi173:mgr.z> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T12:08:40.766 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T12:08:40.766 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:08:40.766 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:08:40.786 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:08:40.786 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 12:07:59.605451289 +0000 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 12:03:32.266282776 +0000 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 12:03:32.266282776 +0000 2024-09-12T12:08:40.845 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 12:03:32.266282776 +0000 2024-09-12T12:08:40.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:08:40.912 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T12:08:40.912 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T12:08:40.912 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000237107 s, 2.2 MB/s 2024-09-12T12:08:40.913 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:08:40.972 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 12:07:59.630450799 +0000 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 12:03:32.592276289 +0000 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 12:03:32.592276289 +0000 2024-09-12T12:08:41.030 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 12:03:32.592276289 +0000 2024-09-12T12:08:41.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:08:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T12:08:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T12:08:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000213728 s, 2.4 MB/s 2024-09-12T12:08:41.096 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:08:41.154 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-12T12:08:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 12:07:59.656450290 +0000 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 12:03:32.930269564 +0000 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 12:03:32.930269564 +0000 2024-09-12T12:08:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 12:03:32.930269564 +0000 2024-09-12T12:08:41.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:08:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T12:08:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T12:08:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000252151 s, 2.0 MB/s 2024-09-12T12:08:41.276 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:08:41.333 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-12T12:08:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:08:41.389 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:41.389 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T12:08:41.389 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:41.389 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:41.390 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 12:07:59.681449800 +0000 2024-09-12T12:08:41.390 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 12:03:33.266262878 +0000 2024-09-12T12:08:41.390 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 12:03:33.266262878 +0000 2024-09-12T12:08:41.390 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 12:03:33.266262878 +0000 2024-09-12T12:08:41.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:08:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-12T12:08:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-12T12:08:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00024707 s, 2.1 MB/s 2024-09-12T12:08:41.454 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:08:41.510 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T12:08:41.510 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:08:41.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:08:41.528 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 12:08:29.270186652 +0000 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 12:03:47.057569516 +0000 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 12:03:47.057569516 +0000 2024-09-12T12:08:41.585 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-12 12:03:47.057569516 +0000 2024-09-12T12:08:41.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:08:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:41 smithi081 ceph-mon[30948]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:08:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:41 smithi081 ceph-mon[30948]: Reconfiguring daemon mon.c on smithi173 2024-09-12T12:08:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:41 smithi081 ceph-mon[30948]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi103=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:41 smithi081 ceph-mon[30948]: Saving service mgr spec with placement smithi081=x;smithi103=y;smithi173=z;count:3 2024-09-12T12:08:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:41 smithi081 ceph-mon[30948]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:41.647 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:41 smithi103 ceph-mon[35094]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:08:41.647 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:41 smithi103 ceph-mon[35094]: Reconfiguring daemon mon.c on smithi173 2024-09-12T12:08:41.647 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:41 smithi103 ceph-mon[35094]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi103=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:41.647 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:41 smithi103 ceph-mon[35094]: Saving service mgr spec with placement smithi081=x;smithi103=y;smithi173=z;count:3 2024-09-12T12:08:41.647 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:41 smithi103 ceph-mon[35094]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T12:08:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T12:08:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000342083 s, 1.5 MB/s 2024-09-12T12:08:41.651 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:08:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:41 smithi173 ceph-mon[35326]: Reconfiguring mon.c (monmap changed)... 2024-09-12T12:08:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:41 smithi173 ceph-mon[35326]: Reconfiguring daemon mon.c on smithi173 2024-09-12T12:08:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:41 smithi173 ceph-mon[35326]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi103=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:41 smithi173 ceph-mon[35326]: Saving service mgr spec with placement smithi081=x;smithi103=y;smithi173=z;count:3 2024-09-12T12:08:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:41 smithi173 ceph-mon[35326]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:41.708 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-12T12:08:41.764 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 12:08:29.270186652 +0000 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 12:03:47.397562939 +0000 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 12:03:47.397562939 +0000 2024-09-12T12:08:41.765 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-12 12:03:47.397562939 +0000 2024-09-12T12:08:41.765 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:08:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T12:08:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T12:08:41.829 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00023394 s, 2.2 MB/s 2024-09-12T12:08:41.830 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:08:41.887 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-12T12:08:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:08:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:41.942 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T12:08:41.943 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:41.943 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:41.943 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 12:08:29.271186633 +0000 2024-09-12T12:08:41.943 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 12:03:47.714556806 +0000 2024-09-12T12:08:41.943 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 12:03:47.714556806 +0000 2024-09-12T12:08:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-12 12:03:47.714556806 +0000 2024-09-12T12:08:41.943 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:08:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T12:08:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T12:08:42.006 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000220303 s, 2.3 MB/s 2024-09-12T12:08:42.007 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:08:42.063 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-12T12:08:42.118 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:08:42.118 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:42.118 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T12:08:42.119 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:42.119 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:42.119 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 12:08:29.271186633 +0000 2024-09-12T12:08:42.119 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 12:03:48.059550132 +0000 2024-09-12T12:08:42.119 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 12:03:48.059550132 +0000 2024-09-12T12:08:42.119 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-12 12:03:48.059550132 +0000 2024-09-12T12:08:42.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:08:42.181 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T12:08:42.181 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T12:08:42.181 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000197959 s, 2.6 MB/s 2024-09-12T12:08:42.182 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:08:42.238 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-09-12T12:08:42.238 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T12:08:42.254 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T12:08:42.255 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 12:08:19.913363021 +0000 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 12:03:46.028750561 +0000 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 12:03:46.028750561 +0000 2024-09-12T12:08:42.311 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 12:03:46.028750561 +0000 2024-09-12T12:08:42.312 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T12:08:42.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T12:08:42.375 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T12:08:42.376 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000191407 s, 2.7 MB/s 2024-09-12T12:08:42.377 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T12:08:42.435 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-09-12T12:08:42.492 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T12:08:42.492 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:42.492 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T12:08:42.492 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:42.492 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:42.492 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 12:08:19.914362999 +0000 2024-09-12T12:08:42.493 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 12:03:46.361743014 +0000 2024-09-12T12:08:42.493 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 12:03:46.361743014 +0000 2024-09-12T12:08:42.493 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 12:03:46.361743014 +0000 2024-09-12T12:08:42.493 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T12:08:42.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T12:08:42.556 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T12:08:42.556 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000180766 s, 2.8 MB/s 2024-09-12T12:08:42.557 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T12:08:42.613 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 12:08:19.914362999 +0000 2024-09-12T12:08:42.668 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 12:03:46.688735603 +0000 2024-09-12T12:08:42.669 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 12:03:46.688735603 +0000 2024-09-12T12:08:42.669 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 12:03:46.688735603 +0000 2024-09-12T12:08:42.669 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T12:08:42.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T12:08:42.731 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T12:08:42.731 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000197867 s, 2.6 MB/s 2024-09-12T12:08:42.733 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T12:08:42.789 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-09-12 12:08:19.915362977 +0000 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-09-12 12:03:47.028727898 +0000 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-09-12 12:03:47.028727898 +0000 2024-09-12T12:08:42.844 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-09-12 12:03:47.028727898 +0000 2024-09-12T12:08:42.845 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T12:08:42.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-09-12T12:08:42.907 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-09-12T12:08:42.907 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000204329 s, 2.5 MB/s 2024-09-12T12:08:42.909 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T12:08:42.967 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-09-12T12:08:42.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:08:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:43.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:43.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: Deploying daemon mgr.z on smithi173 2024-09-12T12:08:43.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:42 smithi081 ceph-mon[30948]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:43.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: Deploying daemon mgr.z on smithi173 2024-09-12T12:08:43.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:42 smithi173 ceph-mon[35326]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:43.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:43.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: Deploying daemon mgr.z on smithi173 2024-09-12T12:08:43.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:42 smithi103 ceph-mon[35094]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:43.219 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:43.862 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:43 smithi173 systemd[1]: Starting Ceph mgr.z for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:08:44.154 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:43 smithi173 podman[37111]: 2024-09-12 12:08:43.764503543 +0000 UTC m=+0.015474372 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:08:44.154 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:43 smithi173 podman[37111]: 2024-09-12 12:08:43.888830528 +0000 UTC m=+0.139801344 container create 5738d836e6b9e02ad5e47601ec290f1a239da559a71c335a53e45c37bfc0c4d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T12:08:44.154 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 podman[37111]: 2024-09-12 12:08:44.082827612 +0000 UTC m=+0.333798428 container init 5738d836e6b9e02ad5e47601ec290f1a239da559a71c335a53e45c37bfc0c4d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-12T12:08:44.154 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 podman[37111]: 2024-09-12 12:08:44.085770138 +0000 UTC m=+0.336740969 container start 5738d836e6b9e02ad5e47601ec290f1a239da559a71c335a53e45c37bfc0c4d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:08:44.154 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-mgr[37130]: -- 172.21.15.173:0/3634710406 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587cbb4f0e0 con 0x5587cbb2c800 2024-09-12T12:08:44.414 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 bash[37111]: 5738d836e6b9e02ad5e47601ec290f1a239da559a71c335a53e45c37bfc0c4d2 2024-09-12T12:08:44.414 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 systemd[1]: Started Ceph mgr.z for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:08:44.415 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:44.208+0000 7f3f6713c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:08:44.415 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:44.267+0000 7f3f6713c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:08:44.415 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:44.414+0000 7f3f6713c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:08:44.761 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:44.479+0000 7f3f6713c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:08:44.761 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:44.623+0000 7f3f6713c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:08:44.761 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:44.760+0000 7f3f6713c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:45.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: Deploying daemon mgr.y on smithi103 2024-09-12T12:08:45.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:45 smithi081 ceph-mon[30948]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:45.403 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:45.072+0000 7f3f6713c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:08:45.403 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:45.132+0000 7f3f6713c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:45.315+0000 7f3f6713c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:45.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: Deploying daemon mgr.y on smithi103 2024-09-12T12:08:45.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:45 smithi173 ceph-mon[35326]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:45.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:45.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:45.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T12:08:45.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:45.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:45.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: Deploying daemon mgr.y on smithi103 2024-09-12T12:08:45.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:45 smithi103 ceph-mon[35094]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:08:45.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-09-12T12:08:45.900 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:08:46.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 systemd[1]: Starting Ceph mgr.y for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:08:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 -- 172.21.15.81:0/684902455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 msgr2=0x7f16a4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 --2- 172.21.15.81:0/684902455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 0x7f16a4102210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f168c009900 tx=0x7f168c02a410 comp rx=0 tx=0).stop 2024-09-12T12:08:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 -- 172.21.15.81:0/684902455 shutdown_connections 2024-09-12T12:08:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 --2- 172.21.15.81:0/684902455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a4108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 --2- 172.21.15.81:0/684902455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 0x7f16a4102210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 --2- 172.21.15.81:0/684902455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a4101070 0x7f16a4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 -- 172.21.15.81:0/684902455 >> 172.21.15.81:0/684902455 conn(0x7f16a40fba80 msgr2=0x7f16a40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 -- 172.21.15.81:0/684902455 shutdown_connections 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 -- 172.21.15.81:0/684902455 wait complete. 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 Processor -- start 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.312+0000 7f16aadfa640 1 -- start start 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16aadfa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a4101070 0x7f16a4197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16aadfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 0x7f16a4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16aadfa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16aadfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410c8a0 con 0x7f16a4101d90 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16aadfa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410c720 con 0x7f16a4102750 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16aadfa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ca20 con 0x7f16a4101070 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 0x7f16a4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:44534/0 (socket says 172.21.15.81:44534) 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a8b96640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a4101070 0x7f16a4197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 -- 172.21.15.81:0/3540797487 learned_addr learned my addr 172.21.15.81:0/3540797487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 -- 172.21.15.81:0/3540797487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a4101070 msgr2=0x7f16a4197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a4101070 0x7f16a4197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 -- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 msgr2=0x7f16a4198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:08:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 0x7f16a4198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 -- 172.21.15.81:0/3540797487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a419fbf0 con 0x7f16a4102750 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a9397640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a419f580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f169c00d750 tx=0x7f169c00dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.313+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c017070 con 0x7f16a4102750 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.314+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f169c005520 con 0x7f16a4102750 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.314+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a419fee0 con 0x7f16a4102750 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.314+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c004e00 con 0x7f16a4102750 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.314+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a41a0340 con 0x7f16a4102750 2024-09-12T12:08:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.314+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f169c010460 con 0x7f16a4102750 2024-09-12T12:08:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.315+0000 7f16a1ffb640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f16900392c0 0x7f169003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:08:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.315+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f169c04bdf0 con 0x7f16a4102750 2024-09-12T12:08:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.315+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a41a0570 con 0x7f16a4102750 2024-09-12T12:08:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.315+0000 7f16a8b96640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f16900392c0 0x7f169003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:08:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.315+0000 7f16a8b96640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f16900392c0 0x7f169003b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16a4069ae0 tx=0x7f1694009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:08:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.320+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f169c01a360 con 0x7f16a4102750 2024-09-12T12:08:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:46.497+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f16a40fdc60 con 0x7f16900392c0 2024-09-12T12:08:46.536 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 podman[36443]: 2024-09-12 12:08:46.165490286 +0000 UTC m=+0.015845829 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:08:46.536 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 podman[36443]: 2024-09-12 12:08:46.290325829 +0000 UTC m=+0.140681354 container create 6b5607096053cb1219b6980b0caf088f4ed7a3b1059aa096e285eb07cc9cb033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T12:08:46.536 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 podman[36443]: 2024-09-12 12:08:46.509245526 +0000 UTC m=+0.359601051 container init 6b5607096053cb1219b6980b0caf088f4ed7a3b1059aa096e285eb07cc9cb033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:08:46.537 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 podman[36443]: 2024-09-12 12:08:46.512070418 +0000 UTC m=+0.362425950 container start 6b5607096053cb1219b6980b0caf088f4ed7a3b1059aa096e285eb07cc9cb033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:08:46.537 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 ceph-mgr[36462]: -- 172.21.15.103:0/2835623240 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a660a110e0 con 0x55a6609ee800 2024-09-12T12:08:46.653 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:46 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:46.185+0000 7f3f6713c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:08:46.653 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:46 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:46.252+0000 7f3f6713c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:08:46.864 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 bash[36443]: 6b5607096053cb1219b6980b0caf088f4ed7a3b1059aa096e285eb07cc9cb033 2024-09-12T12:08:46.865 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 systemd[1]: Started Ceph mgr.y for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:08:46.865 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:46.645+0000 7f1a19443040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:08:46.865 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:46.707+0000 7f1a19443040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:08:46.865 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:46.863+0000 7f1a19443040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:08:47.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:46.931+0000 7f1a19443040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:08:47.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:47.091+0000 7f1a19443040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:08:47.264 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:46 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:46.978+0000 7f3f6713c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:08:47.264 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.108+0000 7f3f6713c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:08:47.265 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.264+0000 7f3f6713c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:08:47.513 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:47.247+0000 7f1a19443040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:08:47.513 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:47.513 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:08:47.513 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:08:47.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:47.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:47.553 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.325+0000 7f3f6713c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.484+0000 7f3f6713c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.553+0000 7f3f6713c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:47.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:47 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:47.822 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:47.570+0000 7f1a19443040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:08:47.822 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:47.633+0000 7f1a19443040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:08:47.848 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.616+0000 7f3f6713c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:08:47.848 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.776+0000 7f3f6713c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:08:47.848 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.848+0000 7f3f6713c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:08:48.119 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:47.915+0000 7f3f6713c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:08:48.119 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:48.000+0000 7f3f6713c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:08:48.119 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:48.060+0000 7f3f6713c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:08:48.119 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:48.119+0000 7f3f6713c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:08:48.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:47.821+0000 7f1a19443040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:08:48.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:48.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.486 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:48.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:48.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:49.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:48.705+0000 7f1a19443040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:08:49.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:48 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:48.771+0000 7f1a19443040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:08:49.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:08:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:08:48.906+0000 7f3f6713c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:08:49.596 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:49.483+0000 7f1a19443040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:49.596+0000 7f1a19443040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: Reconfiguring daemon mgr.x on smithi081 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/299663797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eec0ad60-853a-44dc-9453-3ec54f1ca452"}]: dispatch 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/299663797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eec0ad60-853a-44dc-9453-3ec54f1ca452"}]': finished 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: Standby manager daemon z started 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:08:49.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:08:49.598 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:08:49.598 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:08:49.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:08:49.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: Reconfiguring daemon mgr.x on smithi081 2024-09-12T12:08:49.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/299663797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eec0ad60-853a-44dc-9453-3ec54f1ca452"}]: dispatch 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/299663797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eec0ad60-853a-44dc-9453-3ec54f1ca452"}]': finished 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: Standby manager daemon z started 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:08:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:49 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:08:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: Reconfiguring daemon mgr.x on smithi081 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/299663797' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eec0ad60-853a-44dc-9453-3ec54f1ca452"}]: dispatch 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/299663797' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eec0ad60-853a-44dc-9453-3ec54f1ca452"}]': finished 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: Standby manager daemon z started 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:08:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:49 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/2838081922' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:08:49.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:49.735+0000 7f1a19443040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:08:49.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:49.795+0000 7f1a19443040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:08:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:49.938+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f169c00f3c0 con 0x7f16a4102750 2024-09-12T12:08:50.223 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:49.942+0000 7f1a19443040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:08:50.224 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.009+0000 7f1a19443040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:08:50.224 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.068+0000 7f1a19443040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:08:50.224 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.223+0000 7f1a19443040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:08:50.493 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/616864635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:08:50.493 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-mon[35094]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T12:08:50.493 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:08:50.493 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.287+0000 7f1a19443040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:08:50.493 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.352+0000 7f1a19443040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:08:50.493 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.433+0000 7f1a19443040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:08:50.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:50 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/616864635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:08:50.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:50 smithi081 ceph-mon[30948]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T12:08:50.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:08:50.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:50 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/616864635' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:08:50.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:50 smithi173 ceph-mon[35326]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-12T12:08:50.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:08:50.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.492+0000 7f1a19443040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:08:50.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:50.550+0000 7f1a19443040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:08:51.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:51 smithi081 ceph-mon[30948]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:51.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:51 smithi081 ceph-mon[30948]: Standby manager daemon y started 2024-09-12T12:08:51.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:51 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:08:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:51 smithi173 ceph-mon[35326]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:51 smithi173 ceph-mon[35326]: Standby manager daemon y started 2024-09-12T12:08:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:51 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:08:51.685 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:08:51 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:08:51.325+0000 7f1a19443040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:08:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:51 smithi103 ceph-mon[35094]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:51 smithi103 ceph-mon[35094]: Standby manager daemon y started 2024-09-12T12:08:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:51 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:08:51.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:08:51.943+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mon.2 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f169c010750 con 0x7f16a4102750 2024-09-12T12:08:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:52 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:08:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:52 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:08:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:52 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:08:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:52 smithi081 ceph-mon[30948]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T12:08:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:08:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:52 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:08:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:52 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:08:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:52 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:08:52.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:52 smithi173 ceph-mon[35326]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T12:08:52.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:08:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:52 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:08:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:52 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:08:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:52 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/1705615013' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:08:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:52 smithi103 ceph-mon[35094]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-12T12:08:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:08:53.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:53 smithi081 ceph-mon[30948]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:53 smithi173 ceph-mon[35326]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:53 smithi103 ceph-mon[35094]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:55.593 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:55 smithi081 ceph-mon[30948]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:55 smithi173 ceph-mon[35326]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:55 smithi103 ceph-mon[35094]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:57.182 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.182 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.182 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:57.182 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:57.182 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:57.182 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:57.183 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:57.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:57.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:57.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:57.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:08:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:08:57.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:08:58.574 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:08:58.574 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:08:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:58.660 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T12:08:58.660 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:08:59.578 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:59 smithi081 ceph-mon[30948]: Deploying daemon osd.0 on smithi081 2024-09-12T12:08:59.578 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:08:59 smithi081 ceph-mon[30948]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:59.628 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:59 smithi173 ceph-mon[35326]: Deploying daemon osd.0 on smithi081 2024-09-12T12:08:59.629 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:08:59 smithi173 ceph-mon[35326]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:08:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:59 smithi103 ceph-mon[35094]: Deploying daemon osd.0 on smithi081 2024-09-12T12:08:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:08:59 smithi103 ceph-mon[35094]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:01.459 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:01 smithi081 ceph-mon[30948]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:01 smithi173 ceph-mon[35326]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:01 smithi103 ceph-mon[35094]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:03.546 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:03 smithi081 ceph-mon[30948]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:03 smithi173 ceph-mon[35326]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:03 smithi103 ceph-mon[35094]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:04.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:04.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:04.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:04.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:04.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:04.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:05.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:05 smithi081 ceph-mon[30948]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:05 smithi173 ceph-mon[35326]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:05 smithi103 ceph-mon[35094]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:06 smithi081 ceph-mon[30948]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:07.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:07.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:07.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:06 smithi173 ceph-mon[35326]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:07.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:07.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:06 smithi103 ceph-mon[35094]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.347+0000 7f16a1ffb640 1 -- 172.21.15.81:0/3540797487 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f16a40fdc60 con 0x7f16900392c0 2024-09-12T12:09:08.347 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f16900392c0 msgr2=0x7f169003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f16900392c0 0x7f169003b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f16a4069ae0 tx=0x7f1694009670 comp rx=0 tx=0).stop 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 msgr2=0x7f16a419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a419f580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f169c00d750 tx=0x7f169c00dc10 comp rx=0 tx=0).stop 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 shutdown_connections 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f16900392c0 0x7f169003b780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:08.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16a4102750 0x7f16a419f580 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a4101d90 0x7f16a4198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 --2- 172.21.15.81:0/3540797487 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f16a4101070 0x7f16a4197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 >> 172.21.15.81:0/3540797487 conn(0x7f16a40fba80 msgr2=0x7f16a40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:09:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 shutdown_connections 2024-09-12T12:09:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:09:08.349+0000 7f16aadfa640 1 -- 172.21.15.81:0/3540797487 wait complete. 2024-09-12T12:09:08.971 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T12:09:08.973 INFO:tasks.cephadm:Deploying osd.1 on smithi103 with /dev/vg_nvme/lv_4... 2024-09-12T12:09:08.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:09:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:09:09.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:09 smithi173 ceph-mon[35326]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:09.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:09.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:09.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:09.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:09 smithi081 ceph-mon[30948]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:09.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:09.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:09.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:09.631 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:09 smithi103 ceph-mon[35094]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:09.631 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:09.631 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:09.631 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:10.610 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:09:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0[44399]: 2024-09-12T12:09:10.409+0000 7f79f59ef640 -1 osd.0 0 log_to_monitors true 2024-09-12T12:09:11.549 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:11 smithi103 ceph-mon[35094]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:11.549 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:11 smithi103 ceph-mon[35094]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:09:11.552 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:09:11.589 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-09-12T12:09:11.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:11 smithi081 ceph-mon[30948]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:11.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:11 smithi081 ceph-mon[30948]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:09:11.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:11 smithi173 ceph-mon[35326]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:11.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:11 smithi173 ceph-mon[35326]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T12:09:11.845 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 -- 172.21.15.103:0/508550853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 msgr2=0x7fd514102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 --2- 172.21.15.103:0/508550853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 0x7fd514102150 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd504009860 tx=0x7fd50402a340 comp rx=0 tx=0).stop 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 -- 172.21.15.103:0/508550853 shutdown_connections 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 --2- 172.21.15.103:0/508550853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd514102690 0x7fd514108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 --2- 172.21.15.103:0/508550853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 0x7fd514102150 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 --2- 172.21.15.103:0/508550853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 -- 172.21.15.103:0/508550853 >> 172.21.15.103:0/508550853 conn(0x7fd5140fc280 msgr2=0x7fd5140fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:09:12.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 -- 172.21.15.103:0/508550853 shutdown_connections 2024-09-12T12:09:12.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.279+0000 7fd51b86e640 1 -- 172.21.15.103:0/508550853 wait complete. 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 Processor -- start 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 -- start start 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 0x7fd514198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd514102690 0x7fd51419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd51410c890 con 0x7fd514101cd0 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd51410c710 con 0x7fd514100ad0 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51b86e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd51410ca10 con 0x7fd514102690 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47304/0 (socket says 172.21.15.103:47304) 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 -- 172.21.15.103:0/3912640986 learned_addr learned my addr 172.21.15.103:0/3912640986 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-12T12:09:12.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd518e09640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 0x7fd514198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd519e0b640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd514102690 0x7fd51419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 -- 172.21.15.103:0/3912640986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd514102690 msgr2=0x7fd51419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd514102690 0x7fd51419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 -- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 msgr2=0x7fd514198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 0x7fd514198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.280+0000 7fd51960a640 1 -- 172.21.15.103:0/3912640986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51419fbf0 con 0x7fd514100ad0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.281+0000 7fd51960a640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514197fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e9f0 tx=0x7fd51000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.281+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51000ccc0 con 0x7fd514100ad0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.281+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd5100035f0 con 0x7fd514100ad0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.281+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51419fee0 con 0x7fd514100ad0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.281+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51000ce60 con 0x7fd514100ad0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.281+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5141a0340 con 0x7fd514100ad0 2024-09-12T12:09:12.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.282+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5141a05d0 con 0x7fd514100ad0 2024-09-12T12:09:12.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.283+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fd5100037a0 con 0x7fd514100ad0 2024-09-12T12:09:12.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.284+0000 7fd50a7fc640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd5000a2ba0 0x7fd5000a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:12.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.284+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7fd5100cd690 con 0x7fd514100ad0 2024-09-12T12:09:12.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.284+0000 7fd518e09640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd5000a2ba0 0x7fd5000a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:12.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.285+0000 7fd518e09640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd5000a2ba0 0x7fd5000a5060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd504000c00 tx=0x7fd5040305e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:09:12.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.288+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd51009c190 con 0x7fd514100ad0 2024-09-12T12:09:12.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:12.470+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd5141a07a0 con 0x7fd5000a2ba0 2024-09-12T12:09:12.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:09:12.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:09:12.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:09:12.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:12.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:09:12.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:12.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:12.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:09:12.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:12.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T12:09:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T12:09:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:09:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:13.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi081 2024-09-12T12:09:13.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:13.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:13 smithi103 ceph-mon[35094]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' 2024-09-12T12:09:13.609 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0[44399]: 2024-09-12T12:09:13.193+0000 7f79f114f640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T12:09:13.610 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0[44399]: 2024-09-12T12:09:13.198+0000 7f79e9781640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi081 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:09:13.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:09:13.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:13.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:13 smithi081 ceph-mon[30948]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi081 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi081 to 17088M 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:13.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:13 smithi173 ceph-mon[35326]: from='osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778]' entity='osd.0' 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] boot 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:09:14.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:14.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:09:14.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:09:14.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:09:14.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:14.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] boot 2024-09-12T12:09:14.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:09:14.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:14.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:09:14.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:09:14.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:09:14.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:14.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: osd.0 [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] boot 2024-09-12T12:09:14.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T12:09:14.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/3546218405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]: dispatch 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]: dispatch 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]': finished 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: osdmap e9: 2 total, 1 up, 2 in 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:15 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/4049876580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:09:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:15.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/3546218405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]: dispatch 2024-09-12T12:09:15.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]: dispatch 2024-09-12T12:09:15.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]': finished 2024-09-12T12:09:15.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: osdmap e9: 2 total, 1 up, 2 in 2024-09-12T12:09:15.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:15.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:15 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/4049876580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:09:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T12:09:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/3546218405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]: dispatch 2024-09-12T12:09:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]: dispatch 2024-09-12T12:09:15.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c632ebfd-7044-4070-839b-9abc5275937e"}]': finished 2024-09-12T12:09:15.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: osdmap e9: 2 total, 1 up, 2 in 2024-09-12T12:09:15.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:15.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:15 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/4049876580' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:09:17.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:17 smithi081 ceph-mon[30948]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:17 smithi173 ceph-mon[35326]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:17 smithi103 ceph-mon[35094]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:19.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:19 smithi081 ceph-mon[30948]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:19.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:19 smithi173 ceph-mon[35326]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:19 smithi103 ceph-mon[35094]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:21.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:21 smithi103 ceph-mon[35094]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:21.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:21 smithi081 ceph-mon[30948]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:21.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:21 smithi173 ceph-mon[35326]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:23.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:23 smithi081 ceph-mon[30948]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:23.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:09:23.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:23 smithi173 ceph-mon[35326]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:09:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:23 smithi103 ceph-mon[35094]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:23.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T12:09:23.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:24.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:24 smithi081 ceph-mon[30948]: Deploying daemon osd.1 on smithi103 2024-09-12T12:09:24.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:24 smithi173 ceph-mon[35326]: Deploying daemon osd.1 on smithi103 2024-09-12T12:09:24.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:24 smithi103 ceph-mon[35094]: Deploying daemon osd.1 on smithi103 2024-09-12T12:09:25.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:25 smithi081 ceph-mon[30948]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:25 smithi173 ceph-mon[35326]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:25 smithi103 ceph-mon[35094]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:27 smithi173 ceph-mon[35326]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:27.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:27 smithi103 ceph-mon[35094]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:27.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:27 smithi081 ceph-mon[30948]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:29.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:29 smithi103 ceph-mon[35094]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:29 smithi173 ceph-mon[35326]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:29.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:29 smithi081 ceph-mon[30948]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:30.469 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:30.470 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:30.470 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:30.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:31.467 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:31 smithi103 ceph-mon[35094]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:31 smithi173 ceph-mon[35326]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:31.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:31 smithi081 ceph-mon[30948]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:33.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:33.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:33.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:33 smithi081 ceph-mon[30948]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:33.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:33.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:33.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:33 smithi173 ceph-mon[35326]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:33.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:33.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:33.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:33.437 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:33 smithi103 ceph-mon[35094]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:34.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.046+0000 7fd50a7fc640 1 -- 172.21.15.103:0/3912640986 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd5141a07a0 con 0x7fd5000a2ba0 2024-09-12T12:09:34.047 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 1 on host 'smithi103' 2024-09-12T12:09:34.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd5000a2ba0 msgr2=0x7fd5000a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:34.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd5000a2ba0 0x7fd5000a5060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd504000c00 tx=0x7fd5040305e0 comp rx=0 tx=0).stop 2024-09-12T12:09:34.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 msgr2=0x7fd514197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:34.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514197fc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e9f0 tx=0x7fd51000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:09:34.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 shutdown_connections 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd5000a2ba0 0x7fd5000a5060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd514102690 0x7fd51419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd514101cd0 0x7fd514198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 --2- 172.21.15.103:0/3912640986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd514100ad0 0x7fd514197fc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.048+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 >> 172.21.15.103:0/3912640986 conn(0x7fd5140fc280 msgr2=0x7fd514069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.049+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 shutdown_connections 2024-09-12T12:09:34.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:09:34.049+0000 7fd51b86e640 1 -- 172.21.15.103:0/3912640986 wait complete. 2024-09-12T12:09:34.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:34.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:34.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:34.386 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:34.386 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:34.386 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:34.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:34.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:34.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:34.675 DEBUG:teuthology.orchestra.run.smithi103:osd.1> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T12:09:34.679 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_4... 2024-09-12T12:09:34.679 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T12:09:34.935 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:09:35.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:35 smithi173 ceph-mon[35326]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:35.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:35 smithi081 ceph-mon[30948]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:35.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:35 smithi103 ceph-mon[35094]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:36.053 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:09:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1[39585]: 2024-09-12T12:09:36.045+0000 7fd389677640 -1 osd.1 0 log_to_monitors true 2024-09-12T12:09:36.192 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:36 smithi173 ceph-mon[35326]: from='osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:09:36.192 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:36 smithi173 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:09:36.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:36 smithi081 ceph-mon[30948]: from='osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:09:36.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:36 smithi081 ceph-mon[30948]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:09:36.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:36 smithi103 ceph-mon[35094]: from='osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:09:36.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:36 smithi103 ceph-mon[35094]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T12:09:37.192 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:09:37.217 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-09-12T12:09:37.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: from='osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:09:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:09:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: from='osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:09:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:09:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:09:37.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:09:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:09:37.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:37.425 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: from='osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T12:09:37.426 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:37.477 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:09:37.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 -- 172.21.15.173:0/1496402240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 msgr2=0x7fce48101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/1496402240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48101ff0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce44009900 tx=0x7fce4402a410 comp rx=0 tx=0).stop 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 -- 172.21.15.173:0/1496402240 shutdown_connections 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/1496402240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 0x7fce4810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/1496402240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce48102df0 0x7fce48103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/1496402240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48101ff0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 -- 172.21.15.173:0/1496402240 >> 172.21.15.173:0/1496402240 conn(0x7fce480fd3c0 msgr2=0x7fce480ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 -- 172.21.15.173:0/1496402240 shutdown_connections 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 -- 172.21.15.173:0/1496402240 wait complete. 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.910+0000 7fce4f7f8640 1 Processor -- start 2024-09-12T12:09:37.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 -- start start 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce48102df0 0x7fce480745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 0x7fce48074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce4810d9b0 con 0x7fce481037b0 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fce4810d830 con 0x7fce48102df0 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4f7f8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fce4810db30 con 0x7fce48101bf0 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:52746/0 (socket says 172.21.15.173:52746) 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 -- 172.21.15.173:0/761260643 learned_addr learned my addr 172.21.15.173:0/761260643 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4cd93640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce48102df0 0x7fce480745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:37.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4dd95640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 0x7fce48074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 -- 172.21.15.173:0/761260643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce48102df0 msgr2=0x7fce480745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce48102df0 0x7fce480745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 -- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 msgr2=0x7fce48074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 0x7fce48074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 -- 172.21.15.173:0/761260643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce480753e0 con 0x7fce48101bf0 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4dd95640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 0x7fce48074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce4d594640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48075f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fce44005ab0 tx=0x7fce440042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.911+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4403f030 con 0x7fce48101bf0 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.912+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce44003d00 con 0x7fce48101bf0 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.912+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44035070 con 0x7fce48101bf0 2024-09-12T12:09:37.928 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.912+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce481a20b0 con 0x7fce48101bf0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.912+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce481a25b0 con 0x7fce48101bf0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.913+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce48108ff0 con 0x7fce48101bf0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.914+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fce44042030 con 0x7fce48101bf0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.914+0000 7fce3e7fc640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fce340a2b70 0x7fce340a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.915+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7fce440edcc0 con 0x7fce48101bf0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.915+0000 7fce4cd93640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fce340a2b70 0x7fce340a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.915+0000 7fce4cd93640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fce340a2b70 0x7fce340a5030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fce48075d10 tx=0x7fce3800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:09:37.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:37.922+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce440bc590 con 0x7fce48101bf0 2024-09-12T12:09:38.100 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:38.099+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fce48062630 con 0x7fce340a2b70 2024-09-12T12:09:38.185 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1[39585]: 2024-09-12T12:09:37.869+0000 7fd385e0e640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T12:09:38.185 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:09:37 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1[39585]: 2024-09-12T12:09:37.875+0000 7fd37d409640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='osd.1 ' entity='osd.1' 2024-09-12T12:09:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='osd.1 ' entity='osd.1' 2024-09-12T12:09:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:38.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:38.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='osd.1 ' entity='osd.1' 2024-09-12T12:09:38.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:09:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:09:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi103 2024-09-12T12:09:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi103 to 17088M 2024-09-12T12:09:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:09:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:09:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:09:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:39.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] boot 2024-09-12T12:09:39.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: osdmap e12: 2 total, 2 up, 2 in 2024-09-12T12:09:39.362 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:39.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi103 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi103 to 17088M 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] boot 2024-09-12T12:09:39.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: osdmap e12: 2 total, 2 up, 2 in 2024-09-12T12:09:39.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:39.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:09:39.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:09:39.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi103 2024-09-12T12:09:39.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi103 to 17088M 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: osd.1 [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] boot 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: osdmap e12: 2 total, 2 up, 2 in 2024-09-12T12:09:39.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:09:41.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: pgmap v59: 0 pgs: ; 0 B data, 462 MiB used, 178 GiB / 179 GiB avail 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/3797391694' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]: dispatch 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]: dispatch 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]': finished 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:09:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:41 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/1536113789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: pgmap v59: 0 pgs: ; 0 B data, 462 MiB used, 178 GiB / 179 GiB avail 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/3797391694' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]: dispatch 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]: dispatch 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]': finished 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:09:41.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:41 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/1536113789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:09:41.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T12:09:41.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: pgmap v59: 0 pgs: ; 0 B data, 462 MiB used, 178 GiB / 179 GiB avail 2024-09-12T12:09:41.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/3797391694' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]: dispatch 2024-09-12T12:09:41.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]: dispatch 2024-09-12T12:09:41.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4133af2-0de8-4d7c-a428-c04eee0d9b54"}]': finished 2024-09-12T12:09:41.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: osdmap e14: 3 total, 2 up, 3 in 2024-09-12T12:09:41.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:09:41.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:41 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/1536113789' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:09:43.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:43 smithi081 ceph-mon[30948]: pgmap v61: 0 pgs: ; 0 B data, 462 MiB used, 178 GiB / 179 GiB avail 2024-09-12T12:09:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:43 smithi173 ceph-mon[35326]: pgmap v61: 0 pgs: ; 0 B data, 462 MiB used, 178 GiB / 179 GiB avail 2024-09-12T12:09:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:43 smithi103 ceph-mon[35094]: pgmap v61: 0 pgs: ; 0 B data, 462 MiB used, 178 GiB / 179 GiB avail 2024-09-12T12:09:45.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:45 smithi173 ceph-mon[35326]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:45.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:45 smithi081 ceph-mon[30948]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:45.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:45 smithi103 ceph-mon[35094]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:47.381 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:47 smithi173 ceph-mon[35326]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:47.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:47 smithi081 ceph-mon[30948]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:47 smithi103 ceph-mon[35094]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:49 smithi081 ceph-mon[30948]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:09:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:49 smithi173 ceph-mon[35326]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:09:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:49 smithi103 ceph-mon[35094]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T12:09:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:50.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:50 smithi173 ceph-mon[35326]: Deploying daemon osd.2 on smithi173 2024-09-12T12:09:50.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:50 smithi081 ceph-mon[30948]: Deploying daemon osd.2 on smithi173 2024-09-12T12:09:50.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:50 smithi103 ceph-mon[35094]: Deploying daemon osd.2 on smithi173 2024-09-12T12:09:51.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:51 smithi081 ceph-mon[30948]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:51 smithi173 ceph-mon[35326]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:51 smithi103 ceph-mon[35094]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:53.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:53 smithi081 ceph-mon[30948]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:53 smithi173 ceph-mon[35326]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:53 smithi103 ceph-mon[35094]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:55.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:55 smithi081 ceph-mon[30948]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:55.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:55.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:55.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:55 smithi173 ceph-mon[35326]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:55 smithi103 ceph-mon[35094]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:57 smithi081 ceph-mon[30948]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:57 smithi173 ceph-mon[35326]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:57 smithi103 ceph-mon[35094]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:09:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:09:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:58.836 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2024-09-12T12:09:58.836 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.835+0000 7fce3e7fc640 1 -- 172.21.15.173:0/761260643 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fce48062630 con 0x7fce340a2b70 2024-09-12T12:09:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.837+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fce340a2b70 msgr2=0x7fce340a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.837+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fce340a2b70 0x7fce340a5030 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fce48075d10 tx=0x7fce3800a2d0 comp rx=0 tx=0).stop 2024-09-12T12:09:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.837+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 msgr2=0x7fce48075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:09:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.837+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48075f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fce44005ab0 tx=0x7fce440042f0 comp rx=0 tx=0).stop 2024-09-12T12:09:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 shutdown_connections 2024-09-12T12:09:58.838 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fce340a2b70 0x7fce340a5030 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce481037b0 0x7fce48074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce48102df0 0x7fce480745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 --2- 172.21.15.173:0/761260643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce48101bf0 0x7fce48075f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:09:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 >> 172.21.15.173:0/761260643 conn(0x7fce480fd3c0 msgr2=0x7fce481061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:09:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 shutdown_connections 2024-09-12T12:09:58.839 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:09:58.838+0000 7fce4f7f8640 1 -- 172.21.15.173:0/761260643 wait complete. 2024-09-12T12:09:59.420 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:59 smithi173 ceph-mon[35326]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:59.420 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:59 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:59.420 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:59 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:59.420 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:09:59 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:59.421 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T12:09:59.424 INFO:tasks.cephadm:Deploying osd.3 on smithi081 with /dev/vg_nvme/lv_3... 2024-09-12T12:09:59.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:09:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:59 smithi081 ceph-mon[30948]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:59 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:59.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:59 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:59.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:09:59 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:09:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:59 smithi103 ceph-mon[35094]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:09:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:59 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:09:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:59 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:09:59.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:09:59 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:00.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:00 smithi173 ceph-mon[35326]: overall HEALTH_OK 2024-09-12T12:10:00.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:00 smithi081 ceph-mon[30948]: overall HEALTH_OK 2024-09-12T12:10:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:00 smithi103 ceph-mon[35094]: overall HEALTH_OK 2024-09-12T12:10:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:01 smithi173 ceph-mon[35326]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:01 smithi173 ceph-mon[35326]: from='osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:10:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:01 smithi173 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:10:01.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:01 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2[40297]: 2024-09-12T12:10:01.244+0000 7fa3c4e3d640 -1 osd.2 0 log_to_monitors true 2024-09-12T12:10:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:01 smithi103 ceph-mon[35094]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:01 smithi103 ceph-mon[35094]: from='osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:10:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:01 smithi103 ceph-mon[35094]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:10:01.811 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:01 smithi081 ceph-mon[30948]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:01.811 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:01 smithi081 ceph-mon[30948]: from='osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:10:01.811 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:01 smithi081 ceph-mon[30948]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T12:10:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:10:02.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-09-12T12:10:02.380 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:10:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:02 smithi081 ceph-mon[30948]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:10:02.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:10:02.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:10:02.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:02 smithi173 ceph-mon[35326]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:10:02.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:02.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:02.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:02.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:02 smithi103 ceph-mon[35094]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:10:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 -- 172.21.15.81:0/3369834795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d14100af0 msgr2=0x7f1d14100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 --2- 172.21.15.81:0/3369834795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d14100af0 0x7f1d14100ef0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009900 tx=0x7f1cfc02a410 comp rx=0 tx=0).stop 2024-09-12T12:10:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 -- 172.21.15.81:0/3369834795 shutdown_connections 2024-09-12T12:10:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 --2- 172.21.15.81:0/3369834795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d141026b0 0x7f1d14108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:02.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 --2- 172.21.15.81:0/3369834795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d14101cf0 0x7f1d14102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 --2- 172.21.15.81:0/3369834795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d14100af0 0x7f1d14100ef0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 -- 172.21.15.81:0/3369834795 >> 172.21.15.81:0/3369834795 conn(0x7f1d140fc280 msgr2=0x7f1d140fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:10:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 -- 172.21.15.81:0/3369834795 shutdown_connections 2024-09-12T12:10:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.858+0000 7f1d18fad640 1 -- 172.21.15.81:0/3369834795 wait complete. 2024-09-12T12:10:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.859+0000 7f1d18fad640 1 Processor -- start 2024-09-12T12:10:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.859+0000 7f1d18fad640 1 -- start start 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.859+0000 7f1d18fad640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d14100af0 0x7f1d14196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.859+0000 7f1d18fad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d14101cf0 0x7f1d14197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.859+0000 7f1d18fad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 0x7f1d1419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d18fad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1410c8b0 con 0x7f1d141026b0 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d18fad640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1410c730 con 0x7f1d14101cf0 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d18fad640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1410ca30 con 0x7f1d14100af0 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d1259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d14100af0 0x7f1d14196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 0x7f1d1419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 0x7f1d1419e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49232/0 (socket says 172.21.15.81:49232) 2024-09-12T12:10:02.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 -- 172.21.15.81:0/4145338354 learned_addr learned my addr 172.21.15.81:0/4145338354 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d11d9b640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d14101cf0 0x7f1d14197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 -- 172.21.15.81:0/4145338354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d14100af0 msgr2=0x7f1d14196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d14100af0 0x7f1d14196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 -- 172.21.15.81:0/4145338354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d14101cf0 msgr2=0x7f1d14197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d14101cf0 0x7f1d14197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 -- 172.21.15.81:0/4145338354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1419eb40 con 0x7f1d141026b0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d12d9d640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 0x7f1d1419e4d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00eb10 tx=0x7f1d0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c004b20 con 0x7f1d141026b0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d0c004cc0 con 0x7f1d141026b0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0107f0 con 0x7f1d141026b0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.860+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1419ee30 con 0x7f1d141026b0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.861+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1419f2e0 con 0x7f1d141026b0 2024-09-12T12:10:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.861+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d14107ec0 con 0x7f1d141026b0 2024-09-12T12:10:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.863+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f1d0c010990 con 0x7f1d141026b0 2024-09-12T12:10:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.864+0000 7f1d0b7fe640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d000a2ba0 0x7f1d000a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.864+0000 7f1d1259c640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d000a2ba0 0x7f1d000a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:02.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.864+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f1d0c0ce0b0 con 0x7f1d141026b0 2024-09-12T12:10:02.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.865+0000 7f1d1259c640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d000a2ba0 0x7f1d000a5060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc031570 tx=0x7f1cfc031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:10:02.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:02.867+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d0c0541b0 con 0x7f1d141026b0 2024-09-12T12:10:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:03.047+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1d14062630 con 0x7f1d000a2ba0 2024-09-12T12:10:03.653 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2[40297]: 2024-09-12T12:10:03.229+0000 7fa3c059d640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T12:10:03.653 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2[40297]: 2024-09-12T12:10:03.234+0000 7fa3b8bcf640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:10:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi173 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:03 smithi173 ceph-mon[35326]: from='osd.2 ' entity='osd.2' 2024-09-12T12:10:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi173 2024-09-12T12:10:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-12T12:10:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:03.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:03 smithi103 ceph-mon[35094]: from='osd.2 ' entity='osd.2' 2024-09-12T12:10:03.726 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi173 2024-09-12T12:10:03.726 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi173 to 17088M 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:03.727 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:03 smithi081 ceph-mon[30948]: from='osd.2 ' entity='osd.2' 2024-09-12T12:10:04.746 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:10:04.747 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:10:04.747 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:04.747 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:04.747 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] boot 2024-09-12T12:10:04.747 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T12:10:04.747 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:04.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:10:04.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:10:04.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:04.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:04.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] boot 2024-09-12T12:10:04.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T12:10:04.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:04.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:10:04.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:10:04.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:04.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:04.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: osd.2 [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] boot 2024-09-12T12:10:04.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: osdmap e17: 3 total, 3 up, 3 in 2024-09-12T12:10:04.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:10:05.859 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:05 smithi081 sudo[49291]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:10:05.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:05 smithi081 sudo[49291]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:05.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:05 smithi081 sudo[49291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:05.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:05 smithi081 sudo[49291]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:10:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:10:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:10:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:10:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/518530534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "255d0d9f-47b0-45d3-98c8-17ce85b3cf2a"}]: dispatch 2024-09-12T12:10:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:10:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/518530534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "255d0d9f-47b0-45d3-98c8-17ce85b3cf2a"}]': finished 2024-09-12T12:10:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T12:10:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/518530534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "255d0d9f-47b0-45d3-98c8-17ce85b3cf2a"}]: dispatch 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/518530534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "255d0d9f-47b0-45d3-98c8-17ce85b3cf2a"}]': finished 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T12:10:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-12T12:10:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:10:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/518530534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "255d0d9f-47b0-45d3-98c8-17ce85b3cf2a"}]: dispatch 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/518530534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "255d0d9f-47b0-45d3-98c8-17ce85b3cf2a"}]': finished 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: osdmap e19: 4 total, 3 up, 4 in 2024-09-12T12:10:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:06.360 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:06 smithi081 sudo[49302]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:10:06.371 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:06 smithi081 sudo[49302]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:06.371 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:06 smithi081 sudo[49302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:06.371 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:10:06 smithi081 sudo[49302]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:06.553 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43590]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:10:06.553 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43590]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:06.554 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:06.554 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43590]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:06.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:06 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1658248047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:06 smithi081 ceph-mon[30948]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:06 smithi081 ceph-mon[30948]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T12:10:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:06.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:06 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1658248047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:06.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:06.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:06 smithi173 ceph-mon[35326]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:06.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:06 smithi173 ceph-mon[35326]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T12:10:06.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:06.935 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43593]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:10:06.935 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43593]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:06.935 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:06.935 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:10:06 smithi103 sudo[43593]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:06.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:06 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1658248047' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:06.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:06.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:06 smithi103 ceph-mon[35094]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:06.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:06 smithi103 ceph-mon[35094]: osdmap e20: 4 total, 3 up, 4 in 2024-09-12T12:10:06.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:07.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:07.066+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1d0c098630 con 0x7f1d141026b0 2024-09-12T12:10:07.170 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:06 smithi173 sudo[43958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:10:07.171 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:06 smithi173 sudo[43958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:07.171 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:06 smithi173 sudo[43958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:07.171 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:06 smithi173 sudo[43958]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:07.653 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43961]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:10:07.653 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43961]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:07.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:07.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43961]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:07.711 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49537]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:10:07.711 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49537]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:07.711 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:07.711 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49537]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:07.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:07.971 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 ceph-mon[35326]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:10:07.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:07.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:07.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43964]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:10:07.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43964]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:07.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:07.972 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:07 smithi173 sudo[43964]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:08.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49724]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49724]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 sudo[49724]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 ceph-mon[30948]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:07 smithi081 ceph-mon[30948]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:08.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:08.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:07 smithi103 ceph-mon[35094]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T12:10:08.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:08.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:07 smithi103 ceph-mon[35094]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 sudo[43967]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:10:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 sudo[43967]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 sudo[43967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 sudo[43967]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:08.712 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43596]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T12:10:08.712 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43596]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:08.712 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:08.712 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43596]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:08.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:08.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:08.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:08.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:08.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:08.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:08 smithi173 ceph-mon[35326]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:09.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:09.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:09.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:08 smithi081 ceph-mon[30948]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:09.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43599]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T12:10:09.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43599]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 sudo[43599]: pam_unix(sudo:session): session closed for user root 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T12:10:09.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:10:09.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:10:09.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:10:09.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:08 smithi103 ceph-mon[35094]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:10.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:09 smithi081 ceph-mon[30948]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:10.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:09 smithi173 ceph-mon[35326]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:10.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:09 smithi103 ceph-mon[35094]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T12:10:11.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:10 smithi081 ceph-mon[30948]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:11.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:10 smithi173 ceph-mon[35326]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:11.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:10 smithi103 ceph-mon[35094]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:13.465 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:13 smithi081 ceph-mon[30948]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:13 smithi173 ceph-mon[35326]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:13 smithi103 ceph-mon[35094]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:14.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:10:14.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:14.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:10:14.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:14.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T12:10:14.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:15.461 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:15 smithi081 ceph-mon[30948]: Deploying daemon osd.3 on smithi081 2024-09-12T12:10:15.462 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:15 smithi081 ceph-mon[30948]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:15 smithi173 ceph-mon[35326]: Deploying daemon osd.3 on smithi081 2024-09-12T12:10:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:15 smithi173 ceph-mon[35326]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:15 smithi103 ceph-mon[35094]: Deploying daemon osd.3 on smithi081 2024-09-12T12:10:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:15 smithi103 ceph-mon[35094]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:17.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:17 smithi081 ceph-mon[30948]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:17 smithi173 ceph-mon[35326]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:17 smithi103 ceph-mon[35094]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:19.398 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:19 smithi081 ceph-mon[30948]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:19.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:19 smithi173 ceph-mon[35326]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:19 smithi103 ceph-mon[35094]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:20.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:20.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:20.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:20.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:20.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:20.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:20.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:20.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:20.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:21.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:21 smithi081 ceph-mon[30948]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:21.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:21 smithi173 ceph-mon[35326]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:21 smithi103 ceph-mon[35094]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:23.450 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:23 smithi081 ceph-mon[30948]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:23.450 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.450 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.451 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:23.451 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:23.451 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:23 smithi173 ceph-mon[35326]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:23.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:23 smithi103 ceph-mon[35094]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:23.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:23.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:23.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.771+0000 7f1d0b7fe640 1 -- 172.21.15.81:0/4145338354 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d14062630 con 0x7f1d000a2ba0 2024-09-12T12:10:23.771 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 3 on host 'smithi081' 2024-09-12T12:10:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d000a2ba0 msgr2=0x7f1d000a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d000a2ba0 0x7f1d000a5060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc031570 tx=0x7f1cfc031640 comp rx=0 tx=0).stop 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 msgr2=0x7f1d1419e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 0x7f1d1419e4d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00eb10 tx=0x7f1d0c00c2d0 comp rx=0 tx=0).stop 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 shutdown_connections 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d000a2ba0 0x7f1d000a5060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d141026b0 0x7f1d1419e4d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d14101cf0 0x7f1d14197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 --2- 172.21.15.81:0/4145338354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d14100af0 0x7f1d14196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 >> 172.21.15.81:0/4145338354 conn(0x7f1d140fc280 msgr2=0x7f1d14105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 shutdown_connections 2024-09-12T12:10:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:10:23.773+0000 7f1d18fad640 1 -- 172.21.15.81:0/4145338354 wait complete. 2024-09-12T12:10:24.325 DEBUG:teuthology.orchestra.run.smithi081:osd.3> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T12:10:24.327 INFO:tasks.cephadm:Deploying osd.4 on smithi103 with /dev/vg_nvme/lv_3... 2024-09-12T12:10:24.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:10:24.583 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:10:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:24 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:24 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:24 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:24.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:24 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:24.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:24 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:24.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:24 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:24.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:24 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:24.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:24 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:24.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:24 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:25.462 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:25 smithi081 ceph-mon[30948]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:25 smithi173 ceph-mon[35326]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:25 smithi103 ceph-mon[35094]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:26.801 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:10:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3[51331]: 2024-09-12T12:10:26.366+0000 7f5052892640 -1 osd.3 0 log_to_monitors true 2024-09-12T12:10:27.233 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:10:27.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:27.461 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:27.462 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:27 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:10:27.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:27 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:27.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:27.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:27 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:27.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 -- 172.21.15.103:0/3616189106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8101cd0 msgr2=0x7fc0c8102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:27.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/3616189106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8101cd0 0x7fc0c8102150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009900 tx=0x7fc0b002a410 comp rx=0 tx=0).stop 2024-09-12T12:10:27.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 -- 172.21.15.103:0/3616189106 shutdown_connections 2024-09-12T12:10:27.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/3616189106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8102690 0x7fc0c8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:27.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/3616189106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8101cd0 0x7fc0c8102150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/3616189106 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0c8100ad0 0x7fc0c8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 -- 172.21.15.103:0/3616189106 >> 172.21.15.103:0/3616189106 conn(0x7fc0c80fc280 msgr2=0x7fc0c80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 -- 172.21.15.103:0/3616189106 shutdown_connections 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.959+0000 7fc0cdb27640 1 -- 172.21.15.103:0/3616189106 wait complete. 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 Processor -- start 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 -- start start 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8100ad0 0x7fc0c8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0c8101cd0 0x7fc0c8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 0x7fc0c819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c810c890 con 0x7fc0c8100ad0 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c810c710 con 0x7fc0c8102690 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0cdb27640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c810ca10 con 0x7fc0c8101cd0 2024-09-12T12:10:27.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.960+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 0x7fc0c819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 0x7fc0c819f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60408/0 (socket says 172.21.15.103:60408) 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 -- 172.21.15.103:0/2723142225 learned_addr learned my addr 172.21.15.103:0/2723142225 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c77fe640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8100ad0 0x7fc0c8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c6ffd640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0c8101cd0 0x7fc0c8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 -- 172.21.15.103:0/2723142225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0c8101cd0 msgr2=0x7fc0c8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0c8101cd0 0x7fc0c8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 -- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8100ad0 msgr2=0x7fc0c8197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8100ad0 0x7fc0c8197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 -- 172.21.15.103:0/2723142225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c819fbf0 con 0x7fc0c8102690 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c77fe640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8100ad0 0x7fc0c8197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c7fff640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 0x7fc0c819f580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000eb10 tx=0x7fc0c000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:10:27.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0004b20 con 0x7fc0c8102690 2024-09-12T12:10:27.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0c0004cc0 con 0x7fc0c8102690 2024-09-12T12:10:27.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c819fee0 con 0x7fc0c8102690 2024-09-12T12:10:27.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00107f0 con 0x7fc0c8102690 2024-09-12T12:10:27.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.961+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c81a0340 con 0x7fc0c8102690 2024-09-12T12:10:27.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.963+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c8108a10 con 0x7fc0c8102690 2024-09-12T12:10:27.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.963+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc0c0005020 con 0x7fc0c8102690 2024-09-12T12:10:27.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.964+0000 7fc0c4ff9640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc0b40a2bb0 0x7fc0b40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:27.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.964+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3373+0+0 (secure 0 0 0) 0x7fc0c00ce1f0 con 0x7fc0c8102690 2024-09-12T12:10:27.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.964+0000 7fc0c77fe640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc0b40a2bb0 0x7fc0b40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:27.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.965+0000 7fc0c77fe640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc0b40a2bb0 0x7fc0b40a5070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8005fd0 tx=0x7fc0b800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:10:27.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:27.973+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0c009c4a0 con 0x7fc0c8102690 2024-09-12T12:10:28.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:28.154+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc0c8062630 con 0x7fc0b40a2bb0 2024-09-12T12:10:28.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi081 2024-09-12T12:10:28.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-12T12:10:28.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:10:28.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T12:10:28.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:10:28.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:28.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:28.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:28.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:28.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi081 2024-09-12T12:10:28.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:28.860 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3[51331]: 2024-09-12T12:10:28.371+0000 7f504dff2640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T12:10:28.860 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3[51331]: 2024-09-12T12:10:28.378+0000 7f504a62c640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi081 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi081 to 8544M 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: osdmap e21: 4 total, 3 up, 4 in 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:29.522 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:29.523 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: from='osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:30.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:30.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:30 smithi103 ceph-mon[35094]: osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] boot 2024-09-12T12:10:30.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:30 smithi103 ceph-mon[35094]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T12:10:30.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:30.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:30 smithi173 ceph-mon[35326]: osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] boot 2024-09-12T12:10:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:30 smithi173 ceph-mon[35326]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T12:10:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:30.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:30 smithi081 ceph-mon[30948]: osd.3 [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] boot 2024-09-12T12:10:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:30 smithi081 ceph-mon[30948]: osdmap e23: 4 total, 4 up, 4 in 2024-09-12T12:10:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:10:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T12:10:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/1583660812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]: dispatch 2024-09-12T12:10:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]: dispatch 2024-09-12T12:10:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]': finished 2024-09-12T12:10:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: osdmap e25: 5 total, 4 up, 5 in 2024-09-12T12:10:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:31 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/2115273568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/1583660812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]: dispatch 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]: dispatch 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]': finished 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: osdmap e25: 5 total, 4 up, 5 in 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:31 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/2115273568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: pgmap v94: 1 pgs: 1 peering; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T12:10:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: osdmap e24: 4 total, 4 up, 4 in 2024-09-12T12:10:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/1583660812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]: dispatch 2024-09-12T12:10:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]: dispatch 2024-09-12T12:10:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "233bf67e-6d2b-498b-ace5-aef1a3f5a107"}]': finished 2024-09-12T12:10:31.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: osdmap e25: 5 total, 4 up, 5 in 2024-09-12T12:10:31.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:31.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:31 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/2115273568' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:32 smithi081 ceph-mon[30948]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T12:10:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:32 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:32 smithi081 ceph-mon[30948]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:32 smithi173 ceph-mon[35326]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T12:10:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:32 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:32 smithi173 ceph-mon[35326]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:32.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:32 smithi103 ceph-mon[35094]: osdmap e26: 5 total, 4 up, 5 in 2024-09-12T12:10:32.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:32 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:32.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:32 smithi103 ceph-mon[35094]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:33.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:33 smithi081 ceph-mon[30948]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T12:10:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:33 smithi173 ceph-mon[35326]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T12:10:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:33.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:33 smithi103 ceph-mon[35094]: osdmap e27: 5 total, 4 up, 5 in 2024-09-12T12:10:33.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:34.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:34 smithi081 ceph-mon[30948]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:10:34.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:34 smithi173 ceph-mon[35326]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:10:34.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:34 smithi103 ceph-mon[35094]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-12T12:10:37.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:37 smithi081 ceph-mon[30948]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T12:10:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:37 smithi173 ceph-mon[35326]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T12:10:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:37 smithi103 ceph-mon[35094]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T12:10:39.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:39 smithi081 ceph-mon[30948]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-12T12:10:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:10:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:39.639 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:39 smithi103 ceph-mon[35094]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-12T12:10:39.639 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:10:39.639 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:39 smithi173 ceph-mon[35326]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-12T12:10:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T12:10:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:40.550 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:40 smithi103 ceph-mon[35094]: Deploying daemon osd.4 on smithi103 2024-09-12T12:10:40.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:40 smithi081 ceph-mon[30948]: Deploying daemon osd.4 on smithi103 2024-09-12T12:10:40.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:40 smithi173 ceph-mon[35326]: Deploying daemon osd.4 on smithi103 2024-09-12T12:10:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:41 smithi081 ceph-mon[30948]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T12:10:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:41 smithi173 ceph-mon[35326]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T12:10:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:41 smithi103 ceph-mon[35094]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-12T12:10:43.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:43 smithi081 ceph-mon[30948]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:10:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:43 smithi173 ceph-mon[35326]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:10:43.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:43 smithi103 ceph-mon[35094]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:10:45.607 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:45 smithi103 ceph-mon[35094]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T12:10:45.607 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:45.607 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:45.607 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:45.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:45 smithi081 ceph-mon[30948]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T12:10:45.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:45.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:45.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:45 smithi173 ceph-mon[35326]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-12T12:10:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:47 smithi081 ceph-mon[30948]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:47.611 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:47 smithi103 ceph-mon[35094]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:47 smithi173 ceph-mon[35326]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:48.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.285+0000 7fc0c4ff9640 1 -- 172.21.15.103:0/2723142225 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc0c8062630 con 0x7fc0b40a2bb0 2024-09-12T12:10:48.286 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 4 on host 'smithi103' 2024-09-12T12:10:48.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc0b40a2bb0 msgr2=0x7fc0b40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:48.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc0b40a2bb0 0x7fc0b40a5070 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8005fd0 tx=0x7fc0b800b410 comp rx=0 tx=0).stop 2024-09-12T12:10:48.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 msgr2=0x7fc0c819f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:48.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 0x7fc0c819f580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000eb10 tx=0x7fc0c000c2d0 comp rx=0 tx=0).stop 2024-09-12T12:10:48.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 shutdown_connections 2024-09-12T12:10:48.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc0b40a2bb0 0x7fc0b40a5070 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:48.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c8102690 0x7fc0c819f580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:48.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0c8101cd0 0x7fc0c8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:48.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 --2- 172.21.15.103:0/2723142225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0c8100ad0 0x7fc0c8197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:48.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 >> 172.21.15.103:0/2723142225 conn(0x7fc0c80fc280 msgr2=0x7fc0c80fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:10:48.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 shutdown_connections 2024-09-12T12:10:48.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:10:48.287+0000 7fc0cdb27640 1 -- 172.21.15.103:0/2723142225 wait complete. 2024-09-12T12:10:48.840 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.840 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.840 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:48.840 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:48.840 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.841 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:48.841 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.841 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.841 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:48 smithi103 ceph-mon[35094]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:48.867 DEBUG:teuthology.orchestra.run.smithi103:osd.4> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T12:10:48.870 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_3... 2024-09-12T12:10:48.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T12:10:48.898 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.898 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.898 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:48.898 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:48.898 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.899 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:48.899 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.899 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:48.899 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:48 smithi173 ceph-mon[35326]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:49.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:49.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:48 smithi081 ceph-mon[30948]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:49.125 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:10:51.442 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:10:51.467 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-09-12T12:10:51.531 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:51 smithi173 ceph-mon[35326]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:51.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:51 smithi081 ceph-mon[30948]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:51.621 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:51 smithi103 ceph-mon[35094]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:51.622 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:10:51 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:10:51.393+0000 7fb751a55640 -1 osd.4 0 log_to_monitors true 2024-09-12T12:10:51.755 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:10:52.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.148+0000 7f3861c4b640 1 -- 172.21.15.173:0/3684951577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c1026b0 msgr2=0x7f385c108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:52.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.148+0000 7f3861c4b640 1 --2- 172.21.15.173:0/3684951577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c1026b0 0x7f385c108f40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3854009ca0 tx=0x7f385402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:10:52.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- 172.21.15.173:0/3684951577 shutdown_connections 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 --2- 172.21.15.173:0/3684951577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c1026b0 0x7f385c108f40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 --2- 172.21.15.173:0/3684951577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c101cf0 0x7f385c102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 --2- 172.21.15.173:0/3684951577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 0x7f385c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- 172.21.15.173:0/3684951577 >> 172.21.15.173:0/3684951577 conn(0x7f385c0fc280 msgr2=0x7f385c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- 172.21.15.173:0/3684951577 shutdown_connections 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- 172.21.15.173:0/3684951577 wait complete. 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 Processor -- start 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- start start 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 0x7f385c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:52.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 0x7f385c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c1026b0 0x7f385c1a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f385c10c8a0 con 0x7f385c100af0 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.149+0000 7f3861c4b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f385c10c720 con 0x7f385c1026b0 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f3861c4b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f385c10ca20 con 0x7f385c101cf0 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 0x7f385c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 0x7f385c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51462/0 (socket says 172.21.15.173:51462) 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 -- 172.21.15.173:0/2744700924 learned_addr learned my addr 172.21.15.173:0/2744700924 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385b7fe640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 0x7f385c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385bfff640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c1026b0 0x7f385c1a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 -- 172.21.15.173:0/2744700924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c1026b0 msgr2=0x7f385c1a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c1026b0 0x7f385c1a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:52.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 -- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 msgr2=0x7f385c19a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 0x7f385c19a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 -- 172.21.15.173:0/2744700924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385c1a1c60 con 0x7f385c101cf0 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385bfff640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c1026b0 0x7f385c1a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385b7fe640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 0x7f385c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f385affd640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 0x7f385c19a570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f385000c920 tx=0x7f385000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850007c70 con 0x7f385c101cf0 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385c1a1f50 con 0x7f385c101cf0 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.150+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3850007e10 con 0x7f385c101cf0 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.151+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850018940 con 0x7f385c101cf0 2024-09-12T12:10:52.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.151+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f385c1a2450 con 0x7f385c101cf0 2024-09-12T12:10:52.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.152+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f385c1a26e0 con 0x7f385c101cf0 2024-09-12T12:10:52.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.153+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3850018ba0 con 0x7f385c101cf0 2024-09-12T12:10:52.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.154+0000 7f3858ff9640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f38440a2bb0 0x7f38440a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:10:52.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.154+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3784+0+0 (secure 0 0 0) 0x7f38500ce040 con 0x7f385c101cf0 2024-09-12T12:10:52.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.154+0000 7f385b7fe640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f38440a2bb0 0x7f38440a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:10:52.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.155+0000 7f385b7fe640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f38440a2bb0 0x7f38440a5070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f385c101b50 tx=0x7f384c00a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:10:52.159 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.158+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3850014030 con 0x7f385c101cf0 2024-09-12T12:10:52.337 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:10:52.335+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f385c062630 con 0x7f38440a2bb0 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:52.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:52.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.405 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:10:52.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T12:10:52.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:52.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:10:52.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:52.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:10:52.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:10:52.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi103 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:53.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:53 smithi081 ceph-mon[30948]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:10:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi103 2024-09-12T12:10:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:53.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:53 smithi173 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:10:53.685 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:10:53.354+0000 7fb74d1b5640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T12:10:53.685 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:10:53.362+0000 7fb7497ef640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi103 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:53.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:53 smithi103 ceph-mon[35094]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:10:54.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:54 smithi081 ceph-mon[30948]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:10:54.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:54 smithi081 ceph-mon[30948]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:10:54.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:54 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:54.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:54 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:54.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:54 smithi173 ceph-mon[35326]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:10:54.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:54 smithi173 ceph-mon[35326]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:10:54.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:54 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:54.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:54 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:54.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:54 smithi103 ceph-mon[35094]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:10:54.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:54 smithi103 ceph-mon[35094]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T12:10:54.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:54 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:54.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:54 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:10:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] boot 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/2009200502' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]: dispatch 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]: dispatch 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]': finished 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: osdmap e31: 6 total, 5 up, 6 in 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:10:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:55 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/3426735309' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:10:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:10:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] boot 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/2009200502' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]: dispatch 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]: dispatch 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]': finished 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: osdmap e31: 6 total, 5 up, 6 in 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:10:55.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:55 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/3426735309' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: osd.4 [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] boot 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: osdmap e30: 5 total, 5 up, 5 in 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/2009200502' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]: dispatch 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]: dispatch 2024-09-12T12:10:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfaddbb0-cfb9-4a0d-907e-47556befc325"}]': finished 2024-09-12T12:10:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: osdmap e31: 6 total, 5 up, 6 in 2024-09-12T12:10:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:10:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:55 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/3426735309' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:10:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:57 smithi173 ceph-mon[35326]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:10:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:57 smithi103 ceph-mon[35094]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:10:57.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:57 smithi081 ceph-mon[30948]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:10:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:10:59 smithi173 ceph-mon[35326]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:10:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:10:59 smithi103 ceph-mon[35094]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:10:59.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:10:59 smithi081 ceph-mon[30948]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:01 smithi173 ceph-mon[35326]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:01 smithi103 ceph-mon[35094]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:01.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:01 smithi081 ceph-mon[30948]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:03 smithi173 ceph-mon[35326]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:11:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:03 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:03 smithi103 ceph-mon[35094]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:11:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:03 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:03.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:03 smithi081 ceph-mon[30948]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:03.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T12:11:03.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:03 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:04.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:04 smithi173 ceph-mon[35326]: Deploying daemon osd.5 on smithi173 2024-09-12T12:11:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:04 smithi103 ceph-mon[35094]: Deploying daemon osd.5 on smithi173 2024-09-12T12:11:04.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:04 smithi081 ceph-mon[30948]: Deploying daemon osd.5 on smithi173 2024-09-12T12:11:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:05 smithi173 ceph-mon[35326]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:05 smithi103 ceph-mon[35094]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:05 smithi081 ceph-mon[30948]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:07.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:07 smithi173 ceph-mon[35326]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:07 smithi103 ceph-mon[35094]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:07.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:07 smithi081 ceph-mon[30948]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:09.641 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:09 smithi173 ceph-mon[35326]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:09.641 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:09.641 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:09.641 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:09 smithi103 ceph-mon[35094]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:09.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:09 smithi081 ceph-mon[30948]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:11.619 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:11 smithi173 ceph-mon[35326]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:11 smithi103 ceph-mon[35094]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:11.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:11 smithi081 ceph-mon[30948]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:13.047 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.047 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.048 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:13.048 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:13.048 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.048 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:12 smithi173 ceph-mon[35326]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:13.090 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.090+0000 7f3858ff9640 1 -- 172.21.15.173:0/2744700924 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f385c062630 con 0x7f38440a2bb0 2024-09-12T12:11:13.091 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f38440a2bb0 msgr2=0x7f38440a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f38440a2bb0 0x7f38440a5070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f385c101b50 tx=0x7f384c00a5e0 comp rx=0 tx=0).stop 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 msgr2=0x7f385c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 0x7f385c19a570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f385000c920 tx=0x7f385000cde0 comp rx=0 tx=0).stop 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 shutdown_connections 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f38440a2bb0 0x7f38440a5070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c1026b0 0x7f385c1a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:13.093 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f385c101cf0 0x7f385c19a570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 --2- 172.21.15.173:0/2744700924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f385c100af0 0x7f385c19a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.092+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 >> 172.21.15.173:0/2744700924 conn(0x7f385c0fc280 msgr2=0x7f385c06b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.093+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 shutdown_connections 2024-09-12T12:11:13.094 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:11:13.093+0000 7f3861c4b640 1 -- 172.21.15.173:0/2744700924 wait complete. 2024-09-12T12:11:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:12 smithi081 ceph-mon[30948]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:13.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:13.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:13.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:12 smithi103 ceph-mon[35094]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:13.666 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T12:11:13.708 INFO:tasks.cephadm:Deploying osd.6 on smithi081 with /dev/vg_nvme/lv_2... 2024-09-12T12:11:13.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:11:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:13 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:13.965 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:11:14.086 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:14.086 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:14.086 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:13 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:14.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:14.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:14.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:13 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:15.105 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:14 smithi173 ceph-mon[35326]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:15.107 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:14 smithi081 ceph-mon[30948]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:15.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:14 smithi103 ceph-mon[35094]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:15 smithi173 ceph-mon[35326]: from='osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:11:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:15 smithi173 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:11:15.904 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:11:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:11:15.597+0000 7f44a120c640 -1 osd.5 0 log_to_monitors true 2024-09-12T12:11:16.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:15 smithi081 ceph-mon[30948]: from='osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:11:16.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:15 smithi081 ceph-mon[30948]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:11:16.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:15 smithi103 ceph-mon[35094]: from='osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:11:16.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:15 smithi103 ceph-mon[35094]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T12:11:16.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:11:16.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-09-12T12:11:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:11:17.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 -- 172.21.15.81:0/2776691261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100101cd0 msgr2=0x7ff100102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:17.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 --2- 172.21.15.81:0/2776691261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100101cd0 0x7ff100102150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009900 tx=0x7ff0fc02a410 comp rx=0 tx=0).stop 2024-09-12T12:11:17.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 -- 172.21.15.81:0/2776691261 shutdown_connections 2024-09-12T12:11:17.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 --2- 172.21.15.81:0/2776691261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff100102690 0x7ff100108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:17.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 --2- 172.21.15.81:0/2776691261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100101cd0 0x7ff100102150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:17.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 --2- 172.21.15.81:0/2776691261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff100100ad0 0x7ff100100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 -- 172.21.15.81:0/2776691261 >> 172.21.15.81:0/2776691261 conn(0x7ff1000fc280 msgr2=0x7ff1000fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 -- 172.21.15.81:0/2776691261 shutdown_connections 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 -- 172.21.15.81:0/2776691261 wait complete. 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 Processor -- start 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.003+0000 7ff108112640 1 -- start start 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 0x7ff100196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff100101cd0 0x7ff100197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff100102690 0x7ff10019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010c890 con 0x7ff100100ad0 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010c710 con 0x7ff100102690 2024-09-12T12:11:17.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010ca10 con 0x7ff100101cd0 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 0x7ff100196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 0x7ff100196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42556/0 (socket says 172.21.15.81:42556) 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 -- 172.21.15.81:0/2444724554 learned_addr learned my addr 172.21.15.81:0/2444724554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff1056ad640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff100101cd0 0x7ff100197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff1066af640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff100102690 0x7ff10019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 -- 172.21.15.81:0/2444724554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff100101cd0 msgr2=0x7ff100197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff100101cd0 0x7ff100197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 -- 172.21.15.81:0/2444724554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff100102690 msgr2=0x7ff10019e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff100102690 0x7ff10019e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 -- 172.21.15.81:0/2444724554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10019eb10 con 0x7ff100100ad0 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff105eae640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 0x7ff100196ee0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ead0 tx=0x7ff0f000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000bbd0 con 0x7ff100100ad0 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.004+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff100069fd0 con 0x7ff100100ad0 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.005+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0f000bd70 con 0x7ff100100ad0 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.005+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0017670 con 0x7ff100100ad0 2024-09-12T12:11:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.005+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff10006a530 con 0x7ff100100ad0 2024-09-12T12:11:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.006+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff100100ed0 con 0x7ff100100ad0 2024-09-12T12:11:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.008+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff0f001e020 con 0x7ff100100ad0 2024-09-12T12:11:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.008+0000 7ff0f6ffd640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff0ec0a2bb0 0x7ff0ec0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.008+0000 7ff1056ad640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff0ec0a2bb0 0x7ff0ec0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.008+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4253+0+0 (secure 0 0 0) 0x7ff0f00cf640 con 0x7ff100100ad0 2024-09-12T12:11:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.009+0000 7ff1056ad640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff0ec0a2bb0 0x7ff0ec0a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc006010 tx=0x7ff0fc031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:11:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.013+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0f009d580 con 0x7ff100100ad0 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi173 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:17.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:17.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:17.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:17.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.153 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:11:16.851+0000 7f449c96c640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T12:11:17.154 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:11:16.857+0000 7f4498fa6640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi173 2024-09-12T12:11:17.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:17.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: osdmap e32: 6 total, 5 up, 6 in 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi173 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:17.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:17.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:17.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:17.194+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff10006a790 con 0x7ff0ec0a2bb0 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:18.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-12T12:11:18.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:18.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi173 to 8544M 2024-09-12T12:11:18.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:11:18.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: osdmap e33: 6 total, 5 up, 6 in 2024-09-12T12:11:18.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:11:18.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:11:18.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:11:18.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:18.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:11:18.986 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:11:18.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] boot 2024-09-12T12:11:18.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: osdmap e34: 6 total, 6 up, 6 in 2024-09-12T12:11:18.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:18.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T12:11:18.987 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:18 smithi081 ceph-mon[30948]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:19.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:11:19.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:11:19.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] boot 2024-09-12T12:11:19.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: osdmap e34: 6 total, 6 up, 6 in 2024-09-12T12:11:19.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:19.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T12:11:19.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:18 smithi173 ceph-mon[35326]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:19.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:11:19.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:11:19.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: osd.5 [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] boot 2024-09-12T12:11:19.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: osdmap e34: 6 total, 6 up, 6 in 2024-09-12T12:11:19.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:11:19.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: osdmap e35: 6 total, 6 up, 6 in 2024-09-12T12:11:19.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:18 smithi103 ceph-mon[35094]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-12T12:11:20.234 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:20 smithi081 ceph-mon[30948]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:11:20.234 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:20 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3340079109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5583451-c189-446a-996a-c0289f513116"}]: dispatch 2024-09-12T12:11:20.234 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:20 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3340079109' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5583451-c189-446a-996a-c0289f513116"}]': finished 2024-09-12T12:11:20.235 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:20 smithi081 ceph-mon[30948]: osdmap e37: 7 total, 6 up, 7 in 2024-09-12T12:11:20.235 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:20.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:20 smithi173 ceph-mon[35326]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:11:20.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:20 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3340079109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5583451-c189-446a-996a-c0289f513116"}]: dispatch 2024-09-12T12:11:20.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:20 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3340079109' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5583451-c189-446a-996a-c0289f513116"}]': finished 2024-09-12T12:11:20.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:20 smithi173 ceph-mon[35326]: osdmap e37: 7 total, 6 up, 7 in 2024-09-12T12:11:20.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:20.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:20 smithi103 ceph-mon[35094]: osdmap e36: 6 total, 6 up, 6 in 2024-09-12T12:11:20.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:20 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3340079109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e5583451-c189-446a-996a-c0289f513116"}]: dispatch 2024-09-12T12:11:20.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:20 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3340079109' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e5583451-c189-446a-996a-c0289f513116"}]': finished 2024-09-12T12:11:20.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:20 smithi103 ceph-mon[35094]: osdmap e37: 7 total, 6 up, 7 in 2024-09-12T12:11:20.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:21.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:21 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1867272174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:11:21.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:21 smithi173 ceph-mon[35326]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:21.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:21 smithi173 ceph-mon[35326]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T12:11:21.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:21 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:21.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:21 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1867272174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:11:21.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:21 smithi103 ceph-mon[35094]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:21.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:21 smithi103 ceph-mon[35094]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T12:11:21.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:21 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:21.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:21 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1867272174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:11:21.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:21 smithi081 ceph-mon[30948]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:21.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:21 smithi081 ceph-mon[30948]: osdmap e38: 7 total, 6 up, 7 in 2024-09-12T12:11:21.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:21 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:23.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:23 smithi081 ceph-mon[30948]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:23 smithi173 ceph-mon[35326]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:23 smithi103 ceph-mon[35094]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:25.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:25 smithi081 ceph-mon[30948]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:11:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:25 smithi173 ceph-mon[35326]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:11:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:25 smithi103 ceph-mon[35094]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:11:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:27 smithi081 ceph-mon[30948]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T12:11:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:27 smithi173 ceph-mon[35326]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T12:11:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:27 smithi103 ceph-mon[35094]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-12T12:11:28.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:11:28.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:28.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:11:28.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:28.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T12:11:28.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:29 smithi173 ceph-mon[35326]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T12:11:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:29 smithi173 ceph-mon[35326]: Deploying daemon osd.6 on smithi081 2024-09-12T12:11:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:29 smithi103 ceph-mon[35094]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T12:11:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:29 smithi103 ceph-mon[35094]: Deploying daemon osd.6 on smithi081 2024-09-12T12:11:29.695 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:29 smithi081 ceph-mon[30948]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T12:11:29.695 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:29 smithi081 ceph-mon[30948]: Deploying daemon osd.6 on smithi081 2024-09-12T12:11:31.583 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:31 smithi081 ceph-mon[30948]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:11:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:31 smithi173 ceph-mon[35326]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:11:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:31 smithi103 ceph-mon[35094]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T12:11:33.552 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:33 smithi081 ceph-mon[30948]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T12:11:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:33 smithi173 ceph-mon[35326]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T12:11:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:33 smithi103 ceph-mon[35094]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T12:11:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:34.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:34 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:34.655 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:34.655 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:34.655 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:34 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:34 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:35 smithi173 ceph-mon[35326]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:11:35.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:35 smithi103 ceph-mon[35094]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:11:35.712 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:35 smithi081 ceph-mon[30948]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:11:37.217 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 6 on host 'smithi081' 2024-09-12T12:11:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.216+0000 7ff0f6ffd640 1 -- 172.21.15.81:0/2444724554 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff10006a790 con 0x7ff0ec0a2bb0 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff0ec0a2bb0 msgr2=0x7ff0ec0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff0ec0a2bb0 0x7ff0ec0a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc006010 tx=0x7ff0fc031640 comp rx=0 tx=0).stop 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 msgr2=0x7ff100196ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 0x7ff100196ee0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000ead0 tx=0x7ff0f000ef90 comp rx=0 tx=0).stop 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 shutdown_connections 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff0ec0a2bb0 0x7ff0ec0a5070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff100102690 0x7ff10019e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff100101cd0 0x7ff100197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 --2- 172.21.15.81:0/2444724554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff100100ad0 0x7ff100196ee0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 >> 172.21.15.81:0/2444724554 conn(0x7ff1000fc280 msgr2=0x7ff1001050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:11:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 shutdown_connections 2024-09-12T12:11:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:11:37.219+0000 7ff108112640 1 -- 172.21.15.81:0/2444724554 wait complete. 2024-09-12T12:11:37.520 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:37 smithi081 ceph-mon[30948]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:37.520 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:37.520 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:37 smithi173 ceph-mon[35326]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:37.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:37.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:37 smithi103 ceph-mon[35094]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:37.831 DEBUG:teuthology.orchestra.run.smithi081:osd.6> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T12:11:37.834 INFO:tasks.cephadm:Deploying osd.7 on smithi103 with /dev/vg_nvme/lv_2... 2024-09-12T12:11:37.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:11:38.092 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:11:39.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:39.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:38 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:39.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:38 smithi173 ceph-mon[35326]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:39.243 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:39.243 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:38 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:39.243 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:38 smithi103 ceph-mon[35094]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:39.284 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:39.285 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:38 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:39.285 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:38 smithi081 ceph-mon[30948]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:40.462 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:11:40.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-09-12T12:11:40.610 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:11:40 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:11:40.445+0000 7fc3efa83640 -1 osd.6 0 log_to_monitors true 2024-09-12T12:11:40.749 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:11:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 -- 172.21.15.103:0/3897820833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68102690 msgr2=0x7f5e68108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/3897820833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68102690 0x7f5e68108f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009ca0 tx=0x7f5e6002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:11:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 -- 172.21.15.103:0/3897820833 shutdown_connections 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/3897820833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68102690 0x7f5e68108f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/3897820833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e68101cd0 0x7f5e68102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/3897820833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68100ad0 0x7f5e68100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 -- 172.21.15.103:0/3897820833 >> 172.21.15.103:0/3897820833 conn(0x7f5e680fc280 msgr2=0x7f5e680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 -- 172.21.15.103:0/3897820833 shutdown_connections 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.200+0000 7f5e6dd98640 1 -- 172.21.15.103:0/3897820833 wait complete. 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 Processor -- start 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 -- start start 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68100ad0 0x7f5e68104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 0x7f5e681030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e68102690 0x7f5e681035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6810c880 con 0x7f5e68102690 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6810c700 con 0x7f5e68101cd0 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.201+0000 7f5e6dd98640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6810ca00 con 0x7f5e68100ad0 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 0x7f5e681030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 0x7f5e681030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58478/0 (socket says 172.21.15.103:58478) 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 -- 172.21.15.103:0/237644484 learned_addr learned my addr 172.21.15.103:0/237644484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e677fe640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68100ad0 0x7f5e68104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e67fff640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e68102690 0x7f5e681035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 -- 172.21.15.103:0/237644484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68100ad0 msgr2=0x7f5e68104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68100ad0 0x7f5e68104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 -- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e68102690 msgr2=0x7f5e681035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e68102690 0x7f5e681035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:11:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 -- 172.21.15.103:0/237644484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e68103eb0 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e66ffd640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 0x7f5e681030b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00e9f0 tx=0x7f5e5c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c00cd80 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e681a20c0 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e5c010930 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c018b00 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.202+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e681a25d0 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.203+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e681a28c0 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.205+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5e5c018ca0 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.205+0000 7f5e64ff9640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5e500a2b80 0x7f5e500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.205+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4648+0+0 (secure 0 0 0) 0x7f5e5c0ce8d0 con 0x7f5e68101cd0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.206+0000 7f5e677fe640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5e500a2b80 0x7f5e500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.206+0000 7f5e677fe640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5e500a2b80 0x7f5e500a5040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e68101b30 tx=0x7f5e5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:11:41.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.211+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5e5c09c030 con 0x7f5e68101cd0 2024-09-12T12:11:41.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:11:41.395+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5e680fe470 con 0x7f5e500a2b80 2024-09-12T12:11:41.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:41.397 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:11:41.397 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.397 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.397 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.397 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.397 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.398 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.398 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:41.398 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:41.398 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.398 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:41.398 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:41.399 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:41.399 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:41.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:41.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:41.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:41.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:41.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:41.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:41.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:41.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:41.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:11:41.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:42.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi081 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:11:42.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:42.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi081 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:11:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:42.859 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:11:42.369+0000 7fc3eb1e3640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T12:11:42.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:11:42.380+0000 7fc3e781d640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi081 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi081 to 5696M 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: osdmap e39: 7 total, 6 up, 7 in 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:11:42.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:11:42.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:11:42.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:43.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:43 smithi103 ceph-mon[35094]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:43.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:43 smithi103 ceph-mon[35094]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:11:43.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:43 smithi103 ceph-mon[35094]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T12:11:43.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:43 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:43.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:43 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:43 smithi173 ceph-mon[35326]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:43 smithi173 ceph-mon[35326]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:11:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:43 smithi173 ceph-mon[35326]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T12:11:43.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:43 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:43.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:43 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:43.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:43 smithi081 ceph-mon[30948]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:43.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:43 smithi081 ceph-mon[30948]: from='osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:11:43.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:43 smithi081 ceph-mon[30948]: osdmap e40: 7 total, 6 up, 7 in 2024-09-12T12:11:43.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:43 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:43.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:43 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] boot 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: osdmap e41: 7 total, 7 up, 7 in 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/4265495306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]: dispatch 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]: dispatch 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]': finished 2024-09-12T12:11:44.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: osdmap e42: 8 total, 7 up, 8 in 2024-09-12T12:11:44.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:11:44.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:44 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/3375735383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:11:44.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:11:44.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:11:44.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] boot 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: osdmap e41: 7 total, 7 up, 7 in 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/4265495306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]: dispatch 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]: dispatch 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]': finished 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: osdmap e42: 8 total, 7 up, 8 in 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:11:44.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:44 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/3375735383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:11:44.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: osd.6 [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] boot 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: osdmap e41: 7 total, 7 up, 7 in 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/4265495306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]: dispatch 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]: dispatch 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9081e5c-accf-4824-9a98-7b13e7037047"}]': finished 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: osdmap e42: 8 total, 7 up, 8 in 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:11:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:44 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/3375735383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:11:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:45 smithi173 ceph-mon[35326]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:45.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:45 smithi103 ceph-mon[35094]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:45 smithi081 ceph-mon[30948]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-12T12:11:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:47 smithi173 ceph-mon[35326]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:47.661 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:47 smithi081 ceph-mon[30948]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:47 smithi103 ceph-mon[35094]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:49 smithi173 ceph-mon[35326]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:49 smithi103 ceph-mon[35094]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:49.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:49 smithi081 ceph-mon[30948]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:51.571 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:51 smithi103 ceph-mon[35094]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:51 smithi173 ceph-mon[35326]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:51.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:51 smithi081 ceph-mon[30948]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:11:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:11:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:52.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T12:11:52.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:11:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:53 smithi173 ceph-mon[35326]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:53 smithi173 ceph-mon[35326]: Deploying daemon osd.7 on smithi103 2024-09-12T12:11:53.665 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:53 smithi103 ceph-mon[35094]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:53.665 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:53 smithi103 ceph-mon[35094]: Deploying daemon osd.7 on smithi103 2024-09-12T12:11:53.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:53 smithi081 ceph-mon[30948]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:53.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:53 smithi081 ceph-mon[30948]: Deploying daemon osd.7 on smithi103 2024-09-12T12:11:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:55 smithi173 ceph-mon[35326]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:55.660 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:55 smithi103 ceph-mon[35094]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:55.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:55 smithi081 ceph-mon[30948]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:57.498 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:57 smithi103 ceph-mon[35094]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:57 smithi173 ceph-mon[35326]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:57.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:57 smithi081 ceph-mon[30948]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:58.596 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:58.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:58.597 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:58.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:58.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:11:58.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:58.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:11:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:11:59 smithi173 ceph-mon[35326]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:59.681 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:11:59 smithi103 ceph-mon[35094]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:11:59.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:11:59 smithi081 ceph-mon[30948]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:01.496 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:01 smithi103 ceph-mon[35094]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:01.496 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.496 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.496 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:01.496 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:01.496 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.535+0000 7f5e64ff9640 1 -- 172.21.15.103:0/237644484 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5e680fe470 con 0x7f5e500a2b80 2024-09-12T12:12:01.536 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 7 on host 'smithi103' 2024-09-12T12:12:01.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5e500a2b80 msgr2=0x7f5e500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:01.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5e500a2b80 0x7f5e500a5040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e68101b30 tx=0x7f5e5800b390 comp rx=0 tx=0).stop 2024-09-12T12:12:01.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 msgr2=0x7f5e681030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 0x7f5e681030b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c00e9f0 tx=0x7f5e5c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 shutdown_connections 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5e500a2b80 0x7f5e500a5040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e68102690 0x7f5e681035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e68101cd0 0x7f5e681030b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 --2- 172.21.15.103:0/237644484 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5e68100ad0 0x7f5e68104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 >> 172.21.15.103:0/237644484 conn(0x7f5e680fc280 msgr2=0x7f5e680fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 shutdown_connections 2024-09-12T12:12:01.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:01.538+0000 7f5e6dd98640 1 -- 172.21.15.103:0/237644484 wait complete. 2024-09-12T12:12:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:01 smithi081 ceph-mon[30948]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:01 smithi173 ceph-mon[35326]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:01.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:01.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:01.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:01.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:02.152 DEBUG:teuthology.orchestra.run.smithi103:osd.7> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T12:12:02.155 INFO:tasks.cephadm:Deploying osd.8 on smithi173 with /dev/vg_nvme/lv_2... 2024-09-12T12:12:02.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T12:12:02.411 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:12:02.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:02.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:02.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:02 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:02.670 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:02.670 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:02.670 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:02 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:02.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:02.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:02.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:02 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:03.584 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:03 smithi173 ceph-mon[35326]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:03.634 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:03 smithi103 ceph-mon[35094]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:03.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:03 smithi081 ceph-mon[30948]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:04 smithi103 ceph-mon[35094]: from='osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:12:04.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:04 smithi103 ceph-mon[35094]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:12:04.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:12:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:12:04.356+0000 7f0302534640 -1 osd.7 0 log_to_monitors true 2024-09-12T12:12:04.754 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:04 smithi173 ceph-mon[35326]: from='osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:12:04.754 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:04 smithi173 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:12:04.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:04 smithi081 ceph-mon[30948]: from='osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:12:04.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:04 smithi081 ceph-mon[30948]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T12:12:04.919 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:12:04.948 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-09-12T12:12:05.199 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: osdmap e43: 8 total, 7 up, 8 in 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:05.578 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:05 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1313135841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18105920 msgr2=0x7fae1810c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:05.660 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1313135841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18105920 0x7fae1810c240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae10009ca0 tx=0x7fae1002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1313135841 shutdown_connections 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1313135841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18105920 0x7fae1810c240 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1313135841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae18104f60 0x7fae181053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1313135841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae18103e00 0x7fae18104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1313135841 >> 172.21.15.173:0/1313135841 conn(0x7fae180ff5b0 msgr2=0x7fae181019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1313135841 shutdown_connections 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1313135841 wait complete. 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 Processor -- start 2024-09-12T12:12:05.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.660+0000 7fae1e5e2640 1 -- start start 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae18103e00 0x7fae1819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 0x7fae1819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae18105920 0x7fae181a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae1810fbf0 con 0x7fae18103e00 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae1810fa70 con 0x7fae18105920 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae1810fd70 con 0x7fae18104f60 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 0x7fae1819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 0x7fae1819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:34662/0 (socket says 172.21.15.173:34662) 2024-09-12T12:12:05.663 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 -- 172.21.15.173:0/1387653285 learned_addr learned my addr 172.21.15.173:0/1387653285 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae17fff640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae18103e00 0x7fae1819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1cb7f640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae18105920 0x7fae181a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 -- 172.21.15.173:0/1387653285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae18105920 msgr2=0x7fae181a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae18105920 0x7fae181a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 -- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae18103e00 msgr2=0x7fae1819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae18103e00 0x7fae1819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 -- 172.21.15.173:0/1387653285 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae181a1d80 con 0x7fae18104f60 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae177fe640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 0x7fae1819a690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00d770 tx=0x7fae0c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c017070 con 0x7fae18104f60 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae0c009c30 con 0x7fae18104f60 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae181a2070 con 0x7fae18104f60 2024-09-12T12:12:05.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.661+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c003e40 con 0x7fae18104f60 2024-09-12T12:12:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.662+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae181a25b0 con 0x7fae18104f60 2024-09-12T12:12:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.662+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1810b0c0 con 0x7fae18104f60 2024-09-12T12:12:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.664+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fae0c003fe0 con 0x7fae18104f60 2024-09-12T12:12:05.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.664+0000 7fae157fa640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fae000a2bb0 0x7fae000a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.664+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5117+0+0 (secure 0 0 0) 0x7fae0c0cdd60 con 0x7fae18104f60 2024-09-12T12:12:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.665+0000 7fae17fff640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fae000a2bb0 0x7fae000a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:05.666 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.665+0000 7fae17fff640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fae000a2bb0 0x7fae000a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae080058c0 tx=0x7fae0800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:05.669 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.669+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae0c009de0 con 0x7fae18104f60 2024-09-12T12:12:05.848 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:05.848+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fae18062630 con 0x7fae000a2bb0 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: osdmap e43: 8 total, 7 up, 8 in 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:05.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:05 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: osdmap e43: 8 total, 7 up, 8 in 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:05.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:05 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:06.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi103 2024-09-12T12:12:06.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:06.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:06 smithi173 ceph-mon[35326]: from='osd.7 ' entity='osd.7' 2024-09-12T12:12:06.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:12:06.238+0000 7f02fdc94640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T12:12:06.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:12:06.252+0000 7f02f62c6640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi103 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:06.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:06 smithi103 ceph-mon[35094]: from='osd.7 ' entity='osd.7' 2024-09-12T12:12:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi103 2024-09-12T12:12:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-12T12:12:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:12:06.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: osdmap e44: 8 total, 7 up, 8 in 2024-09-12T12:12:06.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:06.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:06.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:06.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:06.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:06.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:06 smithi081 ceph-mon[30948]: from='osd.7 ' entity='osd.7' 2024-09-12T12:12:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:12:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:12:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] boot 2024-09-12T12:12:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: osdmap e45: 8 total, 8 up, 8 in 2024-09-12T12:12:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:07 smithi103 ceph-mon[35094]: osdmap e46: 8 total, 8 up, 8 in 2024-09-12T12:12:07.806 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:12:07.806 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:12:07.806 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:07.807 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:07.807 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] boot 2024-09-12T12:12:07.807 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: osdmap e45: 8 total, 8 up, 8 in 2024-09-12T12:12:07.807 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:07.807 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:07 smithi173 ceph-mon[35326]: osdmap e46: 8 total, 8 up, 8 in 2024-09-12T12:12:07.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: osd.7 [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] boot 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: osdmap e45: 8 total, 8 up, 8 in 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:12:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:07 smithi081 ceph-mon[30948]: osdmap e46: 8 total, 8 up, 8 in 2024-09-12T12:12:08.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:08 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/257159430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]: dispatch 2024-09-12T12:12:08.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:08 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]: dispatch 2024-09-12T12:12:08.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:08 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]': finished 2024-09-12T12:12:08.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:08 smithi173 ceph-mon[35326]: osdmap e47: 9 total, 8 up, 9 in 2024-09-12T12:12:08.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:08 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:08.827 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:08 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/257159430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]: dispatch 2024-09-12T12:12:08.827 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:08 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]: dispatch 2024-09-12T12:12:08.827 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:08 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]': finished 2024-09-12T12:12:08.827 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:08 smithi103 ceph-mon[35094]: osdmap e47: 9 total, 8 up, 9 in 2024-09-12T12:12:08.827 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:08 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:08.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:08 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/257159430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]: dispatch 2024-09-12T12:12:08.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:08 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]: dispatch 2024-09-12T12:12:08.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:08 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1b297bd-6351-4c68-b4c1-985906cdbade"}]': finished 2024-09-12T12:12:08.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:08 smithi081 ceph-mon[30948]: osdmap e47: 9 total, 8 up, 9 in 2024-09-12T12:12:08.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:08 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:09 smithi103 ceph-mon[35094]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:09 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/4270779709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:09 smithi103 ceph-mon[35094]: osdmap e48: 9 total, 8 up, 9 in 2024-09-12T12:12:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:09.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:09 smithi081 ceph-mon[30948]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:09 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/4270779709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:09 smithi081 ceph-mon[30948]: osdmap e48: 9 total, 8 up, 9 in 2024-09-12T12:12:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:09 smithi173 ceph-mon[35326]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:09 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/4270779709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:09 smithi173 ceph-mon[35326]: osdmap e48: 9 total, 8 up, 9 in 2024-09-12T12:12:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:11.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:11 smithi081 ceph-mon[30948]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T12:12:11.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:11.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:11 smithi081 ceph-mon[30948]: pgmap v170: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:11.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:11 smithi173 ceph-mon[35326]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T12:12:11.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:11.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:11 smithi173 ceph-mon[35326]: pgmap v170: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:11 smithi103 ceph-mon[35094]: osdmap e49: 9 total, 8 up, 9 in 2024-09-12T12:12:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:11 smithi103 ceph-mon[35094]: pgmap v170: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:13.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:13 smithi081 ceph-mon[30948]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:13.648 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:13 smithi173 ceph-mon[35326]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:13.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:13 smithi103 ceph-mon[35094]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:15.621 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:15 smithi173 ceph-mon[35326]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:15 smithi103 ceph-mon[35094]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:15.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:15 smithi081 ceph-mon[30948]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:17 smithi173 ceph-mon[35326]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:12:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:17 smithi081 ceph-mon[30948]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:12:17.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:17 smithi103 ceph-mon[35094]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T12:12:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:18.501 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:18 smithi173 ceph-mon[35326]: Deploying daemon osd.8 on smithi173 2024-09-12T12:12:18.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:18 smithi103 ceph-mon[35094]: Deploying daemon osd.8 on smithi173 2024-09-12T12:12:18.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:18 smithi081 ceph-mon[30948]: Deploying daemon osd.8 on smithi173 2024-09-12T12:12:19.644 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:19 smithi173 ceph-mon[35326]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:19 smithi103 ceph-mon[35094]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:19.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:19 smithi081 ceph-mon[30948]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:21.565 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:21 smithi173 ceph-mon[35326]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:21 smithi103 ceph-mon[35094]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:21.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:21 smithi081 ceph-mon[30948]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:23 smithi173 ceph-mon[35326]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:23 smithi103 ceph-mon[35094]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:23 smithi081 ceph-mon[30948]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:25 smithi173 ceph-mon[35326]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:25 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:25 smithi103 ceph-mon[35094]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:25 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:25 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:25 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:25 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:25 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:25 smithi081 ceph-mon[30948]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:25 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.043+0000 7fae157fa640 1 -- 172.21.15.173:0/1387653285 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fae18062630 con 0x7fae000a2bb0 2024-09-12T12:12:26.044 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 8 on host 'smithi173' 2024-09-12T12:12:26.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fae000a2bb0 msgr2=0x7fae000a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fae000a2bb0 0x7fae000a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae080058c0 tx=0x7fae0800a250 comp rx=0 tx=0).stop 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 msgr2=0x7fae1819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 0x7fae1819a690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00d770 tx=0x7fae0c00dc30 comp rx=0 tx=0).stop 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 shutdown_connections 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fae000a2bb0 0x7fae000a5070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae18105920 0x7fae181a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae18104f60 0x7fae1819a690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 --2- 172.21.15.173:0/1387653285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae18103e00 0x7fae1819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 >> 172.21.15.173:0/1387653285 conn(0x7fae180ff5b0 msgr2=0x7fae18108290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 shutdown_connections 2024-09-12T12:12:26.047 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:12:26.046+0000 7fae1e5e2640 1 -- 172.21.15.173:0/1387653285 wait complete. 2024-09-12T12:12:26.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:26.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.684 DEBUG:teuthology.orchestra.run.smithi173:osd.8> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T12:12:26.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:26.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.687 INFO:tasks.cephadm:Deploying osd.9 on smithi081 with /dev/vg_nvme/lv_1... 2024-09-12T12:12:26.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:12:26.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:26.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:12:27.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:27 smithi081 ceph-mon[30948]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:27 smithi173 ceph-mon[35326]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:27 smithi103 ceph-mon[35094]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:28.869 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:12:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:12:28.466+0000 7faa3dc22640 -1 osd.8 0 log_to_monitors true 2024-09-12T12:12:29.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:29 smithi173 ceph-mon[35326]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:29.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:29 smithi173 ceph-mon[35326]: from='osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:12:29.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:29 smithi173 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:12:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:12:29.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-09-12T12:12:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:29 smithi103 ceph-mon[35094]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:29 smithi103 ceph-mon[35094]: from='osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:12:29.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:29 smithi103 ceph-mon[35094]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:12:29.830 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:29 smithi081 ceph-mon[30948]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:29.830 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:29 smithi081 ceph-mon[30948]: from='osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:12:29.830 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:29 smithi081 ceph-mon[30948]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T12:12:29.861 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:12:30.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 -- 172.21.15.81:0/1395936947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554102690 msgr2=0x7fa554108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/1395936947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554102690 0x7fa554108f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009ca0 tx=0x7fa54c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 -- 172.21.15.81:0/1395936947 shutdown_connections 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/1395936947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554102690 0x7fa554108f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/1395936947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 0x7fa554102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/1395936947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa554100ad0 0x7fa554100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 -- 172.21.15.81:0/1395936947 >> 172.21.15.81:0/1395936947 conn(0x7fa5540fc280 msgr2=0x7fa5540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:30.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 -- 172.21.15.81:0/1395936947 shutdown_connections 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.278+0000 7fa55bbd6640 1 -- 172.21.15.81:0/1395936947 wait complete. 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 Processor -- start 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 -- start start 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 0x7fa554196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 0x7fa554197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa554102690 0x7fa55419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:30.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa55410c890 con 0x7fa554100ad0 2024-09-12T12:12:30.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa55410c710 con 0x7fa554102690 2024-09-12T12:12:30.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55bbd6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa55410ca10 con 0x7fa554101cd0 2024-09-12T12:12:30.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559972640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 0x7fa554196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:30.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559972640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 0x7fa554196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59390/0 (socket says 172.21.15.81:59390) 2024-09-12T12:12:30.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559972640 1 -- 172.21.15.81:0/3916708274 learned_addr learned my addr 172.21.15.81:0/3916708274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:12:30.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559171640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 0x7fa554197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa55a173640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa554102690 0x7fa55419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559171640 1 -- 172.21.15.81:0/3916708274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa554102690 msgr2=0x7fa55419e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559171640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa554102690 0x7fa55419e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559171640 1 -- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 msgr2=0x7fa554196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559171640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 0x7fa554196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559171640 1 -- 172.21.15.81:0/3916708274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55419ea40 con 0x7fa554101cd0 2024-09-12T12:12:30.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.279+0000 7fa559972640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 0x7fa554196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.280+0000 7fa559171640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 0x7fa554197350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa55000e9f0 tx=0x7fa55000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.280+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55000cd80 con 0x7fa554101cd0 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.280+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa554069fd0 con 0x7fa554101cd0 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.280+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5500035f0 con 0x7fa554101cd0 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.280+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550010650 con 0x7fa554101cd0 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.280+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55406a560 con 0x7fa554101cd0 2024-09-12T12:12:30.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.281+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa554107870 con 0x7fa554101cd0 2024-09-12T12:12:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.282+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa5500037a0 con 0x7fa554101cd0 2024-09-12T12:12:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.283+0000 7fa54affd640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5400a2bb0 0x7fa5400a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.283+0000 7fa559972640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5400a2bb0 0x7fa5400a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.283+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5533+0+0 (secure 0 0 0) 0x7fa5500ce960 con 0x7fa554101cd0 2024-09-12T12:12:30.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.283+0000 7fa559972640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5400a2bb0 0x7fa5400a5070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5440058c0 tx=0x7fa544010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:30.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.286+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa55009c300 con 0x7fa554101cd0 2024-09-12T12:12:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:30.468+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa55406a820 con 0x7fa5400a2bb0 2024-09-12T12:12:30.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:12:30.396+0000 7faa39382640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T12:12:30.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:12:30.405+0000 7faa359bc640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:30.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:30.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:30 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:12:30.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:30.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:30 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: osdmap e50: 9 total, 8 up, 9 in 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.838 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:30.839 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:30 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi173 2024-09-12T12:12:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi173 2024-09-12T12:12:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-12T12:12:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:12:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:12:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi173 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi173 to 5696M 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: osdmap e51: 9 total, 8 up, 9 in 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:32.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:12:32.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:12:32.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:32.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:32.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] boot 2024-09-12T12:12:32.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: osdmap e52: 9 total, 9 up, 9 in 2024-09-12T12:12:32.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:32 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:12:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:12:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] boot 2024-09-12T12:12:32.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: osdmap e52: 9 total, 9 up, 9 in 2024-09-12T12:12:32.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:32 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: osd.8 [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] boot 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: osdmap e52: 9 total, 9 up, 9 in 2024-09-12T12:12:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:32 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:12:33.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: pgmap v184: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:33.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: osdmap e53: 9 total, 9 up, 9 in 2024-09-12T12:12:33.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/777451057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bdbbf2c-ec45-4561-b86a-93e24b7a8359"}]: dispatch 2024-09-12T12:12:33.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/777451057' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bdbbf2c-ec45-4561-b86a-93e24b7a8359"}]': finished 2024-09-12T12:12:33.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: osdmap e54: 10 total, 9 up, 10 in 2024-09-12T12:12:33.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:33.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: osdmap e55: 10 total, 9 up, 10 in 2024-09-12T12:12:33.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:33.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:33 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1138748727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:33.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: pgmap v184: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: osdmap e53: 9 total, 9 up, 9 in 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/777451057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bdbbf2c-ec45-4561-b86a-93e24b7a8359"}]: dispatch 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/777451057' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bdbbf2c-ec45-4561-b86a-93e24b7a8359"}]': finished 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: osdmap e54: 10 total, 9 up, 10 in 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: osdmap e55: 10 total, 9 up, 10 in 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:33 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1138748727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: pgmap v184: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T12:12:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: osdmap e53: 9 total, 9 up, 9 in 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/777451057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bdbbf2c-ec45-4561-b86a-93e24b7a8359"}]: dispatch 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/777451057' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bdbbf2c-ec45-4561-b86a-93e24b7a8359"}]': finished 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: osdmap e54: 10 total, 9 up, 10 in 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: osdmap e55: 10 total, 9 up, 10 in 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:33 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1138748727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:35.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:35 smithi103 ceph-mon[35094]: osdmap e56: 10 total, 9 up, 10 in 2024-09-12T12:12:35.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:35 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:35.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:35 smithi103 ceph-mon[35094]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:35.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:35 smithi081 ceph-mon[30948]: osdmap e56: 10 total, 9 up, 10 in 2024-09-12T12:12:35.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:35 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:35.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:35 smithi081 ceph-mon[30948]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:35 smithi173 ceph-mon[35326]: osdmap e56: 10 total, 9 up, 10 in 2024-09-12T12:12:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:35 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:35 smithi173 ceph-mon[35326]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:37 smithi173 ceph-mon[35326]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:37 smithi103 ceph-mon[35094]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:37.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:37 smithi081 ceph-mon[30948]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:39 smithi173 ceph-mon[35326]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T12:12:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:39 smithi103 ceph-mon[35094]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T12:12:39.687 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:39 smithi081 ceph-mon[30948]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-12T12:12:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:41 smithi173 ceph-mon[35326]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:12:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:41 smithi103 ceph-mon[35094]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:12:41.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:41 smithi081 ceph-mon[30948]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T12:12:42.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:12:42.863 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:42.864 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:12:42.864 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:42.864 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T12:12:42.865 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:43.651 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:43 smithi081 ceph-mon[30948]: Deploying daemon osd.9 on smithi081 2024-09-12T12:12:43.651 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:43 smithi081 ceph-mon[30948]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-12T12:12:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:43 smithi173 ceph-mon[35326]: Deploying daemon osd.9 on smithi081 2024-09-12T12:12:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:43 smithi173 ceph-mon[35326]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-12T12:12:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:43 smithi103 ceph-mon[35094]: Deploying daemon osd.9 on smithi081 2024-09-12T12:12:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:43 smithi103 ceph-mon[35094]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-12T12:12:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:45 smithi173 ceph-mon[35326]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-12T12:12:45.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:45 smithi103 ceph-mon[35094]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-12T12:12:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:45 smithi081 ceph-mon[30948]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-12T12:12:47.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:47 smithi081 ceph-mon[30948]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:12:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:47 smithi173 ceph-mon[35326]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:12:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:47 smithi103 ceph-mon[35094]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:12:48.530 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:48.530 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:48.530 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:48 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:48.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:48.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:48.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:48 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:48 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:49.482 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:49 smithi081 ceph-mon[30948]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:12:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:49 smithi173 ceph-mon[35326]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:12:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:49 smithi103 ceph-mon[35094]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:12:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.984+0000 7fa54affd640 1 -- 172.21.15.81:0/3916708274 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa55406a820 con 0x7fa5400a2bb0 2024-09-12T12:12:50.985 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 9 on host 'smithi081' 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5400a2bb0 msgr2=0x7fa5400a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5400a2bb0 0x7fa5400a5070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5440058c0 tx=0x7fa544010040 comp rx=0 tx=0).stop 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 msgr2=0x7fa554197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 0x7fa554197350 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa55000e9f0 tx=0x7fa55000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 shutdown_connections 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5400a2bb0 0x7fa5400a5070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa554102690 0x7fa55419e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa554101cd0 0x7fa554197350 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 --2- 172.21.15.81:0/3916708274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa554100ad0 0x7fa554196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.986+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 >> 172.21.15.81:0/3916708274 conn(0x7fa5540fc280 msgr2=0x7fa554104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.987+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 shutdown_connections 2024-09-12T12:12:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:12:50.987+0000 7fa55bbd6640 1 -- 172.21.15.81:0/3916708274 wait complete. 2024-09-12T12:12:51.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:51.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:51.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:51.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:51.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:51 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:51 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:51 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:51.767 DEBUG:teuthology.orchestra.run.smithi081:osd.9> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T12:12:51.770 INFO:tasks.cephadm:Deploying osd.10 on smithi103 with /dev/vg_nvme/lv_1... 2024-09-12T12:12:51.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:12:52.027 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:12:53.392 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:53 smithi103 ceph-mon[35094]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:53.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:53 smithi081 ceph-mon[30948]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:53 smithi173 ceph-mon[35326]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:54.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:12:53 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:12:53.819+0000 7f4a7c7c5640 -1 osd.9 0 log_to_monitors true 2024-09-12T12:12:54.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:54 smithi103 ceph-mon[35094]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:12:54.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T12:12:54.515 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2024-09-12T12:12:54.580 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:54 smithi081 ceph-mon[30948]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:12:54.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:54 smithi173 ceph-mon[35326]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T12:12:54.775 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:12:55.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/2950038464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4107970 msgr2=0x7fc6c4109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:55.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/2950038464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4107970 0x7fc6c4109d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009ca0 tx=0x7fc6bc02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/2950038464 shutdown_connections 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/2950038464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4107970 0x7fc6c4109d60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/2950038464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c4105040 0x7fc6c4107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/2950038464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6c4102710 0x7fc6c4104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/2950038464 >> 172.21.15.103:0/2950038464 conn(0x7fc6c40fc270 msgr2=0x7fc6c40fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/2950038464 shutdown_connections 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.216+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/2950038464 wait complete. 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 Processor -- start 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 -- start start 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c4102710 0x7fc6c419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:55.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 0x7fc6c419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6c4107970 0x7fc6c41a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410d9e0 con 0x7fc6c4102710 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410d860 con 0x7fc6c4105040 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6cbb4c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c410db60 con 0x7fc6c4107970 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 0x7fc6c419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 0x7fc6c419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59512/0 (socket says 172.21.15.103:59512) 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 -- 172.21.15.103:0/1742994300 learned_addr learned my addr 172.21.15.103:0/1742994300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c98e8640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c4102710 0x7fc6c419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6ca0e9640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6c4107970 0x7fc6c41a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 -- 172.21.15.103:0/1742994300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6c4107970 msgr2=0x7fc6c41a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6c4107970 0x7fc6c41a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:55.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 -- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c4102710 msgr2=0x7fc6c419a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c4102710 0x7fc6c419a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 -- 172.21.15.103:0/1742994300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c41a1e60 con 0x7fc6c4105040 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.217+0000 7fc6c90e7640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 0x7fc6c419a770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000d770 tx=0x7fc6c000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.218+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0017070 con 0x7fc6c4105040 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.218+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc6c0009c30 con 0x7fc6c4105040 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.218+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000f6b0 con 0x7fc6c4105040 2024-09-12T12:12:55.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.218+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c41a2150 con 0x7fc6c4105040 2024-09-12T12:12:55.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.218+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c41a2640 con 0x7fc6c4105040 2024-09-12T12:12:55.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.219+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c4109460 con 0x7fc6c4105040 2024-09-12T12:12:55.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.220+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc6c001a070 con 0x7fc6c4105040 2024-09-12T12:12:55.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.221+0000 7fc6baffd640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc6b00a2c30 0x7fc6b00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:12:55.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.221+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5965+0+0 (secure 0 0 0) 0x7fc6c00ce240 con 0x7fc6c4105040 2024-09-12T12:12:55.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.221+0000 7fc6c98e8640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc6b00a2c30 0x7fc6b00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:12:55.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.221+0000 7fc6c98e8640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc6b00a2c30 0x7fc6b00a50f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4005fd0 tx=0x7fc6b4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:12:55.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.228+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6c009bb50 con 0x7fc6c4105040 2024-09-12T12:12:55.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:12:55.408+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc6c4062630 con 0x7fc6b00a2c30 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.409 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.410 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:55.410 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:55.410 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:55.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:12:55.377+0000 7f4a77f25640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T12:12:55.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:12:55.394+0000 7f4a7455f640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: osdmap e57: 10 total, 9 up, 10 in 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:12:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:12:56.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi081 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:56.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:56 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:56.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi081 2024-09-12T12:12:56.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:56.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:56 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:56.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi081 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi081 to 4272M 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: osdmap e58: 10 total, 9 up, 10 in 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:12:56.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:56 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:12:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:12:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:12:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] boot 2024-09-12T12:12:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: osdmap e59: 10 total, 10 up, 10 in 2024-09-12T12:12:57.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:57 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:12:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:12:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] boot 2024-09-12T12:12:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: osdmap e59: 10 total, 10 up, 10 in 2024-09-12T12:12:57.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:57 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:57.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:12:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:12:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-12T12:12:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: osd.9 [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] boot 2024-09-12T12:12:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: osdmap e59: 10 total, 10 up, 10 in 2024-09-12T12:12:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:57 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:12:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: osdmap e60: 10 total, 10 up, 10 in 2024-09-12T12:12:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/1630882562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]: dispatch 2024-09-12T12:12:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]: dispatch 2024-09-12T12:12:58.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]': finished 2024-09-12T12:12:58.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: osdmap e61: 11 total, 10 up, 11 in 2024-09-12T12:12:58.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:12:58.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:58 smithi173 ceph-mon[35326]: from='client.? 172.21.15.103:0/2770875148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:58.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: osdmap e60: 10 total, 10 up, 10 in 2024-09-12T12:12:58.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/1630882562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]: dispatch 2024-09-12T12:12:58.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]: dispatch 2024-09-12T12:12:58.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]': finished 2024-09-12T12:12:58.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: osdmap e61: 11 total, 10 up, 11 in 2024-09-12T12:12:58.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:12:58.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:58 smithi103 ceph-mon[35094]: from='client.? 172.21.15.103:0/2770875148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:58.797 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: osdmap e60: 10 total, 10 up, 10 in 2024-09-12T12:12:58.797 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/1630882562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]: dispatch 2024-09-12T12:12:58.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]: dispatch 2024-09-12T12:12:58.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8bad4f9-e18c-4226-bb8e-30a1a5a80985"}]': finished 2024-09-12T12:12:58.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: osdmap e61: 11 total, 10 up, 11 in 2024-09-12T12:12:58.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:12:58.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:58 smithi081 ceph-mon[30948]: from='client.? 172.21.15.103:0/2770875148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:12:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:12:59 smithi173 ceph-mon[35326]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:12:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:12:59 smithi103 ceph-mon[35094]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:12:59.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:12:59 smithi081 ceph-mon[30948]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:01 smithi173 ceph-mon[35326]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:01 smithi103 ceph-mon[35094]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:01.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:01 smithi081 ceph-mon[30948]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:03.538 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:03 smithi103 ceph-mon[35094]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:03.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:03 smithi081 ceph-mon[30948]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:03 smithi173 ceph-mon[35326]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:05.657 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:05 smithi103 ceph-mon[35094]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:05 smithi081 ceph-mon[30948]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:05 smithi173 ceph-mon[35326]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:07 smithi103 ceph-mon[35094]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:13:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:07 smithi081 ceph-mon[30948]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:13:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:07 smithi173 ceph-mon[35326]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T12:13:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:08.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:08 smithi173 ceph-mon[35326]: Deploying daemon osd.10 on smithi103 2024-09-12T12:13:08.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:08 smithi103 ceph-mon[35094]: Deploying daemon osd.10 on smithi103 2024-09-12T12:13:08.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:08 smithi081 ceph-mon[30948]: Deploying daemon osd.10 on smithi103 2024-09-12T12:13:09.576 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:09 smithi103 ceph-mon[35094]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:09.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:09 smithi081 ceph-mon[30948]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:09 smithi173 ceph-mon[35326]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:11 smithi103 ceph-mon[35094]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:11.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:11 smithi081 ceph-mon[30948]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:11.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:11 smithi173 ceph-mon[35326]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:12.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:12.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:12.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:13 smithi103 ceph-mon[35094]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:13.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:13 smithi081 ceph-mon[30948]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:13 smithi173 ceph-mon[35326]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.678+0000 7fc6baffd640 1 -- 172.21.15.103:0/1742994300 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc6c4062630 con 0x7fc6b00a2c30 2024-09-12T12:13:15.679 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 10 on host 'smithi103' 2024-09-12T12:13:15.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:15 smithi103 ceph-mon[35094]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:15.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:15 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:15 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:15 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:15.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:15 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:15.680 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:15 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc6b00a2c30 msgr2=0x7fc6b00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc6b00a2c30 0x7fc6b00a50f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4005fd0 tx=0x7fc6b4005850 comp rx=0 tx=0).stop 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 msgr2=0x7fc6c419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 0x7fc6c419a770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000d770 tx=0x7fc6c000dc30 comp rx=0 tx=0).stop 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 shutdown_connections 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc6b00a2c30 0x7fc6b00a50f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6c4107970 0x7fc6c41a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6c4105040 0x7fc6c419a770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 --2- 172.21.15.103:0/1742994300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c4102710 0x7fc6c419a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 >> 172.21.15.103:0/1742994300 conn(0x7fc6c40fc270 msgr2=0x7fc6c4101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 shutdown_connections 2024-09-12T12:13:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T12:13:15.681+0000 7fc6cbb4c640 1 -- 172.21.15.103:0/1742994300 wait complete. 2024-09-12T12:13:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:15 smithi081 ceph-mon[30948]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:15.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:15.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:15 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:15 smithi173 ceph-mon[35326]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:15 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:15 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:15 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:15 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:15.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:15 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:16.279 DEBUG:teuthology.orchestra.run.smithi103:osd.10> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T12:13:16.282 INFO:tasks.cephadm:Deploying osd.11 on smithi173 with /dev/vg_nvme/lv_1... 2024-09-12T12:13:16.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T12:13:16.514 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:16.515 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:16.515 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:16 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:16.539 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:13:16.652 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:16.652 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:16.652 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:16 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:16.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:16.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:16.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:16 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:17.501 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:17 smithi103 ceph-mon[35094]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:17 smithi173 ceph-mon[35326]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:17.761 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:17 smithi081 ceph-mon[30948]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:18.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:18 smithi173 ceph-mon[35326]: from='osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:13:18.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:18 smithi173 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:13:18.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:18 smithi103 ceph-mon[35094]: from='osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:13:18.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:18 smithi103 ceph-mon[35094]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:13:18.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:13:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:13:18.401+0000 7feceddca640 -1 osd.10 0 log_to_monitors true 2024-09-12T12:13:18.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:18 smithi081 ceph-mon[30948]: from='osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:13:18.777 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:18 smithi081 ceph-mon[30948]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T12:13:19.302 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-09-12T12:13:19.327 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2024-09-12T12:13:19.587 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:13:19.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:19.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:13:19.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: osdmap e62: 11 total, 10 up, 11 in 2024-09-12T12:13:19.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:19.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:13:19.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:13:19.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:19.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:19.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:19 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: osdmap e62: 11 total, 10 up, 11 in 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:19.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:19.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:19 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:13:19.464+0000 7fece952a640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T12:13:19.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:13:19.475+0000 7fece5b64640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:13:19.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:19.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T12:13:19.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: osdmap e62: 11 total, 10 up, 11 in 2024-09-12T12:13:19.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:19.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:19.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:19.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:19.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:19 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 -- 172.21.15.173:0/1549099709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701037c0 msgr2=0x7f547010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 --2- 172.21.15.173:0/1549099709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701037c0 0x7f547010a050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5468009ca0 tx=0x7f546802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:13:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 -- 172.21.15.173:0/1549099709 shutdown_connections 2024-09-12T12:13:20.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 --2- 172.21.15.173:0/1549099709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54701037c0 0x7f547010a050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 --2- 172.21.15.173:0/1549099709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470102e00 0x7f5470103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 --2- 172.21.15.173:0/1549099709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5470101c00 0x7f5470102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.035+0000 7f5477030640 1 -- 172.21.15.173:0/1549099709 >> 172.21.15.173:0/1549099709 conn(0x7f54700fd390 msgr2=0x7f54700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.036+0000 7f5477030640 1 -- 172.21.15.173:0/1549099709 shutdown_connections 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.036+0000 7f5477030640 1 -- 172.21.15.173:0/1549099709 wait complete. 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.036+0000 7f5477030640 1 Processor -- start 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.036+0000 7f5477030640 1 -- start start 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.036+0000 7f5477030640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 0x7f547019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.036+0000 7f5477030640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470102e00 0x7f547019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5477030640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54701037c0 0x7f54701a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5477030640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f547010da40 con 0x7f5470102e00 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5477030640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f547010d8c0 con 0x7f54701037c0 2024-09-12T12:13:20.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5477030640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f547010dbc0 con 0x7f5470101c00 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 0x7f547019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 0x7f547019a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:42662/0 (socket says 172.21.15.173:42662) 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 -- 172.21.15.173:0/2619858259 learned_addr learned my addr 172.21.15.173:0/2619858259 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f546ffff640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470102e00 0x7f547019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f54755cd640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54701037c0 0x7f54701a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 -- 172.21.15.173:0/2619858259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54701037c0 msgr2=0x7f54701a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54701037c0 0x7f54701a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 -- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470102e00 msgr2=0x7f547019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470102e00 0x7f547019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 -- 172.21.15.173:0/2619858259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54701a1c70 con 0x7f5470101c00 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5474dcc640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 0x7f547019a040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f546400d950 tx=0x7f546400dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464017070 con 0x7f5470101c00 2024-09-12T12:13:20.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54701a1f60 con 0x7f5470101c00 2024-09-12T12:13:20.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f546400be10 con 0x7f5470101c00 2024-09-12T12:13:20.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.037+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400f6b0 con 0x7f5470101c00 2024-09-12T12:13:20.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.038+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54701a2430 con 0x7f5470101c00 2024-09-12T12:13:20.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.039+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54701932a0 con 0x7f5470101c00 2024-09-12T12:13:20.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.040+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f546401a070 con 0x7f5470101c00 2024-09-12T12:13:20.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.040+0000 7f546dffb640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54600a2c30 0x7f54600a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:20.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.041+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6414+0+0 (secure 0 0 0) 0x7f54640ce1f0 con 0x7f5470101c00 2024-09-12T12:13:20.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.041+0000 7f546ffff640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54600a2c30 0x7f54600a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:20.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.041+0000 7f546ffff640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54600a2c30 0x7f54600a50f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f547019b560 tx=0x7f545c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:20.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.044+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f546409b940 con 0x7f5470101c00 2024-09-12T12:13:20.217 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:20.217+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5470193bd0 con 0x7f54600a2c30 2024-09-12T12:13:20.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi103 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:20 smithi081 ceph-mon[30948]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:20.863 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi103 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:20.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:20 smithi173 ceph-mon[35326]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:20.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi103 2024-09-12T12:13:20.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-12T12:13:20.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: osdmap e63: 11 total, 10 up, 11 in 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:20 smithi103 ceph-mon[35094]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-12T12:13:21.651 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:21 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:13:21.651 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:21 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:13:21.651 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:21 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:21.651 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:21 smithi173 ceph-mon[35326]: osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] boot 2024-09-12T12:13:21.651 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:21 smithi173 ceph-mon[35326]: osdmap e64: 11 total, 11 up, 11 in 2024-09-12T12:13:21.651 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:21 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:21.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:21 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:13:21.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:21 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:13:21.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:21 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:21.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:21 smithi081 ceph-mon[30948]: osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] boot 2024-09-12T12:13:21.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:21 smithi081 ceph-mon[30948]: osdmap e64: 11 total, 11 up, 11 in 2024-09-12T12:13:21.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:21 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:21.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:21 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:13:21.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:21 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:13:21.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:21 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:21.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:21 smithi103 ceph-mon[35094]: osd.10 [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] boot 2024-09-12T12:13:21.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:21 smithi103 ceph-mon[35094]: osdmap e64: 11 total, 11 up, 11 in 2024-09-12T12:13:21.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:21 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:13:22.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:22 smithi173 ceph-mon[35326]: osdmap e65: 11 total, 11 up, 11 in 2024-09-12T12:13:22.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:22 smithi173 ceph-mon[35326]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:22.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:22 smithi173 ceph-mon[35326]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T12:13:22.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:22 smithi081 ceph-mon[30948]: osdmap e65: 11 total, 11 up, 11 in 2024-09-12T12:13:22.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:22 smithi081 ceph-mon[30948]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:22.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:22 smithi081 ceph-mon[30948]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T12:13:22.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:22 smithi103 ceph-mon[35094]: osdmap e65: 11 total, 11 up, 11 in 2024-09-12T12:13:22.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:22 smithi103 ceph-mon[35094]: pgmap v222: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:22.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:22 smithi103 ceph-mon[35094]: osdmap e66: 11 total, 11 up, 11 in 2024-09-12T12:13:23.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:23 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/1128090536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]: dispatch 2024-09-12T12:13:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:23 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]: dispatch 2024-09-12T12:13:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:23 smithi081 ceph-mon[30948]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]': finished 2024-09-12T12:13:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:23 smithi081 ceph-mon[30948]: osdmap e67: 12 total, 11 up, 12 in 2024-09-12T12:13:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:23 smithi081 ceph-mon[30948]: from='client.? 172.21.15.173:0/2031434285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:13:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:23 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/1128090536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]: dispatch 2024-09-12T12:13:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:23 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]: dispatch 2024-09-12T12:13:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:23 smithi173 ceph-mon[35326]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]': finished 2024-09-12T12:13:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:23 smithi173 ceph-mon[35326]: osdmap e67: 12 total, 11 up, 12 in 2024-09-12T12:13:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:23.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:23 smithi173 ceph-mon[35326]: from='client.? 172.21.15.173:0/2031434285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:13:23.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:23 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/1128090536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]: dispatch 2024-09-12T12:13:23.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:23 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]: dispatch 2024-09-12T12:13:23.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:23 smithi103 ceph-mon[35094]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73635e20-81fb-4323-ba44-febfdf20688f"}]': finished 2024-09-12T12:13:23.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:23 smithi103 ceph-mon[35094]: osdmap e67: 12 total, 11 up, 12 in 2024-09-12T12:13:23.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:23.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:23 smithi103 ceph-mon[35094]: from='client.? 172.21.15.173:0/2031434285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T12:13:24.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:24 smithi173 ceph-mon[35326]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T12:13:24.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:24 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:24.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:24 smithi173 ceph-mon[35326]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:24.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:24 smithi103 ceph-mon[35094]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T12:13:24.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:24 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:24.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:24 smithi103 ceph-mon[35094]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:24 smithi081 ceph-mon[30948]: osdmap e68: 12 total, 11 up, 12 in 2024-09-12T12:13:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:24 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:24 smithi081 ceph-mon[30948]: pgmap v226: 1 pgs: 1 remapped+peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:27.637 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:27 smithi103 ceph-mon[35094]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:27 smithi173 ceph-mon[35326]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:27.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:27 smithi081 ceph-mon[30948]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:29.454 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:29 smithi173 ceph-mon[35326]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:13:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:29 smithi103 ceph-mon[35094]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:13:29.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:29 smithi081 ceph-mon[30948]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T12:13:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:31 smithi173 ceph-mon[35326]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-12T12:13:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:31 smithi103 ceph-mon[35094]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-12T12:13:31.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:31 smithi081 ceph-mon[30948]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-12T12:13:32.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:32 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:13:32.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:32 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:32 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:13:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:32 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:32.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:32 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T12:13:32.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:32 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:33 smithi173 ceph-mon[35326]: Deploying daemon osd.11 on smithi173 2024-09-12T12:13:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:33 smithi173 ceph-mon[35326]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T12:13:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:33 smithi103 ceph-mon[35094]: Deploying daemon osd.11 on smithi173 2024-09-12T12:13:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:33 smithi103 ceph-mon[35094]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T12:13:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:33 smithi081 ceph-mon[30948]: Deploying daemon osd.11 on smithi173 2024-09-12T12:13:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:33 smithi081 ceph-mon[30948]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T12:13:35.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:35 smithi173 ceph-mon[35326]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T12:13:35.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:35 smithi103 ceph-mon[35094]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T12:13:35.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:35 smithi081 ceph-mon[30948]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-12T12:13:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:37 smithi173 ceph-mon[35326]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:13:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:37 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:37 smithi103 ceph-mon[35094]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:13:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:37 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:37.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:37 smithi081 ceph-mon[30948]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:13:37.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:37.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:37.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:37 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:39.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:39 smithi173 ceph-mon[35326]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:13:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:39 smithi103 ceph-mon[35094]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:13:39.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:39 smithi081 ceph-mon[30948]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T12:13:40.152 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.151+0000 7f546dffb640 1 -- 172.21.15.173:0/2619858259 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5470193bd0 con 0x7f54600a2c30 2024-09-12T12:13:40.153 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 11 on host 'smithi173' 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54600a2c30 msgr2=0x7f54600a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54600a2c30 0x7f54600a50f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f547019b560 tx=0x7f545c009110 comp rx=0 tx=0).stop 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 msgr2=0x7f547019a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 0x7f547019a040 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f546400d950 tx=0x7f546400dd50 comp rx=0 tx=0).stop 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 shutdown_connections 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54600a2c30 0x7f54600a50f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54701037c0 0x7f54701a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5470102e00 0x7f547019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 --2- 172.21.15.173:0/2619858259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5470101c00 0x7f547019a040 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:40.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 >> 172.21.15.173:0/2619858259 conn(0x7f54700fd390 msgr2=0x7f54700ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:40.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 shutdown_connections 2024-09-12T12:13:40.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:40.154+0000 7f5477030640 1 -- 172.21.15.173:0/2619858259 wait complete. 2024-09-12T12:13:40.864 DEBUG:teuthology.orchestra.run.smithi173:osd.11> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T12:13:40.867 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T12:13:40.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:13:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:41.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:41.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:41 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:41.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:41 smithi173 ceph-mon[35326]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:41.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:41.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:41 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:41.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:41 smithi103 ceph-mon[35094]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:41.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:41.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:41 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:41.499 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:41 smithi081 ceph-mon[30948]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:41.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 -- 172.21.15.81:0/2636721427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 msgr2=0x7fc86c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 --2- 172.21.15.81:0/2636721427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c102150 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009900 tx=0x7fc85c02a410 comp rx=0 tx=0).stop 2024-09-12T12:13:41.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 -- 172.21.15.81:0/2636721427 shutdown_connections 2024-09-12T12:13:41.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 --2- 172.21.15.81:0/2636721427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc86c102690 0x7fc86c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 --2- 172.21.15.81:0/2636721427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c102150 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 --2- 172.21.15.81:0/2636721427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c100ad0 0x7fc86c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 -- 172.21.15.81:0/2636721427 >> 172.21.15.81:0/2636721427 conn(0x7fc86c0fc280 msgr2=0x7fc86c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:41.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 -- 172.21.15.81:0/2636721427 shutdown_connections 2024-09-12T12:13:41.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.581+0000 7fc873bc2640 1 -- 172.21.15.81:0/2636721427 wait complete. 2024-09-12T12:13:41.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 Processor -- start 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 -- start start 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc86c100ad0 0x7fc86c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102690 0x7fc86c19f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c10c890 con 0x7fc86c101cd0 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c10c710 con 0x7fc86c100ad0 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.582+0000 7fc873bc2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c10ca10 con 0x7fc86c102690 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87115d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87115d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40942/0 (socket says 172.21.15.81:40942) 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87115d640 1 -- 172.21.15.81:0/734525754 learned_addr learned my addr 172.21.15.81:0/734525754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:41.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102690 0x7fc86c19f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87195e640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc86c100ad0 0x7fc86c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 -- 172.21.15.81:0/734525754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc86c100ad0 msgr2=0x7fc86c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc86c100ad0 0x7fc86c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 -- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 msgr2=0x7fc86c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 -- 172.21.15.81:0/734525754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86c19fbf0 con 0x7fc86c102690 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87115d640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc87215f640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102690 0x7fc86c19f2e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc86400cab0 tx=0x7fc86400cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86400ae20 con 0x7fc86c102690 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86c196af0 con 0x7fc86c102690 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc86400f950 con 0x7fc86c102690 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864018bd0 con 0x7fc86c102690 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.583+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86c197000 con 0x7fc86c102690 2024-09-12T12:13:41.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.584+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86c100ed0 con 0x7fc86c102690 2024-09-12T12:13:41.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.586+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc86400fb00 con 0x7fc86c102690 2024-09-12T12:13:41.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.586+0000 7fc862ffd640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc8580a2b80 0x7fc8580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:41.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.586+0000 7fc87195e640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc8580a2b80 0x7fc8580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:41.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.586+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6809+0+0 (secure 0 0 0) 0x7fc8640cf1e0 con 0x7fc86c102690 2024-09-12T12:13:41.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.587+0000 7fc87195e640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc8580a2b80 0x7fc8580a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc86c101b30 tx=0x7fc868005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:41.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.589+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc864014030 con 0x7fc86c102690 2024-09-12T12:13:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.762+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc86c107e50 con 0x7fc86c102690 2024-09-12T12:13:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.762+0000 7fc862ffd640 1 -- 172.21.15.81:0/734525754 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fc86409c680 con 0x7fc86c102690 2024-09-12T12:13:41.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc8580a2b80 msgr2=0x7fc8580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc8580a2b80 0x7fc8580a5040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc86c101b30 tx=0x7fc868005f90 comp rx=0 tx=0).stop 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102690 msgr2=0x7fc86c19f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102690 0x7fc86c19f2e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc86400cab0 tx=0x7fc86400cf70 comp rx=0 tx=0).stop 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 shutdown_connections 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc8580a2b80 0x7fc8580a5040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc86c102690 0x7fc86c19f2e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc86c101cd0 0x7fc86c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 --2- 172.21.15.81:0/734525754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc86c100ad0 0x7fc86c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 >> 172.21.15.81:0/734525754 conn(0x7fc86c0fc280 msgr2=0x7fc86c105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 shutdown_connections 2024-09-12T12:13:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:41.765+0000 7fc873bc2640 1 -- 172.21.15.81:0/734525754 wait complete. 2024-09-12T12:13:42.520 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:42.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:42 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:42.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:42 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/734525754' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:42.556 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726143200,"num_in_osds":12,"osd_in_since":1726143202,"num_remapped_pgs":0} 2024-09-12T12:13:42.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:42.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:42 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:42.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:42 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/734525754' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:42.856 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:42.856 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:42 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:42.856 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:42 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/734525754' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:43.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:13:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:13:43.316+0000 7f3868db7640 -1 osd.11 0 log_to_monitors true 2024-09-12T12:13:43.432 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:43 smithi081 ceph-mon[30948]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:43.432 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:43 smithi081 ceph-mon[30948]: from='osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:13:43.432 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:43 smithi081 ceph-mon[30948]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:13:43.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:13:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:43 smithi103 ceph-mon[35094]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:43 smithi103 ceph-mon[35094]: from='osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:13:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:43 smithi103 ceph-mon[35094]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:13:43.808 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:43 smithi173 ceph-mon[35326]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:43 smithi173 ceph-mon[35326]: from='osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:13:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:43 smithi173 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T12:13:44.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/4042246630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc105050 msgr2=0x7f7dcc107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/4042246630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc105050 0x7f7dcc107440 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009900 tx=0x7f7db402a410 comp rx=0 tx=0).stop 2024-09-12T12:13:44.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/4042246630 shutdown_connections 2024-09-12T12:13:44.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/4042246630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dcc107980 0x7f7dcc109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/4042246630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc105050 0x7f7dcc107440 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/4042246630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc102720 0x7f7dcc104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/4042246630 >> 172.21.15.81:0/4042246630 conn(0x7f7dcc0fc2a0 msgr2=0x7f7dcc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/4042246630 shutdown_connections 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.245+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/4042246630 wait complete. 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 Processor -- start 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 -- start start 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dcc102720 0x7f7dcc102080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc105050 0x7f7dcc1006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 0x7f7dcc100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10dab0 con 0x7f7dcc107980 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10d930 con 0x7f7dcc105050 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dd1ee8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc10dc30 con 0x7f7dcc102720 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 0x7f7dcc100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 0x7f7dcc100c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35554/0 (socket says 172.21.15.81:35554) 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 -- 172.21.15.81:0/3177148707 learned_addr learned my addr 172.21.15.81:0/3177148707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcb7fe640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dcc102720 0x7f7dcc102080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcaffd640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc105050 0x7f7dcc1006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 -- 172.21.15.81:0/3177148707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dcc102720 msgr2=0x7f7dcc102080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dcc102720 0x7f7dcc102080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 -- 172.21.15.81:0/3177148707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc105050 msgr2=0x7f7dcc1006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc105050 0x7f7dcc1006d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcbfff640 1 -- 172.21.15.81:0/3177148707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc1014d0 con 0x7f7dcc107980 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.246+0000 7f7dcaffd640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc105050 0x7f7dcc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.247+0000 7f7dcbfff640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 0x7f7dcc100c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400b970 tx=0x7f7dc400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.247+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4019070 con 0x7f7dcc107980 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.247+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7dc4014440 con 0x7f7dcc107980 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.247+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc1a22f0 con 0x7f7dcc107980 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.247+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40075d0 con 0x7f7dcc107980 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.247+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1a2830 con 0x7f7dcc107980 2024-09-12T12:13:44.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.248+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc0fdd90 con 0x7f7dcc107980 2024-09-12T12:13:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.250+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7dc401c070 con 0x7f7dcc107980 2024-09-12T12:13:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.251+0000 7f7dc8ff9640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7db80a2b80 0x7f7db80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.251+0000 7f7dcb7fe640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7db80a2b80 0x7f7db80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.252+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6831+0+0 (secure 0 0 0) 0x7f7dc40ce000 con 0x7f7dcc107980 2024-09-12T12:13:44.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.252+0000 7f7dcb7fe640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7db80a2b80 0x7f7db80a5040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009990 tx=0x7f7dbc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:44.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.256+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7dc409b530 con 0x7f7dcc107980 2024-09-12T12:13:44.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.423+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7dcc062df0 con 0x7f7dcc107980 2024-09-12T12:13:44.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.423+0000 7f7dc8ff9640 1 -- 172.21.15.81:0/3177148707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f7dc409ae30 con 0x7f7dcc107980 2024-09-12T12:13:44.423 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:13:44.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7db80a2b80 msgr2=0x7f7db80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7db80a2b80 0x7f7db80a5040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009990 tx=0x7f7dbc009110 comp rx=0 tx=0).stop 2024-09-12T12:13:44.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 msgr2=0x7f7dcc100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 0x7f7dcc100c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400b970 tx=0x7f7dc400bd70 comp rx=0 tx=0).stop 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 shutdown_connections 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7db80a2b80 0x7f7db80a5040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dcc107980 0x7f7dcc100c10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dcc105050 0x7f7dcc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 --2- 172.21.15.81:0/3177148707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7dcc102720 0x7f7dcc102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 >> 172.21.15.81:0/3177148707 conn(0x7f7dcc0fc2a0 msgr2=0x7f7dcc103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 shutdown_connections 2024-09-12T12:13:44.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:44.425+0000 7f7dd1ee8640 1 -- 172.21.15.81:0/3177148707 wait complete. 2024-09-12T12:13:44.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:13:44.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T12:13:44.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: from='osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:13:44.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:44.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:13:44.559 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3177148707' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:44.559 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:44 smithi173 ceph-mon[35326]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: from='osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3177148707' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:44.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:44 smithi081 ceph-mon[30948]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:13:44.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T12:13:45.049 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: osdmap e69: 12 total, 11 up, 12 in 2024-09-12T12:13:45.050 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: from='osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:13:45.050 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.050 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-09-12T12:13:45.050 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3177148707' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:45.050 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:44 smithi103 ceph-mon[35094]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-09-12T12:13:45.146 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726143200,"num_in_osds":12,"osd_in_since":1726143202,"num_remapped_pgs":0} 2024-09-12T12:13:45.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:13:45.230+0000 7f3864517640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T12:13:45.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:13:45.243+0000 7f385cb49640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='osd.11 ' entity='osd.11' 2024-09-12T12:13:45.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:45 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:45.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:45.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:45.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:45.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='osd.11 ' entity='osd.11' 2024-09-12T12:13:45.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:45 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: osdmap e70: 12 total, 11 up, 12 in 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='osd.11 ' entity='osd.11' 2024-09-12T12:13:45.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:45 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:46.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T12:13:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:46.749 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: purged_snaps scrub starts 2024-09-12T12:13:46.749 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: purged_snaps scrub ok 2024-09-12T12:13:46.749 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: Detected new or changed devices on smithi173 2024-09-12T12:13:46.749 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-12T12:13:46.749 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] boot 2024-09-12T12:13:46.749 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: osdmap e71: 12 total, 12 up, 12 in 2024-09-12T12:13:46.750 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:46 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.825+0000 7f3547eb3640 1 -- 172.21.15.81:0/539318420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 msgr2=0x7f3540103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.825+0000 7f3547eb3640 1 --2- 172.21.15.81:0/539318420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540103280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3534009ca0 tx=0x7f353402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 -- 172.21.15.81:0/539318420 shutdown_connections 2024-09-12T12:13:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 --2- 172.21.15.81:0/539318420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35401037c0 0x7f354010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 --2- 172.21.15.81:0/539318420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540103280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 --2- 172.21.15.81:0/539318420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540101c00 0x7f3540102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 -- 172.21.15.81:0/539318420 >> 172.21.15.81:0/539318420 conn(0x7f35400fd390 msgr2=0x7f35400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 -- 172.21.15.81:0/539318420 shutdown_connections 2024-09-12T12:13:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 -- 172.21.15.81:0/539318420 wait complete. 2024-09-12T12:13:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 Processor -- start 2024-09-12T12:13:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.826+0000 7f3547eb3640 1 -- start start 2024-09-12T12:13:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3547eb3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3540101c00 0x7f3540198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3547eb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3547eb3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35401037c0 0x7f354019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3547eb3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f354010dac0 con 0x7f3540102e00 2024-09-12T12:13:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3547eb3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f354010d940 con 0x7f3540101c00 2024-09-12T12:13:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3547eb3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f354010dc40 con 0x7f35401037c0 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35560/0 (socket says 172.21.15.81:35560) 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 -- 172.21.15.81:0/1381608349 learned_addr learned my addr 172.21.15.81:0/1381608349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3545c4f640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3540101c00 0x7f3540198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3546450640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35401037c0 0x7f354019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 -- 172.21.15.81:0/1381608349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35401037c0 msgr2=0x7f354019f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35401037c0 0x7f354019f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 -- 172.21.15.81:0/1381608349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3540101c00 msgr2=0x7f3540198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3540101c00 0x7f3540198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 -- 172.21.15.81:0/1381608349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354019fd80 con 0x7f3540102e00 2024-09-12T12:13:46.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3546450640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35401037c0 0x7f354019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f3545c4f640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3540101c00 0x7f3540198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f354544e640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540198690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3534009dc0 tx=0x7f353402f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.827+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353402fe40 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.828+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35401a0010 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.828+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3534030ac0 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.828+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534046cf0 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.828+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35401a05d0 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.828+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3540109050 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.830+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3534030c70 con 0x7f3540102e00 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.830+0000 7f353effd640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f35280a2bb0 0x7f35280a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.830+0000 7f3545c4f640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f35280a2bb0 0x7f35280a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:46.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.830+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f35340f05b0 con 0x7f3540102e00 2024-09-12T12:13:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.831+0000 7f3545c4f640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f35280a2bb0 0x7f35280a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3540102c60 tx=0x7f3538008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.833+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3534044380 con 0x7f3540102e00 2024-09-12T12:13:46.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: purged_snaps scrub starts 2024-09-12T12:13:46.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: purged_snaps scrub ok 2024-09-12T12:13:46.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: Detected new or changed devices on smithi173 2024-09-12T12:13:46.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-12T12:13:46.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] boot 2024-09-12T12:13:46.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: osdmap e71: 12 total, 12 up, 12 in 2024-09-12T12:13:46.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:46 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:46.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: purged_snaps scrub starts 2024-09-12T12:13:46.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: purged_snaps scrub ok 2024-09-12T12:13:46.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: Detected new or changed devices on smithi173 2024-09-12T12:13:46.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi173 to 4272M 2024-09-12T12:13:46.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: osd.11 [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] boot 2024-09-12T12:13:46.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: osdmap e71: 12 total, 12 up, 12 in 2024-09-12T12:13:46.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:46 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:13:46.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.998+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f354002d990 con 0x7f3540102e00 2024-09-12T12:13:46.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:46.999+0000 7f353effd640 1 -- 172.21.15.81:0/1381608349 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f35340b7e20 con 0x7f3540102e00 2024-09-12T12:13:46.999 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:13:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f35280a2bb0 msgr2=0x7f35280a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f35280a2bb0 0x7f35280a5070 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3540102c60 tx=0x7f3538008040 comp rx=0 tx=0).stop 2024-09-12T12:13:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 msgr2=0x7f3540198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540198690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3534009dc0 tx=0x7f353402f840 comp rx=0 tx=0).stop 2024-09-12T12:13:47.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 shutdown_connections 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f35280a2bb0 0x7f35280a5070 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35401037c0 0x7f354019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3540102e00 0x7f3540198690 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 --2- 172.21.15.81:0/1381608349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3540101c00 0x7f3540198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 >> 172.21.15.81:0/1381608349 conn(0x7f35400fd390 msgr2=0x7f3540106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 shutdown_connections 2024-09-12T12:13:47.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:47.001+0000 7f3547eb3640 1 -- 172.21.15.81:0/1381608349 wait complete. 2024-09-12T12:13:47.703 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:47 smithi081 ceph-mon[30948]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:47.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:47 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1381608349' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:47.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:47 smithi081 ceph-mon[30948]: osdmap e72: 12 total, 12 up, 12 in 2024-09-12T12:13:47.731 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1726143226,"num_in_osds":12,"osd_in_since":1726143202,"num_remapped_pgs":0} 2024-09-12T12:13:47.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:13:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:47 smithi173 ceph-mon[35326]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:47 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1381608349' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:47 smithi173 ceph-mon[35326]: osdmap e72: 12 total, 12 up, 12 in 2024-09-12T12:13:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:47 smithi103 ceph-mon[35094]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-09-12T12:13:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:47 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1381608349' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T12:13:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:47 smithi103 ceph-mon[35094]: osdmap e72: 12 total, 12 up, 12 in 2024-09-12T12:13:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:48.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 -- 172.21.15.81:0/2246031931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102570 msgr2=0x7f1fc81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 --2- 172.21.15.81:0/2246031931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102570 0x7f1fc81029b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009900 tx=0x7f1fb002a480 comp rx=0 tx=0).stop 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 -- 172.21.15.81:0/2246031931 shutdown_connections 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 --2- 172.21.15.81:0/2246031931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fc8102ef0 0x7f1fc810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 --2- 172.21.15.81:0/2246031931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102570 0x7f1fc81029b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 --2- 172.21.15.81:0/2246031931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fc8100e20 0x7f1fc8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 -- 172.21.15.81:0/2246031931 >> 172.21.15.81:0/2246031931 conn(0x7f1fc80fc7d0 msgr2=0x7f1fc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 -- 172.21.15.81:0/2246031931 shutdown_connections 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 -- 172.21.15.81:0/2246031931 wait complete. 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 Processor -- start 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.428+0000 7f1fcf233640 1 -- start start 2024-09-12T12:13:48.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fc8100e20 0x7f1fc8199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fc8102570 0x7f1fc8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 0x7f1fc81a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc81110a0 con 0x7f1fc8102ef0 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8110f20 con 0x7f1fc8100e20 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc8111220 con 0x7f1fc8102570 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 0x7f1fc81a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 0x7f1fc81a4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35580/0 (socket says 172.21.15.81:35580) 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 -- 172.21.15.81:0/1276357737 learned_addr learned my addr 172.21.15.81:0/1276357737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fccfcf640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fc8100e20 0x7f1fc8199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fc7fff640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fc8102570 0x7f1fc8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 -- 172.21.15.81:0/1276357737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fc8102570 msgr2=0x7f1fc8199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fc8102570 0x7f1fc8199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 -- 172.21.15.81:0/1276357737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fc8100e20 msgr2=0x7f1fc8199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fc8100e20 0x7f1fc8199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 -- 172.21.15.81:0/1276357737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc81a49d0 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcd7d0640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 0x7f1fc81a4490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000eaa0 tx=0x7f1fc000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000cdb0 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1fc0004b20 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc81a4ba0 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.429+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0011760 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.430+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc81a50b0 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.431+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc8101200 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.432+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1fc0004cd0 con 0x7f1fc8102ef0 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.432+0000 7f1fc5ffb640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1fb40a2c00 0x7f1fb40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:48.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.433+0000 7f1fccfcf640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1fb40a2c00 0x7f1fb40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.433+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f1fc00ced50 con 0x7f1fc8102ef0 2024-09-12T12:13:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.433+0000 7f1fccfcf640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1fb40a2c00 0x7f1fb40a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800bbe0 tx=0x7f1fb800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.437+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fc00d2030 con 0x7f1fc8102ef0 2024-09-12T12:13:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.604+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fc806a560 con 0x7f1fc8102ef0 2024-09-12T12:13:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.605+0000 7f1fc5ffb640 1 -- 172.21.15.81:0/1276357737 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18492 (secure 0 0 0) 0x7f1fc806a560 con 0x7f1fc8102ef0 2024-09-12T12:13:48.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:13:48.606 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:13:47.235629+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:13:48.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1fb40a2c00 msgr2=0x7f1fb40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1fb40a2c00 0x7f1fb40a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800bbe0 tx=0x7f1fb800b390 comp rx=0 tx=0).stop 2024-09-12T12:13:48.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 msgr2=0x7f1fc81a4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 0x7f1fc81a4490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000eaa0 tx=0x7f1fc000ef60 comp rx=0 tx=0).stop 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 shutdown_connections 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1fb40a2c00 0x7f1fb40a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fc8102ef0 0x7f1fc81a4490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fc8102570 0x7f1fc8199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 --2- 172.21.15.81:0/1276357737 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fc8100e20 0x7f1fc8199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 >> 172.21.15.81:0/1276357737 conn(0x7f1fc80fc7d0 msgr2=0x7f1fc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 shutdown_connections 2024-09-12T12:13:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:48.607+0000 7f1fcf233640 1 -- 172.21.15.81:0/1276357737 wait complete. 2024-09-12T12:13:49.234 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:10:04.561261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:13:49.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T12:13:49.478 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:49.588 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:49 smithi081 ceph-mon[30948]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:49.588 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:49 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1276357737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:13:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:49 smithi173 ceph-mon[35326]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:49 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1276357737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:13:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 -- 172.21.15.81:0/2179959232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734100a80 msgr2=0x7fa734100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 --2- 172.21.15.81:0/2179959232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734100a80 0x7fa734100ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa724009930 tx=0x7fa72402a420 comp rx=0 tx=0).stop 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 -- 172.21.15.81:0/2179959232 shutdown_connections 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 --2- 172.21.15.81:0/2179959232 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa734101420 0x7fa73410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 --2- 172.21.15.81:0/2179959232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734100a80 0x7fa734100ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 --2- 172.21.15.81:0/2179959232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734106a80 0x7fa734106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 -- 172.21.15.81:0/2179959232 >> 172.21.15.81:0/2179959232 conn(0x7fa7340fc7a0 msgr2=0x7fa7340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 -- 172.21.15.81:0/2179959232 shutdown_connections 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.897+0000 7fa738866640 1 -- 172.21.15.81:0/2179959232 wait complete. 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 Processor -- start 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 -- start start 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734100a80 0x7fa734198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa734101420 0x7fa734198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 0x7fa73419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa734111060 con 0x7fa734106a80 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa734110ee0 con 0x7fa734100a80 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa738866640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7341111e0 con 0x7fa734101420 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa732d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 0x7fa73419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa732d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 0x7fa73419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35594/0 (socket says 172.21.15.81:35594) 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa732d9d640 1 -- 172.21.15.81:0/1145290314 learned_addr learned my addr 172.21.15.81:0/1145290314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa731d9b640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa734101420 0x7fa734198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.898+0000 7fa73259c640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734100a80 0x7fa734198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa732d9d640 1 -- 172.21.15.81:0/1145290314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa734101420 msgr2=0x7fa734198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa732d9d640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa734101420 0x7fa734198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa732d9d640 1 -- 172.21.15.81:0/1145290314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734100a80 msgr2=0x7fa734198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa732d9d640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734100a80 0x7fa734198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa732d9d640 1 -- 172.21.15.81:0/1145290314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73419d620 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa73259c640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734100a80 0x7fa734198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa732d9d640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 0x7fa73419cf40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b970 tx=0x7fa72c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c019070 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73419d910 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa72c00cb40 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0076e0 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.899+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7341a51f0 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.900+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa734100f60 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.901+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa72c01c070 con 0x7fa734106a80 2024-09-12T12:13:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.902+0000 7fa72b7fe640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa7200a2b80 0x7fa7200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.902+0000 7fa73259c640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa7200a2b80 0x7fa7200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.902+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fa72c0ce130 con 0x7fa734106a80 2024-09-12T12:13:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.902+0000 7fa73259c640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa7200a2b80 0x7fa7200a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009930 tx=0x7fa71c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:49.906+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa72c09aee0 con 0x7fa734106a80 2024-09-12T12:13:49.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:49 smithi103 ceph-mon[35094]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:49.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:49 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1276357737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:13:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.073+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7341a5480 con 0x7fa734106a80 2024-09-12T12:13:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.073+0000 7fa72b7fe640 1 -- 172.21.15.81:0/1145290314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fa72c09f1e0 con 0x7fa734106a80 2024-09-12T12:13:50.075 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa7200a2b80 msgr2=0x7fa7200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa7200a2b80 0x7fa7200a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009930 tx=0x7fa71c008040 comp rx=0 tx=0).stop 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 msgr2=0x7fa73419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 0x7fa73419cf40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00b970 tx=0x7fa72c00be30 comp rx=0 tx=0).stop 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 shutdown_connections 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa7200a2b80 0x7fa7200a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa734106a80 0x7fa73419cf40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa734101420 0x7fa734198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 --2- 172.21.15.81:0/1145290314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa734100a80 0x7fa734198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 >> 172.21.15.81:0/1145290314 conn(0x7fa7340fc7a0 msgr2=0x7fa734104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 shutdown_connections 2024-09-12T12:13:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:50.075+0000 7fa738866640 1 -- 172.21.15.81:0/1145290314 wait complete. 2024-09-12T12:13:50.745 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:50 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1145290314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:13:50.779 INFO:tasks.cephadm:Adding mds.a on smithi081 2024-09-12T12:13:50.779 INFO:tasks.cephadm:Adding mds.d on smithi081 2024-09-12T12:13:50.779 INFO:tasks.cephadm:Adding mds.g on smithi081 2024-09-12T12:13:50.779 INFO:tasks.cephadm:Adding mds.j on smithi081 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.b on smithi103 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.e on smithi103 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.h on smithi103 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.k on smithi103 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.c on smithi173 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.f on smithi173 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.i on smithi173 2024-09-12T12:13:50.780 INFO:tasks.cephadm:Adding mds.l on smithi173 2024-09-12T12:13:50.780 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l' 2024-09-12T12:13:50.809 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:50 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1145290314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:13:50.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:50 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1145290314' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:13:51.040 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:13:51.466 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 -- 172.21.15.173:0/1460235815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c102e00 msgr2=0x7f941c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 --2- 172.21.15.173:0/1460235815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c102e00 0x7f941c103280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f940c009900 tx=0x7f940c02a410 comp rx=0 tx=0).stop 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 -- 172.21.15.173:0/1460235815 shutdown_connections 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 --2- 172.21.15.173:0/1460235815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941c1037c0 0x7f941c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 --2- 172.21.15.173:0/1460235815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c102e00 0x7f941c103280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 --2- 172.21.15.173:0/1460235815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f941c101c00 0x7f941c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 -- 172.21.15.173:0/1460235815 >> 172.21.15.173:0/1460235815 conn(0x7f941c0fd390 msgr2=0x7f941c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 -- 172.21.15.173:0/1460235815 shutdown_connections 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 -- 172.21.15.173:0/1460235815 wait complete. 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 Processor -- start 2024-09-12T12:13:51.467 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.465+0000 7f9424375640 1 -- start start 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 0x7f941c198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941c102e00 0x7f941c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f941c1037c0 0x7f941c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f941c10da90 con 0x7f941c1037c0 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f941c10d910 con 0x7f941c102e00 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f941c10dc10 con 0x7f941c101c00 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 0x7f941c198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 0x7f941c198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:53452/0 (socket says 172.21.15.173:53452) 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 -- 172.21.15.173:0/2018999704 learned_addr learned my addr 172.21.15.173:0/2018999704 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422912640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f941c1037c0 0x7f941c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9421910640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941c102e00 0x7f941c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:51.468 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 -- 172.21.15.173:0/2018999704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941c102e00 msgr2=0x7f941c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941c102e00 0x7f941c198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 -- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f941c1037c0 msgr2=0x7f941c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f941c1037c0 0x7f941c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 -- 172.21.15.173:0/2018999704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c19fc60 con 0x7f941c101c00 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9422111640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 0x7f941c198030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f941800b450 tx=0x7f941800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418015020 con 0x7f941c101c00 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9418011d90 con 0x7f941c101c00 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941c19ff50 con 0x7f941c101c00 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941800f340 con 0x7f941c101c00 2024-09-12T12:13:51.469 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.466+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f941c1a0430 con 0x7f941c101c00 2024-09-12T12:13:51.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.468+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f941c108f30 con 0x7f941c101c00 2024-09-12T12:13:51.470 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.468+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9418018020 con 0x7f941c101c00 2024-09-12T12:13:51.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.469+0000 7f94137fe640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94080a2bb0 0x7f94080a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:51.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.470+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f94180ce6a0 con 0x7f941c101c00 2024-09-12T12:13:51.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.470+0000 7f9421910640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94080a2bb0 0x7f94080a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:51.471 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.470+0000 7f9421910640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94080a2bb0 0x7f94080a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f940c0096c0 tx=0x7f940c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:51.474 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.474+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f941801f020 con 0x7f941c101c00 2024-09-12T12:13:51.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.651+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}) -- 0x7f941c062730 con 0x7f94080a2bb0 2024-09-12T12:13:51.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.659+0000 7f94137fe640 1 -- 172.21.15.173:0/2018999704 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f941c062730 con 0x7f94080a2bb0 2024-09-12T12:13:51.660 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mds.all update... 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94080a2bb0 msgr2=0x7f94080a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94080a2bb0 0x7f94080a5070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f940c0096c0 tx=0x7f940c005fd0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 msgr2=0x7f941c198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 0x7f941c198030 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f941800b450 tx=0x7f941800b910 comp rx=0 tx=0).stop 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 shutdown_connections 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94080a2bb0 0x7f94080a5070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f941c1037c0 0x7f941c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941c102e00 0x7f941c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 --2- 172.21.15.173:0/2018999704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f941c101c00 0x7f941c198030 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 >> 172.21.15.173:0/2018999704 conn(0x7f941c0fd390 msgr2=0x7f941c106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 shutdown_connections 2024-09-12T12:13:51.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-09-12T12:13:51.661+0000 7f9424375640 1 -- 172.21.15.173:0/2018999704 wait complete. 2024-09-12T12:13:51.719 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:51 smithi173 ceph-mon[35326]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:51.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:51 smithi081 ceph-mon[30948]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:51.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:51 smithi103 ceph-mon[35094]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:52.398 DEBUG:teuthology.orchestra.run.smithi081:mds.a> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T12:13:52.401 DEBUG:teuthology.orchestra.run.smithi081:mds.d> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T12:13:52.444 DEBUG:teuthology.orchestra.run.smithi081:mds.g> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T12:13:52.487 DEBUG:teuthology.orchestra.run.smithi081:mds.j> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T12:13:52.530 DEBUG:teuthology.orchestra.run.smithi103:mds.b> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T12:13:52.533 DEBUG:teuthology.orchestra.run.smithi103:mds.e> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T12:13:52.575 DEBUG:teuthology.orchestra.run.smithi103:mds.h> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T12:13:52.618 DEBUG:teuthology.orchestra.run.smithi103:mds.k> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T12:13:52.661 DEBUG:teuthology.orchestra.run.smithi173:mds.c> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T12:13:52.664 DEBUG:teuthology.orchestra.run.smithi173:mds.f> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T12:13:52.707 DEBUG:teuthology.orchestra.run.smithi173:mds.i> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T12:13:52.750 DEBUG:teuthology.orchestra.run.smithi173:mds.l> sudo journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T12:13:52.793 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T12:13:52.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:52.813 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:52.814 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:52.814 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:52.814 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: Deploying daemon mds.l on smithi173 2024-09-12T12:13:52.814 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:52 smithi081 ceph-mon[30948]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:52.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:13:52.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: Deploying daemon mds.l on smithi173 2024-09-12T12:13:52.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:52 smithi103 ceph-mon[35094]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:52.945 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:13:52.945 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T12:13:52.945 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:52.945 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: Deploying daemon mds.l on smithi173 2024-09-12T12:13:52.946 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:52 smithi173 ceph-mon[35326]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.475+0000 7f605f6c7640 1 -- 172.21.15.81:0/3469842471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058101df0 msgr2=0x7f60581021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3469842471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058101df0 0x7f60581021d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6048009ca0 tx=0x7f604802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 -- 172.21.15.81:0/3469842471 shutdown_connections 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3469842471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058106f20 0x7f605810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3469842471 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60581027a0 0x7f60581067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3469842471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058101df0 0x7f60581021d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 -- 172.21.15.81:0/3469842471 >> 172.21.15.81:0/3469842471 conn(0x7f60580fd8f0 msgr2=0x7f60580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 -- 172.21.15.81:0/3469842471 shutdown_connections 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 -- 172.21.15.81:0/3469842471 wait complete. 2024-09-12T12:13:53.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 Processor -- start 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.476+0000 7f605f6c7640 1 -- start start 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058101df0 0x7f6058198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60581027a0 0x7f6058198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 0x7f605819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60581120e0 con 0x7f6058106f20 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6058111f60 con 0x7f6058101df0 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6058112260 con 0x7f60581027a0 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 0x7f605819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 0x7f605819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46220/0 (socket says 172.21.15.81:46220) 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 -- 172.21.15.81:0/3304067522 learned_addr learned my addr 172.21.15.81:0/3304067522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605cc62640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60581027a0 0x7f6058198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:53.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605d463640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058101df0 0x7f6058198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 -- 172.21.15.81:0/3304067522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60581027a0 msgr2=0x7f6058198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60581027a0 0x7f6058198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 -- 172.21.15.81:0/3304067522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058101df0 msgr2=0x7f6058198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058101df0 0x7f6058198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 -- 172.21.15.81:0/3304067522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605819d510 con 0x7f6058106f20 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605d463640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058101df0 0x7f6058198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605dc64640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 0x7f605819ce30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f605000c970 tx=0x7f605000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050007bb0 con 0x7f6058106f20 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605819d800 con 0x7f6058106f20 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6050007d50 con 0x7f6058106f20 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.477+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500187e0 con 0x7f6058106f20 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.478+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60581a50e0 con 0x7f6058106f20 2024-09-12T12:13:53.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.479+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60581021d0 con 0x7f6058106f20 2024-09-12T12:13:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.481+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f60500189a0 con 0x7f6058106f20 2024-09-12T12:13:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.481+0000 7f60567fc640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60400a2b80 0x7f60400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.481+0000 7f605d463640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60400a2b80 0x7f60400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.481+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f60500cec40 con 0x7f6058106f20 2024-09-12T12:13:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.482+0000 7f605d463640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60400a2b80 0x7f60400a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6048009a60 tx=0x7f604802f3a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.485+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6050014030 con 0x7f6058106f20 2024-09-12T12:13:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.689+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f605802d7c0 con 0x7f6058106f20 2024-09-12T12:13:53.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.689+0000 7f60567fc640 1 -- 172.21.15.81:0/3304067522 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f605001f300 con 0x7f6058106f20 2024-09-12T12:13:53.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:13:53.690 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"btime":"2024-09-12T12:07:02:813206+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T12:13:53.691 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 1 2024-09-12T12:13:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60400a2b80 msgr2=0x7f60400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60400a2b80 0x7f60400a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6048009a60 tx=0x7f604802f3a0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 msgr2=0x7f605819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:53.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 0x7f605819ce30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f605000c970 tx=0x7f605000cd70 comp rx=0 tx=0).stop 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 shutdown_connections 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60400a2b80 0x7f60400a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6058106f20 0x7f605819ce30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60581027a0 0x7f6058198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 --2- 172.21.15.81:0/3304067522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6058101df0 0x7f6058198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 >> 172.21.15.81:0/3304067522 conn(0x7f60580fd8f0 msgr2=0x7f60580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 shutdown_connections 2024-09-12T12:13:53.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:53.692+0000 7f605f6c7640 1 -- 172.21.15.81:0/3304067522 wait complete. 2024-09-12T12:13:54.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:54 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3304067522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:13:54.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:54 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3304067522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:13:54.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:54 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3304067522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:13:54.903 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:13:54 smithi173 systemd[1]: Started Ceph mds.l for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6832/372466772,v1:172.21.15.173:6833/372466772] up:boot 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: fsmap 1 up:standby 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.294 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.295 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:55.295 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:55.295 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:55 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6832/372466772,v1:172.21.15.173:6833/372466772] up:boot 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: fsmap 1 up:standby 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:55.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:55.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:55 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:55.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:55.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6832/372466772,v1:172.21.15.173:6833/372466772] up:boot 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: fsmap 1 up:standby 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:55.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:55 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:56.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:56 smithi081 ceph-mon[30948]: Deploying daemon mds.k on smithi103 2024-09-12T12:13:56.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:56 smithi173 ceph-mon[35326]: Deploying daemon mds.k on smithi103 2024-09-12T12:13:56.404 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:56 smithi103 ceph-mon[35094]: Deploying daemon mds.k on smithi103 2024-09-12T12:13:56.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:13:56.685 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:56 smithi103 systemd[1]: Starting Ceph mds.k for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:13:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:13:57.049 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:56 smithi103 podman[64385]: 2024-09-12 12:13:56.776444224 +0000 UTC m=+0.094768813 container create 5d098296042fb6a0f5f40eee66a8676e31cb5c29c407194613f59035d68cbf0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T12:13:57.049 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:56 smithi103 podman[64385]: 2024-09-12 12:13:56.697602361 +0000 UTC m=+0.015926960 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:13:57.049 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:56 smithi103 podman[64385]: 2024-09-12 12:13:56.979081048 +0000 UTC m=+0.297405650 container init 5d098296042fb6a0f5f40eee66a8676e31cb5c29c407194613f59035d68cbf0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T12:13:57.049 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:56 smithi103 podman[64385]: 2024-09-12 12:13:56.981895577 +0000 UTC m=+0.300220175 container start 5d098296042fb6a0f5f40eee66a8676e31cb5c29c407194613f59035d68cbf0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T12:13:57.049 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:57 smithi103 ceph-mds[64405]: -- 172.21.15.103:0/3451979225 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572f51dd860 con 0x5572f51bb000 2024-09-12T12:13:57.049 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:57 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k[64401]: starting mds.k at 2024-09-12T12:13:57.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:57 smithi081 ceph-mon[30948]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:57.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.155+0000 7f92b5e94640 1 -- 172.21.15.81:0/945155431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b010c2f0 msgr2=0x7f92b010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:57.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.155+0000 7f92b5e94640 1 --2- 172.21.15.81:0/945155431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b010c2f0 0x7f92b010e790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009ca0 tx=0x7f92a802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 -- 172.21.15.81:0/945155431 shutdown_connections 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 --2- 172.21.15.81:0/945155431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b010c2f0 0x7f92b010e790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 --2- 172.21.15.81:0/945155431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b01037a0 0x7f92b010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 --2- 172.21.15.81:0/945155431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0102df0 0x7f92b01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 -- 172.21.15.81:0/945155431 >> 172.21.15.81:0/945155431 conn(0x7f92b00fc7d0 msgr2=0x7f92b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 -- 172.21.15.81:0/945155431 shutdown_connections 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 -- 172.21.15.81:0/945155431 wait complete. 2024-09-12T12:13:57.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 Processor -- start 2024-09-12T12:13:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.156+0000 7f92b5e94640 1 -- start start 2024-09-12T12:13:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92b5e94640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0102df0 0x7f92b0100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92b5e94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 0x7f92b0100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92b5e94640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b010c2f0 0x7f92b01014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92b5e94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0112230 con 0x7f92b01037a0 2024-09-12T12:13:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92b5e94640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f92b01120b0 con 0x7f92b0102df0 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92b5e94640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f92b01123b0 con 0x7f92b010c2f0 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 0x7f92b0100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 0x7f92b0100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46234/0 (socket says 172.21.15.81:46234) 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 -- 172.21.15.81:0/2501158307 learned_addr learned my addr 172.21.15.81:0/2501158307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92af7fe640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0102df0 0x7f92b0100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92affff640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b010c2f0 0x7f92b01014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 -- 172.21.15.81:0/2501158307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b010c2f0 msgr2=0x7f92b01014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b010c2f0 0x7f92b01014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 -- 172.21.15.81:0/2501158307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0102df0 msgr2=0x7f92b0100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0102df0 0x7f92b0100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 -- 172.21.15.81:0/2501158307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b01a6af0 con 0x7f92b01037a0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.157+0000 7f92aeffd640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 0x7f92b0100f90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92a400c8c0 tx=0x7f92a400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.158+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4007bb0 con 0x7f92b01037a0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.158+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f92a4007d50 con 0x7f92b01037a0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.158+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b01a6de0 con 0x7f92b01037a0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.158+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a4018930 con 0x7f92b01037a0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.158+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b01a72e0 con 0x7f92b01037a0 2024-09-12T12:13:57.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.159+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b01031d0 con 0x7f92b01037a0 2024-09-12T12:13:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.160+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f92a4018ad0 con 0x7f92b01037a0 2024-09-12T12:13:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.161+0000 7f92acff9640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f92980a2c00 0x7f92980a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:13:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.161+0000 7f92af7fe640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f92980a2c00 0x7f92980a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:13:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.161+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f92a40cebb0 con 0x7f92b01037a0 2024-09-12T12:13:57.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.161+0000 7f92af7fe640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f92980a2c00 0x7f92980a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009bd0 tx=0x7f92a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:13:57.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.165+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92a4014030 con 0x7f92b01037a0 2024-09-12T12:13:57.305 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:57 smithi173 ceph-mon[35326]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.377+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92b01a7570 con 0x7f92b01037a0 2024-09-12T12:13:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.377+0000 7f92acff9640 1 -- 172.21.15.81:0/2501158307 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f92a409bfb0 con 0x7f92b01037a0 2024-09-12T12:13:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:13:57.378 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"btime":"2024-09-12T12:13:57:042028+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T12:13:57.378 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-12T12:13:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f92980a2c00 msgr2=0x7f92980a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f92980a2c00 0x7f92980a50c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009bd0 tx=0x7f92a0005f90 comp rx=0 tx=0).stop 2024-09-12T12:13:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 msgr2=0x7f92b0100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:13:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 0x7f92b0100f90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f92a400c8c0 tx=0x7f92a400cd80 comp rx=0 tx=0).stop 2024-09-12T12:13:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 shutdown_connections 2024-09-12T12:13:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f92980a2c00 0x7f92980a50c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92b010c2f0 0x7f92b01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92b01037a0 0x7f92b0100f90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 --2- 172.21.15.81:0/2501158307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b0102df0 0x7f92b0100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:13:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 >> 172.21.15.81:0/2501158307 conn(0x7f92b00fc7d0 msgr2=0x7f92b00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:13:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 shutdown_connections 2024-09-12T12:13:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:13:57.380+0000 7f92b5e94640 1 -- 172.21.15.81:0/2501158307 wait complete. 2024-09-12T12:13:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:57 smithi103 ceph-mon[35094]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:57.435 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:57 smithi103 bash[64385]: 5d098296042fb6a0f5f40eee66a8676e31cb5c29c407194613f59035d68cbf0d 2024-09-12T12:13:57.436 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:13:57 smithi103 systemd[1]: Started Ceph mds.k for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6832/3064461197,v1:172.21.15.103:6833/3064461197] up:boot 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: fsmap 2 up:standby 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:58.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: Deploying daemon mds.j on smithi081 2024-09-12T12:13:58.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:58 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2501158307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:13:58.395 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6832/3064461197,v1:172.21.15.103:6833/3064461197] up:boot 2024-09-12T12:13:58.395 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: fsmap 2 up:standby 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: Deploying daemon mds.j on smithi081 2024-09-12T12:13:58.396 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:58 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2501158307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:13:58.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6832/3064461197,v1:172.21.15.103:6833/3064461197] up:boot 2024-09-12T12:13:58.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: fsmap 2 up:standby 2024-09-12T12:13:58.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:13:58.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: Deploying daemon mds.j on smithi081 2024-09-12T12:13:58.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:58 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2501158307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:13:59.268 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:13:59 smithi081 ceph-mon[30948]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:59.345 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:13:59 smithi103 ceph-mon[35094]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:59.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:13:59 smithi173 ceph-mon[35326]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:13:59.860 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:13:59 smithi081 systemd[1]: Starting Ceph mds.j for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:00.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:00.184 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:13:59 smithi081 podman[69561]: 2024-09-12 12:13:59.836536007 +0000 UTC m=+0.015927002 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:00.184 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:13:59 smithi081 podman[69561]: 2024-09-12 12:13:59.954242652 +0000 UTC m=+0.133633648 container create 97081209fd1a60492288c1602361711d4c95d7c4a246b06cf6a9b4bf52087e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T12:14:00.185 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:14:00 smithi081 podman[69561]: 2024-09-12 12:14:00.18174322 +0000 UTC m=+0.361134214 container init 97081209fd1a60492288c1602361711d4c95d7c4a246b06cf6a9b4bf52087e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T12:14:00.185 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:14:00 smithi081 podman[69561]: 2024-09-12 12:14:00.184745121 +0000 UTC m=+0.364136126 container start 97081209fd1a60492288c1602361711d4c95d7c4a246b06cf6a9b4bf52087e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T12:14:00.399 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:00.523 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:14:00 smithi081 ceph-mds[69598]: -- 172.21.15.81:0/323408248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f02ab3d860 con 0x55f02ab1b000 2024-09-12T12:14:00.524 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:14:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j[69576]: starting mds.j at 2024-09-12T12:14:00.524 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:14:00 smithi081 bash[69561]: 97081209fd1a60492288c1602361711d4c95d7c4a246b06cf6a9b4bf52087e1f 2024-09-12T12:14:00.524 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:14:00 smithi081 systemd[1]: Started Ceph mds.j for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:00.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 -- 172.21.15.81:0/3769205472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c106a80 msgr2=0x7fb77c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:00.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 --2- 172.21.15.81:0/3769205472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c106a80 0x7fb77c106e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb770009930 tx=0x7fb77002a420 comp rx=0 tx=0).stop 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 -- 172.21.15.81:0/3769205472 shutdown_connections 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 --2- 172.21.15.81:0/3769205472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb77c101420 0x7fb77c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 --2- 172.21.15.81:0/3769205472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c100a80 0x7fb77c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 --2- 172.21.15.81:0/3769205472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c106a80 0x7fb77c106e60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 -- 172.21.15.81:0/3769205472 >> 172.21.15.81:0/3769205472 conn(0x7fb77c0fc7a0 msgr2=0x7fb77c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 -- 172.21.15.81:0/3769205472 shutdown_connections 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.900+0000 7fb782e68640 1 -- 172.21.15.81:0/3769205472 wait complete. 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 Processor -- start 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 -- start start 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 0x7fb77c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb77c101420 0x7fb77c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c106a80 0x7fb77c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:00.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c110fa0 con 0x7fb77c100a80 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c110e20 con 0x7fb77c106a80 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb782e68640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c111120 con 0x7fb77c101420 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 0x7fb77c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 0x7fb77c199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46276/0 (socket says 172.21.15.81:46276) 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 -- 172.21.15.81:0/2147821105 learned_addr learned my addr 172.21.15.81:0/2147821105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb77bfff640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb77c101420 0x7fb77c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb781405640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c106a80 0x7fb77c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 -- 172.21.15.81:0/2147821105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb77c101420 msgr2=0x7fb77c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb77c101420 0x7fb77c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 -- 172.21.15.81:0/2147821105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c106a80 msgr2=0x7fb77c1a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c106a80 0x7fb77c1a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 -- 172.21.15.81:0/2147821105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c1a4930 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb781405640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c106a80 0x7fb77c1a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.901+0000 7fb780c04640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 0x7fb77c199370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb770009230 tx=0x7fb770004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.902+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77003f030 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.902+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c1a4b00 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.902+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb770003af0 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.902+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770035070 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.902+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c1a4f60 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.903+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c100ee0 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.905+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb770042030 con 0x7fb77c100a80 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.905+0000 7fb779ffb640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb76c0a2b80 0x7fb76c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.905+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fb7700ef780 con 0x7fb77c100a80 2024-09-12T12:14:00.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.905+0000 7fb77bfff640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb76c0a2b80 0x7fb76c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:00.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.906+0000 7fb77bfff640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb76c0a2b80 0x7fb76c0a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb77c06b2e0 tx=0x7fb76800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:00.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:00.909+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7700bcc40 con 0x7fb77c100a80 2024-09-12T12:14:01.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.122+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb77c1a5190 con 0x7fb77c100a80 2024-09-12T12:14:01.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.123+0000 7fb779ffb640 1 -- 172.21.15.81:0/2147821105 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7fb7700bc540 con 0x7fb77c100a80 2024-09-12T12:14:01.124 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:01.124 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"btime":"2024-09-12T12:14:00:263552+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T12:14:01.124 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 4 2024-09-12T12:14:01.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb76c0a2b80 msgr2=0x7fb76c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:01.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb76c0a2b80 0x7fb76c0a5040 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb77c06b2e0 tx=0x7fb76800b390 comp rx=0 tx=0).stop 2024-09-12T12:14:01.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 msgr2=0x7fb77c199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 0x7fb77c199370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb770009230 tx=0x7fb770004270 comp rx=0 tx=0).stop 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 shutdown_connections 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb76c0a2b80 0x7fb76c0a5040 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb77c106a80 0x7fb77c1a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb77c101420 0x7fb77c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 --2- 172.21.15.81:0/2147821105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb77c100a80 0x7fb77c199370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 >> 172.21.15.81:0/2147821105 conn(0x7fb77c0fc7a0 msgr2=0x7fb77c0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 shutdown_connections 2024-09-12T12:14:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:01.125+0000 7fb782e68640 1 -- 172.21.15.81:0/2147821105 wait complete. 2024-09-12T12:14:01.380 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.81:6834/4073646080,v1:172.21.15.81:6835/4073646080] up:boot 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: fsmap 3 up:standby 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: Deploying daemon mds.d on smithi081 2024-09-12T12:14:01.381 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:01 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2147821105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.81:6834/4073646080,v1:172.21.15.81:6835/4073646080] up:boot 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: fsmap 3 up:standby 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: Deploying daemon mds.d on smithi081 2024-09-12T12:14:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:01 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2147821105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.81:6834/4073646080,v1:172.21.15.81:6835/4073646080] up:boot 2024-09-12T12:14:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: fsmap 3 up:standby 2024-09-12T12:14:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:14:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: Deploying daemon mds.d on smithi081 2024-09-12T12:14:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:01 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2147821105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:03.360 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 systemd[1]: Starting Ceph mds.d for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:03.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:03 smithi173 ceph-mon[35326]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:03 smithi103 ceph-mon[35094]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:03.710 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:03 smithi081 ceph-mon[30948]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:03.710 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 podman[69976]: 2024-09-12 12:14:03.36760533 +0000 UTC m=+0.016393339 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:03.710 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 podman[69976]: 2024-09-12 12:14:03.499425869 +0000 UTC m=+0.148213874 container create 75db628b4dd69cebb972378c5ab51436fa572df8b498509f6ac0809579f05394 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T12:14:03.710 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 podman[69976]: 2024-09-12 12:14:03.710375215 +0000 UTC m=+0.359163219 container init 75db628b4dd69cebb972378c5ab51436fa572df8b498509f6ac0809579f05394 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T12:14:04.109 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 podman[69976]: 2024-09-12 12:14:03.713826436 +0000 UTC m=+0.362614435 container start 75db628b4dd69cebb972378c5ab51436fa572df8b498509f6ac0809579f05394 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:14:04.110 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 ceph-mds[69995]: -- 172.21.15.81:0/2960795279 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b98d35860 con 0x555b98d12800 2024-09-12T12:14:04.110 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d[69991]: starting mds.d at 2024-09-12T12:14:04.110 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 bash[69976]: 75db628b4dd69cebb972378c5ab51436fa572df8b498509f6ac0809579f05394 2024-09-12T12:14:04.110 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:14:03 smithi081 systemd[1]: Started Ceph mds.d for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:04.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:04.648 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:04.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: Deploying daemon mds.e on smithi103 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.81:6836/3120489264,v1:172.21.15.81:6837/3120489264] up:boot 2024-09-12T12:14:04.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: fsmap 4 up:standby 2024-09-12T12:14:04.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:04 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:14:05.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:05.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:05.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:05.077 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: Deploying daemon mds.e on smithi103 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.81:6836/3120489264,v1:172.21.15.81:6837/3120489264] up:boot 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: fsmap 4 up:standby 2024-09-12T12:14:05.078 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:04 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:14:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 -- 172.21.15.81:0/1638371720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8106f20 msgr2=0x7f8da810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/1638371720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8106f20 0x7f8da810eaa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009ca0 tx=0x7f8da002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 -- 172.21.15.81:0/1638371720 shutdown_connections 2024-09-12T12:14:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/1638371720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8106f20 0x7f8da810eaa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/1638371720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8da81027a0 0x7f8da81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/1638371720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da8101df0 0x7f8da81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 -- 172.21.15.81:0/1638371720 >> 172.21.15.81:0/1638371720 conn(0x7f8da80fd8f0 msgr2=0x7f8da80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 -- 172.21.15.81:0/1638371720 shutdown_connections 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.076+0000 7f8dacbc6640 1 -- 172.21.15.81:0/1638371720 wait complete. 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 Processor -- start 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 -- start start 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 0x7f8da81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da81027a0 0x7f8da8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8da8106f20 0x7f8da819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81120e0 con 0x7f8da8101df0 2024-09-12T12:14:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111f60 con 0x7f8da81027a0 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8dacbc6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8112260 con 0x7f8da8106f20 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8da659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 0x7f8da81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8da659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 0x7f8da81985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42950/0 (socket says 172.21.15.81:42950) 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8da659c640 1 -- 172.21.15.81:0/114008967 learned_addr learned my addr 172.21.15.81:0/114008967 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8da5d9b640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da81027a0 0x7f8da8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.077+0000 7f8da6d9d640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8da8106f20 0x7f8da819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da659c640 1 -- 172.21.15.81:0/114008967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8da8106f20 msgr2=0x7f8da819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da659c640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8da8106f20 0x7f8da819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da659c640 1 -- 172.21.15.81:0/114008967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da81027a0 msgr2=0x7f8da8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da659c640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da81027a0 0x7f8da8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da659c640 1 -- 172.21.15.81:0/114008967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da819d570 con 0x7f8da8101df0 2024-09-12T12:14:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da5d9b640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da81027a0 0x7f8da8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8da659c640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 0x7f8da81985c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800e9f0 tx=0x7f8d9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800ccc0 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da819d860 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d98010930 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98018980 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.078+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da81a5140 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.079+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8da81021d0 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.080+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8d98010ae0 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.081+0000 7f8d977fe640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8d900a2b80 0x7f8d900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.081+0000 7f8da5d9b640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8d900a2b80 0x7f8d900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.081+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f8d980cf3c0 con 0x7f8da8101df0 2024-09-12T12:14:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.081+0000 7f8da5d9b640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8d900a2b80 0x7f8d900a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8da8108890 tx=0x7f8d9c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.084+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d9809c7c0 con 0x7f8da8101df0 2024-09-12T12:14:05.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:05.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:05.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:05.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:05.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:05.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:05.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: Deploying daemon mds.e on smithi103 2024-09-12T12:14:05.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:05.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.81:6836/3120489264,v1:172.21.15.81:6837/3120489264] up:boot 2024-09-12T12:14:05.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: fsmap 4 up:standby 2024-09-12T12:14:05.157 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:04 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:14:05.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.283+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8da8199920 con 0x7f8da8101df0 2024-09-12T12:14:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.283+0000 7f8d977fe640 1 -- 172.21.15.81:0/114008967 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f8d9809c0c0 con 0x7f8da8101df0 2024-09-12T12:14:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"btime":"2024-09-12T12:14:04:380960+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T12:14:05.284 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 5 2024-09-12T12:14:05.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8d900a2b80 msgr2=0x7f8d900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8d900a2b80 0x7f8d900a5040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8da8108890 tx=0x7f8d9c009110 comp rx=0 tx=0).stop 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 msgr2=0x7f8da81985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 0x7f8da81985c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800e9f0 tx=0x7f8d9800edf0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 shutdown_connections 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8d900a2b80 0x7f8d900a5040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8da8106f20 0x7f8da819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8da81027a0 0x7f8da8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 --2- 172.21.15.81:0/114008967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8da8101df0 0x7f8da81985c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.285+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 >> 172.21.15.81:0/114008967 conn(0x7f8da80fd8f0 msgr2=0x7f8da80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.286+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 shutdown_connections 2024-09-12T12:14:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:05.286+0000 7f8dacbc6640 1 -- 172.21.15.81:0/114008967 wait complete. 2024-09-12T12:14:05.862 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:05 smithi103 systemd[1]: Starting Ceph mds.e for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:06.044 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:05 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/114008967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:06.132 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:05 smithi103 podman[64699]: 2024-09-12 12:14:05.793959894 +0000 UTC m=+0.015890175 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:06.132 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:05 smithi103 podman[64699]: 2024-09-12 12:14:05.89667066 +0000 UTC m=+0.118600995 container create 374ff74323ff0f6de5f352c97d34029386d156522db34a4d0c0b23319d2e9106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-12T12:14:06.133 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:05 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/114008967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:06.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:05 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/114008967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:06.435 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:06 smithi103 podman[64699]: 2024-09-12 12:14:06.13308635 +0000 UTC m=+0.355016635 container init 374ff74323ff0f6de5f352c97d34029386d156522db34a4d0c0b23319d2e9106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:14:06.436 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:06 smithi103 podman[64699]: 2024-09-12 12:14:06.136069912 +0000 UTC m=+0.358000197 container start 374ff74323ff0f6de5f352c97d34029386d156522db34a4d0c0b23319d2e9106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:14:06.436 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:06 smithi103 ceph-mds[64718]: -- 172.21.15.103:0/1798862751 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55742e797860 con 0x55742e775000 2024-09-12T12:14:06.436 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e[64714]: starting mds.e at 2024-09-12T12:14:06.436 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:06 smithi103 bash[64699]: 374ff74323ff0f6de5f352c97d34029386d156522db34a4d0c0b23319d2e9106 2024-09-12T12:14:06.436 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:14:06 smithi103 systemd[1]: Started Ceph mds.e for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:07.351 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: Deploying daemon mds.f on smithi173 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] up:boot 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: fsmap 5 up:standby 2024-09-12T12:14:07.352 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:07 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: Deploying daemon mds.f on smithi173 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] up:boot 2024-09-12T12:14:07.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: fsmap 5 up:standby 2024-09-12T12:14:07.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:07 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:14:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: Deploying daemon mds.f on smithi173 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] up:boot 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: fsmap 5 up:standby 2024-09-12T12:14:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:07 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:14:08.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:08.306 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:08.368 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 systemd[1]: Starting Ceph mds.f for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:08.622 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 podman[64969]: 2024-09-12 12:14:08.368888005 +0000 UTC m=+0.106597222 container create e0790123f71387e1fbfa8c4ba396a38ba6d898e87528d1ee11a006c7fa68514a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T12:14:08.622 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 podman[64969]: 2024-09-12 12:14:08.278257387 +0000 UTC m=+0.015966613 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:08.622 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 podman[64969]: 2024-09-12 12:14:08.596023038 +0000 UTC m=+0.333732256 container init e0790123f71387e1fbfa8c4ba396a38ba6d898e87528d1ee11a006c7fa68514a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:14:08.622 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 podman[64969]: 2024-09-12 12:14:08.598917025 +0000 UTC m=+0.336626248 container start e0790123f71387e1fbfa8c4ba396a38ba6d898e87528d1ee11a006c7fa68514a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T12:14:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 -- 172.21.15.81:0/3062639765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4100a70 msgr2=0x7f73a4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/3062639765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4100a70 0x7f73a4100ed0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7394009930 tx=0x7f739402a420 comp rx=0 tx=0).stop 2024-09-12T12:14:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 -- 172.21.15.81:0/3062639765 shutdown_connections 2024-09-12T12:14:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/3062639765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73a4101410 0x7f73a410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/3062639765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4100a70 0x7f73a4100ed0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/3062639765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73a4106a70 0x7f73a4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.777+0000 7f73ab3c7640 1 -- 172.21.15.81:0/3062639765 >> 172.21.15.81:0/3062639765 conn(0x7f73a40fc790 msgr2=0x7f73a40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 -- 172.21.15.81:0/3062639765 shutdown_connections 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 -- 172.21.15.81:0/3062639765 wait complete. 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 Processor -- start 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 -- start start 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73a4100a70 0x7f73a4197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 0x7f73a4197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73a4106a70 0x7f73a419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4110f90 con 0x7f73a4101410 2024-09-12T12:14:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4110e10 con 0x7f73a4106a70 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.778+0000 7f73ab3c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4111110 con 0x7f73a4100a70 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 0x7f73a4197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 0x7f73a4197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42958/0 (socket says 172.21.15.81:42958) 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 -- 172.21.15.81:0/2337508693 learned_addr learned my addr 172.21.15.81:0/2337508693 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a9163640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73a4100a70 0x7f73a4197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a9964640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73a4106a70 0x7f73a419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 -- 172.21.15.81:0/2337508693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73a4100a70 msgr2=0x7f73a4197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73a4100a70 0x7f73a4197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 -- 172.21.15.81:0/2337508693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73a4106a70 msgr2=0x7f73a419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73a4106a70 0x7f73a419bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 -- 172.21.15.81:0/2337508693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a419c3e0 con 0x7f73a4101410 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73a8962640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 0x7f73a4197970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7394009230 tx=0x7f7394004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739403f030 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7394004440 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a419c670 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394035070 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.779+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a41a3fb0 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.780+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a4100ed0 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.781+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7394042030 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.782+0000 7f739a7fc640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f73900a2b80 0x7f73900a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.782+0000 7f73a9163640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f73900a2b80 0x7f73900a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.782+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f73940eef30 con 0x7f73a4101410 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.782+0000 7f73a9163640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f73900a2b80 0x7f73900a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009b50 tx=0x7f73a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.786+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73940bc330 con 0x7f73a4101410 2024-09-12T12:14:08.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 ceph-mds[64988]: -- 172.21.15.173:0/2596970466 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578b50c5860 con 0x5578b50a3000 2024-09-12T12:14:08.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f[64984]: starting mds.f at 2024-09-12T12:14:08.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 bash[64969]: e0790123f71387e1fbfa8c4ba396a38ba6d898e87528d1ee11a006c7fa68514a 2024-09-12T12:14:08.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:14:08 smithi173 systemd[1]: Started Ceph mds.f for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.989+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73a41a41b0 con 0x7f73a4101410 2024-09-12T12:14:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.990+0000 7f739a7fc640 1 -- 172.21.15.81:0/2337508693 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f73940bbc30 con 0x7f73a4101410 2024-09-12T12:14:08.990 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:08.990 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":6,"btime":"2024-09-12T12:14:06:862954+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T12:14:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 6 2024-09-12T12:14:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f73900a2b80 msgr2=0x7f73900a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f73900a2b80 0x7f73900a5040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009b50 tx=0x7f73a0005f90 comp rx=0 tx=0).stop 2024-09-12T12:14:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 msgr2=0x7f73a4197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 0x7f73a4197970 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7394009230 tx=0x7f7394004040 comp rx=0 tx=0).stop 2024-09-12T12:14:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 shutdown_connections 2024-09-12T12:14:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f73900a2b80 0x7f73900a5040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73a4106a70 0x7f73a419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a4101410 0x7f73a4197970 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 --2- 172.21.15.81:0/2337508693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73a4100a70 0x7f73a4197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 >> 172.21.15.81:0/2337508693 conn(0x7f73a40fc790 msgr2=0x7f73a40fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 shutdown_connections 2024-09-12T12:14:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:08.992+0000 7f73ab3c7640 1 -- 172.21.15.81:0/2337508693 wait complete. 2024-09-12T12:14:09.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:09.436 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:09.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:09.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:09.437 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:09 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2337508693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:09.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:09 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2337508693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:09.718 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:09 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2337508693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:10.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:10 smithi173 ceph-mon[35326]: Deploying daemon mds.c on smithi173 2024-09-12T12:14:10.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:10 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6834/3014376257,v1:172.21.15.173:6835/3014376257] up:boot 2024-09-12T12:14:10.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:10 smithi173 ceph-mon[35326]: fsmap 6 up:standby 2024-09-12T12:14:10.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:10 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:14:10.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:10 smithi103 ceph-mon[35094]: Deploying daemon mds.c on smithi173 2024-09-12T12:14:10.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:10 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6834/3014376257,v1:172.21.15.173:6835/3014376257] up:boot 2024-09-12T12:14:10.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:10 smithi103 ceph-mon[35094]: fsmap 6 up:standby 2024-09-12T12:14:10.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:10 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:14:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:10 smithi081 ceph-mon[30948]: Deploying daemon mds.c on smithi173 2024-09-12T12:14:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:10 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6834/3014376257,v1:172.21.15.173:6835/3014376257] up:boot 2024-09-12T12:14:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:10 smithi081 ceph-mon[30948]: fsmap 6 up:standby 2024-09-12T12:14:10.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:10 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:14:11.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:11.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:11.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:11.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:11 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:11.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:11.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:11 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:11.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:11.776 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:11 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:12.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.546+0000 7f2873d79640 1 -- 172.21.15.81:0/226242119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c106f10 msgr2=0x7f286c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.546+0000 7f2873d79640 1 --2- 172.21.15.81:0/226242119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c106f10 0x7f286c10ea90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2864009ca0 tx=0x7f286402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.547+0000 7f2873d79640 1 -- 172.21.15.81:0/226242119 shutdown_connections 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.547+0000 7f2873d79640 1 --2- 172.21.15.81:0/226242119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c106f10 0x7f286c10ea90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.547+0000 7f2873d79640 1 --2- 172.21.15.81:0/226242119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f286c102790 0x7f286c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.547+0000 7f2873d79640 1 --2- 172.21.15.81:0/226242119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f286c101de0 0x7f286c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.547+0000 7f2873d79640 1 -- 172.21.15.81:0/226242119 >> 172.21.15.81:0/226242119 conn(0x7f286c0fd8c0 msgr2=0x7f286c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.547+0000 7f2873d79640 1 -- 172.21.15.81:0/226242119 shutdown_connections 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 -- 172.21.15.81:0/226242119 wait complete. 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 Processor -- start 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 -- start start 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f286c101de0 0x7f286c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:12.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 0x7f286c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f286c106f10 0x7f286c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f286c112090 con 0x7f286c102790 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f286c111f10 con 0x7f286c106f10 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2873d79640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f286c112210 con 0x7f286c101de0 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.548+0000 7f2871314640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 0x7f286c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 0x7f286c1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38122/0 (socket says 172.21.15.81:38122) 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 -- 172.21.15.81:0/3671920890 learned_addr learned my addr 172.21.15.81:0/3671920890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871b15640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f286c101de0 0x7f286c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2872316640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f286c106f10 0x7f286c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 -- 172.21.15.81:0/3671920890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f286c101de0 msgr2=0x7f286c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f286c101de0 0x7f286c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 -- 172.21.15.81:0/3671920890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f286c106f10 msgr2=0x7f286c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:12.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f286c106f10 0x7f286c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 -- 172.21.15.81:0/3671920890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c19d260 con 0x7f286c102790 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2871314640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 0x7f286c1987f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f285c00d770 tx=0x7f285c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c017070 con 0x7f286c102790 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c19d550 con 0x7f286c102790 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f285c005520 con 0x7f286c102790 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c010460 con 0x7f286c102790 2024-09-12T12:14:12.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.549+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1a4e30 con 0x7f286c102790 2024-09-12T12:14:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.551+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c199610 con 0x7f286c102790 2024-09-12T12:14:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.551+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f285c004ea0 con 0x7f286c102790 2024-09-12T12:14:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.552+0000 7f2862ffd640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f28580a2b80 0x7f28580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.552+0000 7f2871b15640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f28580a2b80 0x7f28580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.553+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f285c0ce690 con 0x7f286c102790 2024-09-12T12:14:12.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.553+0000 7f2871b15640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f28580a2b80 0x7f28580a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2868009bd0 tx=0x7f2868005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:12.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.556+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f285c09b9f0 con 0x7f286c102790 2024-09-12T12:14:12.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:12 smithi103 ceph-mon[35094]: Deploying daemon mds.h on smithi103 2024-09-12T12:14:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:12 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] up:boot 2024-09-12T12:14:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:12 smithi103 ceph-mon[35094]: fsmap 7 up:standby 2024-09-12T12:14:12.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:12 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:14:12.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:12 smithi081 ceph-mon[30948]: Deploying daemon mds.h on smithi103 2024-09-12T12:14:12.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:12 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] up:boot 2024-09-12T12:14:12.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:12 smithi081 ceph-mon[30948]: fsmap 7 up:standby 2024-09-12T12:14:12.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:12 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:14:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.794+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f286c1a51d0 con 0x7f286c102790 2024-09-12T12:14:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.795+0000 7f2862ffd640 1 -- 172.21.15.81:0/3671920890 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f285c09b2f0 con 0x7f286c102790 2024-09-12T12:14:12.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:12.795 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"btime":"2024-09-12T12:14:11:396016+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-12T12:14:12.795 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2024-09-12T12:14:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f28580a2b80 msgr2=0x7f28580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f28580a2b80 0x7f28580a5040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2868009bd0 tx=0x7f2868005f90 comp rx=0 tx=0).stop 2024-09-12T12:14:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 msgr2=0x7f286c1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 0x7f286c1987f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f285c00d770 tx=0x7f285c00dc30 comp rx=0 tx=0).stop 2024-09-12T12:14:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 shutdown_connections 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f28580a2b80 0x7f28580a5040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f286c106f10 0x7f286c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286c102790 0x7f286c1987f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 --2- 172.21.15.81:0/3671920890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f286c101de0 0x7f286c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 >> 172.21.15.81:0/3671920890 conn(0x7f286c0fd8c0 msgr2=0x7f286c0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 shutdown_connections 2024-09-12T12:14:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:12.797+0000 7f2873d79640 1 -- 172.21.15.81:0/3671920890 wait complete. 2024-09-12T12:14:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:12 smithi173 ceph-mon[35326]: Deploying daemon mds.h on smithi103 2024-09-12T12:14:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:12 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] up:boot 2024-09-12T12:14:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:12 smithi173 ceph-mon[35326]: fsmap 7 up:standby 2024-09-12T12:14:12.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:12 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:14:13.409 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 systemd[1]: Starting Ceph mds.h for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:13.527 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:13 smithi081 ceph-mon[30948]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:13.527 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:13 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3671920890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:13 smithi103 ceph-mon[35094]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:13 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3671920890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:13.685 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 podman[64999]: 2024-09-12 12:14:13.360916231 +0000 UTC m=+0.016844989 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:13.686 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 podman[64999]: 2024-09-12 12:14:13.476478962 +0000 UTC m=+0.132407708 container create a9ecb9b59d86d8b9a636fe1cd2eb46081bed95f70094778fd75edba2e2d975b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:14:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:13 smithi173 ceph-mon[35326]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:13 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3671920890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:14.185 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 podman[64999]: 2024-09-12 12:14:13.712479442 +0000 UTC m=+0.368408200 container init a9ecb9b59d86d8b9a636fe1cd2eb46081bed95f70094778fd75edba2e2d975b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:14:14.186 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 podman[64999]: 2024-09-12 12:14:13.715255918 +0000 UTC m=+0.371184666 container start a9ecb9b59d86d8b9a636fe1cd2eb46081bed95f70094778fd75edba2e2d975b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T12:14:14.186 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 ceph-mds[65018]: -- 172.21.15.103:0/1887605508 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633a587d860 con 0x5633a585b400 2024-09-12T12:14:14.186 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h[65014]: starting mds.h at 2024-09-12T12:14:14.186 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 bash[64999]: a9ecb9b59d86d8b9a636fe1cd2eb46081bed95f70094778fd75edba2e2d975b5 2024-09-12T12:14:14.186 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:14:13 smithi103 systemd[1]: Started Ceph mds.h for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:15.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: Deploying daemon mds.i on smithi173 2024-09-12T12:14:15.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:15.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] up:boot 2024-09-12T12:14:15.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: fsmap 8 up:standby 2024-09-12T12:14:15.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:14 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:14:15.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: Deploying daemon mds.i on smithi173 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] up:boot 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: fsmap 8 up:standby 2024-09-12T12:14:15.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:14 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: Deploying daemon mds.i on smithi173 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] up:boot 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: fsmap 8 up:standby 2024-09-12T12:14:15.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:14 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:14:15.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:16.066 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:15 smithi173 systemd[1]: Starting Ceph mds.i for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:16.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 -- 172.21.15.81:0/1471414208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102ef0 msgr2=0x7f9d1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:16.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/1471414208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102ef0 0x7f9d1010da40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009ca0 tx=0x7f9d0802a950 comp rx=0 tx=0).stop 2024-09-12T12:14:16.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 -- 172.21.15.81:0/1471414208 shutdown_connections 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/1471414208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102ef0 0x7f9d1010da40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/1471414208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d10102570 0x7f9d101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/1471414208 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d10100e20 0x7f9d10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 -- 172.21.15.81:0/1471414208 >> 172.21.15.81:0/1471414208 conn(0x7f9d100fc7d0 msgr2=0x7f9d100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 -- 172.21.15.81:0/1471414208 shutdown_connections 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.311+0000 7f9d17ab8640 1 -- 172.21.15.81:0/1471414208 wait complete. 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 Processor -- start 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 -- start start 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d10100e20 0x7f9d100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 0x7f9d100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d10102ef0 0x7f9d100fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101110a0 con 0x7f9d10102570 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10110f20 con 0x7f9d10100e20 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d17ab8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10111220 con 0x7f9d10102ef0 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 0x7f9d100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 0x7f9d100fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38148/0 (socket says 172.21.15.81:38148) 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 -- 172.21.15.81:0/873018888 learned_addr learned my addr 172.21.15.81:0/873018888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d16055640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d10102ef0 0x7f9d100fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15854640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d10100e20 0x7f9d100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 -- 172.21.15.81:0/873018888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d10102ef0 msgr2=0x7f9d100fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:16.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d10102ef0 0x7f9d100fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 -- 172.21.15.81:0/873018888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d10100e20 msgr2=0x7f9d100fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d10100e20 0x7f9d100fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 -- 172.21.15.81:0/873018888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d101a6a30 con 0x7f9d10102570 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.312+0000 7f9d15053640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 0x7f9d100fd1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e9f0 tx=0x7f9d0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.313+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000cd80 con 0x7f9d10102570 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.313+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d00010930 con 0x7f9d10102570 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.313+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d101a6d20 con 0x7f9d10102570 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.313+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00018b00 con 0x7f9d10102570 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.313+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101a7200 con 0x7f9d10102570 2024-09-12T12:14:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.314+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d10101200 con 0x7f9d10102570 2024-09-12T12:14:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.315+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9d00018ca0 con 0x7f9d10102570 2024-09-12T12:14:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.316+0000 7f9d06ffd640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9cfc0a2c00 0x7f9cfc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.316+0000 7f9d15854640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9cfc0a2c00 0x7f9cfc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.316+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f9d000cf260 con 0x7f9d10102570 2024-09-12T12:14:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.316+0000 7f9d15854640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9cfc0a2c00 0x7f9cfc0a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009bd0 tx=0x7f9d0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.319+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d0009bf70 con 0x7f9d10102570 2024-09-12T12:14:16.343 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 podman[65569]: 2024-09-12 12:14:16.066592738 +0000 UTC m=+0.108593626 container create 6620330d374a38e534988b8213897d9b20b6c81d1ccaf5660e9846db63d38b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:14:16.343 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 podman[65569]: 2024-09-12 12:14:15.974110517 +0000 UTC m=+0.016111415 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:16.343 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 podman[65569]: 2024-09-12 12:14:16.28552723 +0000 UTC m=+0.327528117 container init 6620330d374a38e534988b8213897d9b20b6c81d1ccaf5660e9846db63d38b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T12:14:16.344 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 podman[65569]: 2024-09-12 12:14:16.28816644 +0000 UTC m=+0.330167330 container start 6620330d374a38e534988b8213897d9b20b6c81d1ccaf5660e9846db63d38b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T12:14:16.344 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 ceph-mds[65589]: -- 172.21.15.173:0/789738752 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561171abf860 con 0x561171a9d000 2024-09-12T12:14:16.344 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i[65585]: starting mds.i at 2024-09-12T12:14:16.344 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 bash[65569]: 6620330d374a38e534988b8213897d9b20b6c81d1ccaf5660e9846db63d38b73 2024-09-12T12:14:16.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.531+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d1010a0d0 con 0x7f9d10102570 2024-09-12T12:14:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.531+0000 7f9d06ffd640 1 -- 172.21.15.81:0/873018888 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f9d000a0270 con 0x7f9d10102570 2024-09-12T12:14:16.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:16.532 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"btime":"2024-09-12T12:14:16:370450+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T12:14:16.532 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 10 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9cfc0a2c00 msgr2=0x7f9cfc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9cfc0a2c00 0x7f9cfc0a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009bd0 tx=0x7f9d0c005f90 comp rx=0 tx=0).stop 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 msgr2=0x7f9d100fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 0x7f9d100fd1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e9f0 tx=0x7f9d0000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 shutdown_connections 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9cfc0a2c00 0x7f9cfc0a50c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d10102ef0 0x7f9d100fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d10102570 0x7f9d100fd1c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 --2- 172.21.15.81:0/873018888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d10100e20 0x7f9d100fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 >> 172.21.15.81:0/873018888 conn(0x7f9d100fc7d0 msgr2=0x7f9d1006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 shutdown_connections 2024-09-12T12:14:16.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:16.534+0000 7f9d17ab8640 1 -- 172.21.15.81:0/873018888 wait complete. 2024-09-12T12:14:16.653 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:14:16 smithi173 systemd[1]: Started Ceph mds.i for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:17.583 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:17.583 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] up:boot 2024-09-12T12:14:17.583 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: fsmap 9 up:standby 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: Deploying daemon mds.g on smithi081 2024-09-12T12:14:17.584 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:17 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/873018888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] up:boot 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: fsmap 9 up:standby 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: Deploying daemon mds.g on smithi081 2024-09-12T12:14:17.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:17 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/873018888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] up:boot 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: fsmap 9 up:standby 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: Deploying daemon mds.g on smithi081 2024-09-12T12:14:17.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:17 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/873018888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:19.107 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:18 smithi081 systemd[1]: Starting Ceph mds.g for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:19.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:19.359 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 podman[70750]: 2024-09-12 12:14:19.010251552 +0000 UTC m=+0.015614423 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:19.360 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 podman[70750]: 2024-09-12 12:14:19.113374112 +0000 UTC m=+0.118737032 container create 474301c7659fa740bc19ebf707a35d5903cbb971d0bb846967c01cd6b1ab2d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T12:14:19.550 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:19.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:19 smithi173 ceph-mon[35326]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:19.672 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:19 smithi081 ceph-mon[30948]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:19.673 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 podman[70750]: 2024-09-12 12:14:19.39093296 +0000 UTC m=+0.396295819 container init 474301c7659fa740bc19ebf707a35d5903cbb971d0bb846967c01cd6b1ab2d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T12:14:19.673 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 podman[70750]: 2024-09-12 12:14:19.394036123 +0000 UTC m=+0.399398982 container start 474301c7659fa740bc19ebf707a35d5903cbb971d0bb846967c01cd6b1ab2d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:14:19.673 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 ceph-mds[70787]: -- 172.21.15.81:0/3802649101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559252ef3860 con 0x559252ed1400 2024-09-12T12:14:19.673 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g[70765]: starting mds.g at 2024-09-12T12:14:19.673 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 bash[70750]: 474301c7659fa740bc19ebf707a35d5903cbb971d0bb846967c01cd6b1ab2d2d 2024-09-12T12:14:19.673 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:14:19 smithi081 systemd[1]: Started Ceph mds.g for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:19 smithi103 ceph-mon[35094]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 -- 172.21.15.81:0/2574237850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77501027a0 msgr2=0x7f77501067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 --2- 172.21.15.81:0/2574237850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77501027a0 0x7f77501067f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7738009900 tx=0x7f773802a410 comp rx=0 tx=0).stop 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 -- 172.21.15.81:0/2574237850 shutdown_connections 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 --2- 172.21.15.81:0/2574237850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 0x7f775010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 --2- 172.21.15.81:0/2574237850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77501027a0 0x7f77501067f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 --2- 172.21.15.81:0/2574237850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7750101df0 0x7f77501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 -- 172.21.15.81:0/2574237850 >> 172.21.15.81:0/2574237850 conn(0x7f77500fd8b0 msgr2=0x7f77500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 -- 172.21.15.81:0/2574237850 shutdown_connections 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.007+0000 7f7754a7e640 1 -- 172.21.15.81:0/2574237850 wait complete. 2024-09-12T12:14:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 Processor -- start 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 -- start start 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 0x7f77501984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77501027a0 0x7f7750198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 0x7f775019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77501120a0 con 0x7f7750101df0 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7750111f20 con 0x7f7750106f20 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f7754a7e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7750112220 con 0x7f77501027a0 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 0x7f77501984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 0x7f77501984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38188/0 (socket says 172.21.15.81:38188) 2024-09-12T12:14:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 -- 172.21.15.81:0/1550096188 learned_addr learned my addr 172.21.15.81:0/1550096188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774ed9d640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 0x7f775019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774dd9b640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77501027a0 0x7f7750198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 -- 172.21.15.81:0/1550096188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77501027a0 msgr2=0x7f7750198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77501027a0 0x7f7750198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 -- 172.21.15.81:0/1550096188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 msgr2=0x7f775019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 0x7f775019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.008+0000 7f774e59c640 1 -- 172.21.15.81:0/1550096188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775019d490 con 0x7f7750101df0 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f774dd9b640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77501027a0 0x7f7750198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f774ed9d640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 0x7f775019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f774e59c640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 0x7f77501984e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f774800ea80 tx=0x7f774800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774800ce40 con 0x7f7750101df0 2024-09-12T12:14:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775019d780 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7748004b20 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748011830 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.009+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77501a5060 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.010+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77501021d0 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.011+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7748004cd0 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.012+0000 7f77477fe640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f773c0a2b80 0x7f773c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.012+0000 7f774dd9b640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f773c0a2b80 0x7f773c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.012+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f77480cf2c0 con 0x7f7750101df0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.012+0000 7f774dd9b640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f773c0a2b80 0x7f773c0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77500fdd40 tx=0x7f7738005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.015+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7748016030 con 0x7f7750101df0 2024-09-12T12:14:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.221+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f775010a160 con 0x7f7750101df0 2024-09-12T12:14:20.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.222+0000 7f77477fe640 1 -- 172.21.15.81:0/1550096188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f774809c6c0 con 0x7f7750101df0 2024-09-12T12:14:20.223 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:20.224 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"btime":"2024-09-12T12:14:16:370450+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T12:14:20.224 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 10 2024-09-12T12:14:20.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f773c0a2b80 msgr2=0x7f773c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:20.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f773c0a2b80 0x7f773c0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f77500fdd40 tx=0x7f7738005a20 comp rx=0 tx=0).stop 2024-09-12T12:14:20.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 msgr2=0x7f77501984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 0x7f77501984e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f774800ea80 tx=0x7f774800ef40 comp rx=0 tx=0).stop 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 shutdown_connections 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f773c0a2b80 0x7f773c0a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7750106f20 0x7f775019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77501027a0 0x7f7750198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 --2- 172.21.15.81:0/1550096188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7750101df0 0x7f77501984e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 >> 172.21.15.81:0/1550096188 conn(0x7f77500fd8b0 msgr2=0x7f77500fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 shutdown_connections 2024-09-12T12:14:20.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:20.224+0000 7f7754a7e640 1 -- 172.21.15.81:0/1550096188 wait complete. 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: Deploying daemon mds.a on smithi081 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1550096188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.81:6838/3279635401,v1:172.21.15.81:6839/3279635401] up:boot 2024-09-12T12:14:20.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: fsmap 10 up:standby 2024-09-12T12:14:20.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:20 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:14:20.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: Deploying daemon mds.a on smithi081 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1550096188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.81:6838/3279635401,v1:172.21.15.81:6839/3279635401] up:boot 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: fsmap 10 up:standby 2024-09-12T12:14:20.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:20 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:14:20.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: Deploying daemon mds.a on smithi081 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1550096188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.81:6838/3279635401,v1:172.21.15.81:6839/3279635401] up:boot 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: fsmap 10 up:standby 2024-09-12T12:14:20.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:20 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:14:22.360 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 systemd[1]: Starting Ceph mds.a for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:14:22.735 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 podman[71163]: 2024-09-12 12:14:22.385918713 +0000 UTC m=+0.015738151 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:14:22.736 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 podman[71163]: 2024-09-12 12:14:22.508934182 +0000 UTC m=+0.138753604 container create ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:14:22.736 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 podman[71163]: 2024-09-12 12:14:22.736255603 +0000 UTC m=+0.366075023 container init ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T12:14:23.110 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 podman[71163]: 2024-09-12 12:14:22.738972232 +0000 UTC m=+0.368791655 container start ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:14:23.110 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 ceph-mds[71182]: -- 172.21.15.81:0/2848881984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8d76d9860 con 0x55c8d76b6800 2024-09-12T12:14:23.110 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a[71178]: starting mds.a at 2024-09-12T12:14:23.110 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 bash[71163]: ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 2024-09-12T12:14:23.110 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:14:22 smithi081 systemd[1]: Started Ceph mds.a for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:23.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:23.653 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:23 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:23.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:23 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:23.755 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:23.755 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.755 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.755 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:23.755 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T12:14:23.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T12:14:23.756 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:23 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 -- 172.21.15.81:0/3296736485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204101420 msgr2=0x7fa20410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 --2- 172.21.15.81:0/3296736485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204101420 0x7fa20410d950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009cd0 tx=0x7fa1f402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 -- 172.21.15.81:0/3296736485 shutdown_connections 2024-09-12T12:14:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 --2- 172.21.15.81:0/3296736485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204101420 0x7fa20410d950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 --2- 172.21.15.81:0/3296736485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204100a80 0x7fa204100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 --2- 172.21.15.81:0/3296736485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204106a80 0x7fa204106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 -- 172.21.15.81:0/3296736485 >> 172.21.15.81:0/3296736485 conn(0x7fa2040fc7a0 msgr2=0x7fa2040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 -- 172.21.15.81:0/3296736485 shutdown_connections 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.111+0000 7fa20c19e640 1 -- 172.21.15.81:0/3296736485 wait complete. 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 Processor -- start 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 -- start start 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 0x7fa204198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204101420 0x7fa204198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204106a80 0x7fa20419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa204110fe0 con 0x7fa204100a80 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa204110e60 con 0x7fa204101420 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20c19e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa204111160 con 0x7fa204106a80 2024-09-12T12:14:24.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 0x7fa204198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 0x7fa204198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37940/0 (socket says 172.21.15.81:37940) 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 -- 172.21.15.81:0/825692667 learned_addr learned my addr 172.21.15.81:0/825692667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa20a73b640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204106a80 0x7fa20419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209739640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204101420 0x7fa204198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 -- 172.21.15.81:0/825692667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204106a80 msgr2=0x7fa20419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204106a80 0x7fa20419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 -- 172.21.15.81:0/825692667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204101420 msgr2=0x7fa204198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204101420 0x7fa204198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 -- 172.21.15.81:0/825692667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20419d4f0 con 0x7fa204100a80 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209739640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204101420 0x7fa204198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.112+0000 7fa209f3a640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 0x7fa204198540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b4a0 tx=0x7fa1fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.113+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc014070 con 0x7fa204100a80 2024-09-12T12:14:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.113+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1fc010b10 con 0x7fa204100a80 2024-09-12T12:14:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.113+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20419d7e0 con 0x7fa204100a80 2024-09-12T12:14:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.113+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc017d60 con 0x7fa204100a80 2024-09-12T12:14:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.113+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041a50c0 con 0x7fa204100a80 2024-09-12T12:14:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.114+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa204100ee0 con 0x7fa204100a80 2024-09-12T12:14:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.115+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa1fc017070 con 0x7fa204100a80 2024-09-12T12:14:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.116+0000 7fa202ffd640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa1ec0a2c00 0x7fa1ec0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.116+0000 7fa209739640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa1ec0a2c00 0x7fa1ec0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.116+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fa1fc0ce390 con 0x7fa204100a80 2024-09-12T12:14:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.116+0000 7fa209739640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa1ec0a2c00 0x7fa1ec0a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa20406b870 tx=0x7fa1f8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:24.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.119+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1fc09b790 con 0x7fa204100a80 2024-09-12T12:14:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.320+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2041998a0 con 0x7fa204100a80 2024-09-12T12:14:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.320+0000 7fa202ffd640 1 -- 172.21.15.81:0/825692667 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7fa1fc09b090 con 0x7fa204100a80 2024-09-12T12:14:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:24.321 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"btime":"2024-09-12T12:14:23:382669+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-12T12:14:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa1ec0a2c00 msgr2=0x7fa1ec0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa1ec0a2c00 0x7fa1ec0a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa20406b870 tx=0x7fa1f8005e50 comp rx=0 tx=0).stop 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 msgr2=0x7fa204198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 0x7fa204198540 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b4a0 tx=0x7fa1fc00b960 comp rx=0 tx=0).stop 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 shutdown_connections 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa1ec0a2c00 0x7fa1ec0a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa204106a80 0x7fa20419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa204101420 0x7fa204198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 --2- 172.21.15.81:0/825692667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204100a80 0x7fa204198540 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.323+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 >> 172.21.15.81:0/825692667 conn(0x7fa2040fc7a0 msgr2=0x7fa204104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.324+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 shutdown_connections 2024-09-12T12:14:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:24.324+0000 7fa20c19e640 1 -- 172.21.15.81:0/825692667 wait complete. 2024-09-12T12:14:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:24 smithi081 ceph-mon[30948]: Deploying daemon mds.b on smithi103 2024-09-12T12:14:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:24 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.81:6840/1006182135,v1:172.21.15.81:6841/1006182135] up:boot 2024-09-12T12:14:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:24 smithi081 ceph-mon[30948]: fsmap 11 up:standby 2024-09-12T12:14:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:24 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:14:24.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:24 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/825692667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:24.628 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:24 smithi103 ceph-mon[35094]: Deploying daemon mds.b on smithi103 2024-09-12T12:14:24.628 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:24 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.81:6840/1006182135,v1:172.21.15.81:6841/1006182135] up:boot 2024-09-12T12:14:24.628 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:24 smithi103 ceph-mon[35094]: fsmap 11 up:standby 2024-09-12T12:14:24.629 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:24 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:14:24.629 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:24 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/825692667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:24.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:24 smithi173 ceph-mon[35326]: Deploying daemon mds.b on smithi103 2024-09-12T12:14:24.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:24 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.81:6840/1006182135,v1:172.21.15.81:6841/1006182135] up:boot 2024-09-12T12:14:24.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:24 smithi173 ceph-mon[35326]: fsmap 11 up:standby 2024-09-12T12:14:24.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:24 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:14:24.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:24 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/825692667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:25 smithi173 ceph-mon[35326]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:25 smithi103 ceph-mon[35094]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:25.685 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:14:25 smithi103 systemd[1]: Started Ceph mds.b for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:14:25.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:25 smithi081 ceph-mon[30948]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:26.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] up:boot 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: fsmap 12 up:standby 2024-09-12T12:14:26.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:26 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:14:26.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] up:boot 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: fsmap 12 up:standby 2024-09-12T12:14:26.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:26 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:14:26.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:27.015 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:27.015 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:27.015 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:27.015 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:27.015 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:27.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:14:27.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:27.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] up:boot 2024-09-12T12:14:27.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: fsmap 12 up:standby 2024-09-12T12:14:27.016 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:26 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:14:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 -- 172.21.15.81:0/175577891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 msgr2=0x7fa5cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/175577891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc1029b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009900 tx=0x7fa5c002a480 comp rx=0 tx=0).stop 2024-09-12T12:14:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 -- 172.21.15.81:0/175577891 shutdown_connections 2024-09-12T12:14:27.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/175577891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5cc102ef0 0x7fa5cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/175577891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc1029b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/175577891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5cc100e20 0x7fa5cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 -- 172.21.15.81:0/175577891 >> 172.21.15.81:0/175577891 conn(0x7fa5cc0fc7d0 msgr2=0x7fa5cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 -- 172.21.15.81:0/175577891 shutdown_connections 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.787+0000 7fa5d26ac640 1 -- 172.21.15.81:0/175577891 wait complete. 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 Processor -- start 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 -- start start 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5cc100e20 0x7fa5cc1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5cc102ef0 0x7fa5cc19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc1110a0 con 0x7fa5cc102570 2024-09-12T12:14:27.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc110f20 con 0x7fa5cc102ef0 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.788+0000 7fa5d26ac640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc111220 con 0x7fa5cc100e20 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37968/0 (socket says 172.21.15.81:37968) 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 -- 172.21.15.81:0/2932920406 learned_addr learned my addr 172.21.15.81:0/2932920406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cbfff640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5cc100e20 0x7fa5cc1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5d0c49640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5cc102ef0 0x7fa5cc19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 -- 172.21.15.81:0/2932920406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5cc100e20 msgr2=0x7fa5cc1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5cc100e20 0x7fa5cc1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 -- 172.21.15.81:0/2932920406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5cc102ef0 msgr2=0x7fa5cc19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5cc102ef0 0x7fa5cc19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 -- 172.21.15.81:0/2932920406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc19d550 con 0x7fa5cc102570 2024-09-12T12:14:27.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5cb7fe640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc198ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0006010 tx=0x7fa5c0004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c003f030 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc19d7e0 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5c0005500 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0035070 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.789+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc1a5120 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.790+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc101200 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.792+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa5c0042030 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.792+0000 7fa5c97fa640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5b40a2b80 0x7fa5b40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.792+0000 7fa5cbfff640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5b40a2b80 0x7fa5b40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.792+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fa5c00ef510 con 0x7fa5cc102570 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.793+0000 7fa5cbfff640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5b40a2b80 0x7fa5b40a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009bd0 tx=0x7fa5bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:27.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:27.795+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5c00bc2c0 con 0x7fa5cc102570 2024-09-12T12:14:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.019+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5cc10a0a0 con 0x7fa5cc102570 2024-09-12T12:14:28.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.020+0000 7fa5c97fa640 1 -- 172.21.15.81:0/2932920406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7fa5c00c05c0 con 0x7fa5cc102570 2024-09-12T12:14:28.021 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:28.021 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"btime":"2024-09-12T12:14:26:396543+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24436,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24485,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T12:14:28.021 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 13 2024-09-12T12:14:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5b40a2b80 msgr2=0x7fa5b40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5b40a2b80 0x7fa5b40a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009bd0 tx=0x7fa5bc005f90 comp rx=0 tx=0).stop 2024-09-12T12:14:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 msgr2=0x7fa5cc198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc198ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0006010 tx=0x7fa5c0004c00 comp rx=0 tx=0).stop 2024-09-12T12:14:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 shutdown_connections 2024-09-12T12:14:28.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa5b40a2b80 0x7fa5b40a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:28.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5cc102ef0 0x7fa5cc19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:28.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc102570 0x7fa5cc198ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:28.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 --2- 172.21.15.81:0/2932920406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5cc100e20 0x7fa5cc1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:28.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 >> 172.21.15.81:0/2932920406 conn(0x7fa5cc0fc7d0 msgr2=0x7fa5cc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:28.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 shutdown_connections 2024-09-12T12:14:28.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:28.023+0000 7fa5d26ac640 1 -- 172.21.15.81:0/2932920406 wait complete. 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:28.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:14:28.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:14:28.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:28 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2932920406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:14:28.431 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.432 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:14:28.432 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:28 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2932920406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:28.449 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:14:28.450 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:28 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2932920406' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:28.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T12:14:29.415 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:29.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:29 smithi103 ceph-mon[35094]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:29.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:29 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:29 smithi081 ceph-mon[30948]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:29 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:29 smithi173 ceph-mon[35326]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:29 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 -- 172.21.15.81:0/4071144933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298101de0 msgr2=0x7f62981021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 --2- 172.21.15.81:0/4071144933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298101de0 0x7f62981021c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6294009900 tx=0x7f629402a410 comp rx=0 tx=0).stop 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 -- 172.21.15.81:0/4071144933 shutdown_connections 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 --2- 172.21.15.81:0/4071144933 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6298106f10 0x7f629810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 --2- 172.21.15.81:0/4071144933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 0x7f62981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 --2- 172.21.15.81:0/4071144933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298101de0 0x7f62981021c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 -- 172.21.15.81:0/4071144933 >> 172.21.15.81:0/4071144933 conn(0x7f62980fd880 msgr2=0x7f62980ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 -- 172.21.15.81:0/4071144933 shutdown_connections 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.918+0000 7f62a005f640 1 -- 172.21.15.81:0/4071144933 wait complete. 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 Processor -- start 2024-09-12T12:14:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 -- start start 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6298101de0 0x7f629819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 0x7f629819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 0x7f629819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62981120d0 con 0x7f6298106f10 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6298111f50 con 0x7f6298102790 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f62a005f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6298112250 con 0x7f6298101de0 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 0x7f629819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 0x7f629819dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37980/0 (socket says 172.21.15.81:37980) 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 -- 172.21.15.81:0/1101454481 learned_addr learned my addr 172.21.15.81:0/1101454481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629d5fa640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 0x7f629819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629ddfb640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6298101de0 0x7f629819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 -- 172.21.15.81:0/1101454481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6298101de0 msgr2=0x7f629819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6298101de0 0x7f629819a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 -- 172.21.15.81:0/1101454481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 msgr2=0x7f629819acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 0x7f629819acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 -- 172.21.15.81:0/1101454481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629819e700 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629d5fa640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 0x7f629819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.919+0000 7f629e5fc640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 0x7f629819dfd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f629000b970 tx=0x7f629000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.920+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290019070 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.920+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629819e9f0 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.920+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f629000cb40 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.920+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6290007700 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.920+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62981a7360 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.921+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62981021c0 con 0x7f6298106f10 2024-09-12T12:14:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.922+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f629001c070 con 0x7f6298106f10 2024-09-12T12:14:29.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.922+0000 7f628affd640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f62840a2b80 0x7f62840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:29.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.923+0000 7f629ddfb640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f62840a2b80 0x7f62840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:29.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.923+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f62900ce5c0 con 0x7f6298106f10 2024-09-12T12:14:29.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.923+0000 7f629ddfb640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f62840a2b80 0x7f62840a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6294005ab0 tx=0x7f6294005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:29.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:29.926+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f629009b370 con 0x7f6298106f10 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.107+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f62981a7620 con 0x7f6298106f10 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.108+0000 7f628affd640 1 -- 172.21.15.81:0/1101454481 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f629009f670 con 0x7f6298106f10 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-12T12:14:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-12T12:14:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:14:30.109 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-12T12:14:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f62840a2b80 msgr2=0x7f62840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f62840a2b80 0x7f62840a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6294005ab0 tx=0x7f6294005a20 comp rx=0 tx=0).stop 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 msgr2=0x7f629819dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 0x7f629819dfd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f629000b970 tx=0x7f629000be30 comp rx=0 tx=0).stop 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 shutdown_connections 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f62840a2b80 0x7f62840a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6298106f10 0x7f629819dfd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6298102790 0x7f629819acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 --2- 172.21.15.81:0/1101454481 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6298101de0 0x7f629819a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 >> 172.21.15.81:0/1101454481 conn(0x7f62980fd880 msgr2=0x7f62980feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.110+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 shutdown_connections 2024-09-12T12:14:30.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:30.111+0000 7f62a005f640 1 -- 172.21.15.81:0/1101454481 wait complete. 2024-09-12T12:14:30.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:30 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1101454481' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:14:30.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:30 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1101454481' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:14:30.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:30 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1101454481' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T12:14:30.743 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T12:14:30.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T12:14:31.022 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:31.462 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:31 smithi081 ceph-mon[30948]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:31.462 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.462 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.463 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:31.463 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:14:31.463 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 -- 172.21.15.81:0/3944954557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102570 msgr2=0x7ff3a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 --2- 172.21.15.81:0/3944954557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102570 0x7ff3a41029b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff390009900 tx=0x7ff39002a480 comp rx=0 tx=0).stop 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 -- 172.21.15.81:0/3944954557 shutdown_connections 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 --2- 172.21.15.81:0/3944954557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4102ef0 0x7ff3a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 --2- 172.21.15.81:0/3944954557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102570 0x7ff3a41029b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 --2- 172.21.15.81:0/3944954557 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4100e20 0x7ff3a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 -- 172.21.15.81:0/3944954557 >> 172.21.15.81:0/3944954557 conn(0x7ff3a40fc7d0 msgr2=0x7ff3a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 -- 172.21.15.81:0/3944954557 shutdown_connections 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.462+0000 7ff3aae72640 1 -- 172.21.15.81:0/3944954557 wait complete. 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 Processor -- start 2024-09-12T12:14:31.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 -- start start 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4100e20 0x7ff3a4198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4102570 0x7ff3a4198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 0x7ff3a419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4111160 con 0x7ff3a4102ef0 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a4110fe0 con 0x7ff3a4100e20 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3aae72640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a41112e0 con 0x7ff3a4102570 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 0x7ff3a419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 0x7ff3a419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37988/0 (socket says 172.21.15.81:37988) 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 -- 172.21.15.81:0/1712644665 learned_addr learned my addr 172.21.15.81:0/1712644665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a8c0e640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4100e20 0x7ff3a4198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a3fff640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4102570 0x7ff3a4198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:31.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 -- 172.21.15.81:0/1712644665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4102570 msgr2=0x7ff3a4198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4102570 0x7ff3a4198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 -- 172.21.15.81:0/1712644665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4100e20 msgr2=0x7ff3a4198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4100e20 0x7ff3a4198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 -- 172.21.15.81:0/1712644665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a419d620 con 0x7ff3a4102ef0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a8c0e640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4100e20 0x7ff3a4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.463+0000 7ff3a940f640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 0x7ff3a419cf40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00b970 tx=0x7ff39c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.464+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c019070 con 0x7ff3a4102ef0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.464+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a419d910 con 0x7ff3a4102ef0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.464+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff39c00cb40 con 0x7ff3a4102ef0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.464+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c007700 con 0x7ff3a4102ef0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.464+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a41a51f0 con 0x7ff3a4102ef0 2024-09-12T12:14:31.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.465+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a4101200 con 0x7ff3a4102ef0 2024-09-12T12:14:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.466+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff39c01c070 con 0x7ff3a4102ef0 2024-09-12T12:14:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.466+0000 7ff3a1ffb640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff3940a2b80 0x7ff3940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.467+0000 7ff3a8c0e640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff3940a2b80 0x7ff3940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.467+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7ff39c0ce1e0 con 0x7ff3a4102ef0 2024-09-12T12:14:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.467+0000 7ff3a8c0e640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff3940a2b80 0x7ff3940a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff398006fd0 tx=0x7ff398008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:31.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.471+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff39c09b5e0 con 0x7ff3a4102ef0 2024-09-12T12:14:31.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:31.641+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff3a410a0a0 con 0x7ff3a4102ef0 2024-09-12T12:14:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:31 smithi173 ceph-mon[35326]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:14:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:31 smithi103 ceph-mon[35094]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:14:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:14:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:14:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.341+0000 7ff3a1ffb640 1 -- 172.21.15.81:0/1712644665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7ff39c09aee0 con 0x7ff3a4102ef0 2024-09-12T12:14:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.343+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff3940a2b80 msgr2=0x7ff3940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.343+0000 7ff3aae72640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff3940a2b80 0x7ff3940a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff398006fd0 tx=0x7ff398008040 comp rx=0 tx=0).stop 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.343+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 msgr2=0x7ff3a419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.343+0000 7ff3aae72640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 0x7ff3a419cf40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00b970 tx=0x7ff39c00be30 comp rx=0 tx=0).stop 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 shutdown_connections 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff3940a2b80 0x7ff3940a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3a4102ef0 0x7ff3a419cf40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3a4102570 0x7ff3a4198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 --2- 172.21.15.81:0/1712644665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3a4100e20 0x7ff3a4198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 >> 172.21.15.81:0/1712644665 conn(0x7ff3a40fc7d0 msgr2=0x7ff3a406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 shutdown_connections 2024-09-12T12:14:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:32.344+0000 7ff3aae72640 1 -- 172.21.15.81:0/1712644665 wait complete. 2024-09-12T12:14:32.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:32 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1712644665' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:14:32.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:32 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1712644665' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:14:32.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:32 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1712644665' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T12:14:33.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T12:14:33.257 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:33 smithi081 ceph-mon[30948]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:33 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1712644665' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:14:33.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:33 smithi081 ceph-mon[30948]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T12:14:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:33 smithi173 ceph-mon[35326]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:33.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:33 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1712644665' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:14:33.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:33 smithi173 ceph-mon[35326]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T12:14:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:33 smithi103 ceph-mon[35094]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:33 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1712644665' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T12:14:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:33 smithi103 ceph-mon[35094]: osdmap e73: 12 total, 12 up, 12 in 2024-09-12T12:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 -- 172.21.15.81:0/1864459295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608102ef0 msgr2=0x7f560810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 --2- 172.21.15.81:0/1864459295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608102ef0 0x7f560810da40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5600009900 tx=0x7f560002a480 comp rx=0 tx=0).stop 2024-09-12T12:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 -- 172.21.15.81:0/1864459295 shutdown_connections 2024-09-12T12:14:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 --2- 172.21.15.81:0/1864459295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608102ef0 0x7f560810da40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 --2- 172.21.15.81:0/1864459295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5608102570 0x7f56081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 --2- 172.21.15.81:0/1864459295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5608100e20 0x7f5608101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 -- 172.21.15.81:0/1864459295 >> 172.21.15.81:0/1864459295 conn(0x7f56080fc7d0 msgr2=0x7f56080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 -- 172.21.15.81:0/1864459295 shutdown_connections 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.789+0000 7f560f905640 1 -- 172.21.15.81:0/1864459295 wait complete. 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 Processor -- start 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 -- start start 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 0x7f5608198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5608102570 0x7f5608198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5608102ef0 0x7f560819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56081110a0 con 0x7f5608100e20 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5608110f20 con 0x7f5608102570 2024-09-12T12:14:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560f905640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5608111220 con 0x7f5608102ef0 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560d6a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 0x7f5608198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560d6a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 0x7f5608198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52524/0 (socket says 172.21.15.81:52524) 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.790+0000 7f560d6a1640 1 -- 172.21.15.81:0/290382721 learned_addr learned my addr 172.21.15.81:0/290382721 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560cea0640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5608102570 0x7f5608198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560dea2640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5608102ef0 0x7f560819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560d6a1640 1 -- 172.21.15.81:0/290382721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5608102ef0 msgr2=0x7f560819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560d6a1640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5608102ef0 0x7f560819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560d6a1640 1 -- 172.21.15.81:0/290382721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5608102570 msgr2=0x7f5608198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560d6a1640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5608102570 0x7f5608198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560d6a1640 1 -- 172.21.15.81:0/290382721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560819d4e0 con 0x7f5608100e20 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560d6a1640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 0x7f5608198530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55f800db80 tx=0x7f55f800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8017070 con 0x7f5608100e20 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560819d7d0 con 0x7f5608100e20 2024-09-12T12:14:33.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55f8003b70 con 0x7f5608100e20 2024-09-12T12:14:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f80106c0 con 0x7f5608100e20 2024-09-12T12:14:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.791+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56081a50b0 con 0x7f5608100e20 2024-09-12T12:14:33.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.792+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5608101200 con 0x7f5608100e20 2024-09-12T12:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.793+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f55f8004020 con 0x7f5608100e20 2024-09-12T12:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.794+0000 7f56067fc640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f55f00a2b80 0x7f55f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.794+0000 7f560cea0640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f55f00a2b80 0x7f55f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.794+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7497+0+0 (secure 0 0 0) 0x7f55f80ceae0 con 0x7f5608100e20 2024-09-12T12:14:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.794+0000 7f560cea0640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f55f00a2b80 0x7f55f00a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56081051b0 tx=0x7f55fc00c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:33.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.798+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55f8020070 con 0x7f5608100e20 2024-09-12T12:14:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:33.966+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f560810a0a0 con 0x7f5608100e20 2024-09-12T12:14:34.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.344+0000 7f56067fc640 1 -- 172.21.15.81:0/290382721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) ==== 170+0+0 (secure 0 0 0) 0x7f55f8019310 con 0x7f5608100e20 2024-09-12T12:14:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-12T12:14:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f55f00a2b80 msgr2=0x7f55f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:34.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f55f00a2b80 0x7f55f00a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56081051b0 tx=0x7f55fc00c4a0 comp rx=0 tx=0).stop 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 msgr2=0x7f5608198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 0x7f5608198530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55f800db80 tx=0x7f55f800b630 comp rx=0 tx=0).stop 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 shutdown_connections 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f55f00a2b80 0x7f55f00a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5608102ef0 0x7f560819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5608102570 0x7f5608198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 --2- 172.21.15.81:0/290382721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5608100e20 0x7f5608198530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 >> 172.21.15.81:0/290382721 conn(0x7f56080fc7d0 msgr2=0x7f560806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 shutdown_connections 2024-09-12T12:14:34.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:34.347+0000 7f560f905640 1 -- 172.21.15.81:0/290382721 wait complete. 2024-09-12T12:14:34.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:34 smithi081 ceph-mon[30948]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T12:14:34.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:34 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/290382721' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:14:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:34 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/290382721' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:14:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:34 smithi081 ceph-mon[30948]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T12:14:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:34 smithi173 ceph-mon[35326]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T12:14:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:34 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/290382721' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:14:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:34 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/290382721' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:14:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:34 smithi173 ceph-mon[35326]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T12:14:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:34 smithi103 ceph-mon[35094]: osdmap e74: 12 total, 12 up, 12 in 2024-09-12T12:14:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:34 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/290382721' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T12:14:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:34 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/290382721' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T12:14:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:34 smithi103 ceph-mon[35094]: osdmap e75: 12 total, 12 up, 12 in 2024-09-12T12:14:35.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T12:14:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:35.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:35 smithi081 ceph-mon[30948]: pgmap v267: 33 pgs: 9 creating+peering, 17 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:35 smithi081 ceph-mon[30948]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:14:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:35 smithi081 ceph-mon[30948]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:14:35.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:35 smithi173 ceph-mon[35326]: pgmap v267: 33 pgs: 9 creating+peering, 17 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:35.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:35 smithi173 ceph-mon[35326]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:14:35.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:35 smithi173 ceph-mon[35326]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:14:35.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:35 smithi103 ceph-mon[35094]: pgmap v267: 33 pgs: 9 creating+peering, 17 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:35.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:35 smithi103 ceph-mon[35094]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T12:14:35.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:35 smithi103 ceph-mon[35094]: osdmap e76: 12 total, 12 up, 12 in 2024-09-12T12:14:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 -- 172.21.15.81:0/4097508247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 msgr2=0x7f65a01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 --2- 172.21.15.81:0/4097508247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a01067e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6588009900 tx=0x7f658802a410 comp rx=0 tx=0).stop 2024-09-12T12:14:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 -- 172.21.15.81:0/4097508247 shutdown_connections 2024-09-12T12:14:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 --2- 172.21.15.81:0/4097508247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a0106f10 0x7f65a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 --2- 172.21.15.81:0/4097508247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a01067e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 --2- 172.21.15.81:0/4097508247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65a0101de0 0x7f65a01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 -- 172.21.15.81:0/4097508247 >> 172.21.15.81:0/4097508247 conn(0x7f65a00fd8c0 msgr2=0x7f65a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 -- 172.21.15.81:0/4097508247 shutdown_connections 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.701+0000 7f65a49ec640 1 -- 172.21.15.81:0/4097508247 wait complete. 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 Processor -- start 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 -- start start 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65a0101de0 0x7f65a0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:35.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a0198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a0106f10 0x7f65a019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0112050 con 0x7f65a0102790 2024-09-12T12:14:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0111ed0 con 0x7f65a0106f10 2024-09-12T12:14:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f65a49ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f65a01121d0 con 0x7f65a0101de0 2024-09-12T12:14:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a0198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a0198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52550/0 (socket says 172.21.15.81:52550) 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 -- 172.21.15.81:0/223288746 learned_addr learned my addr 172.21.15.81:0/223288746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f659ed9d640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a0106f10 0x7f65a019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f659e59c640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65a0101de0 0x7f65a0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 -- 172.21.15.81:0/223288746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65a0101de0 msgr2=0x7f65a0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65a0101de0 0x7f65a0198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 -- 172.21.15.81:0/223288746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a0106f10 msgr2=0x7f65a019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a0106f10 0x7f65a019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.702+0000 7f6597fff640 1 -- 172.21.15.81:0/223288746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a019d500 con 0x7f65a0102790 2024-09-12T12:14:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.703+0000 7f6597fff640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a0198a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6588006010 tx=0x7f65880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.703+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658803f030 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.703+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a019d790 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.703+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6588003d00 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.703+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588035070 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.703+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a01a50d0 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.704+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a01021c0 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.705+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6588042030 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.705+0000 7f65977fe640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f658c0a2b80 0x7f658c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.706+0000 7f659e59c640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f658c0a2b80 0x7f658c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.706+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7879+0+0 (secure 0 0 0) 0x7f65880ef730 con 0x7f65a0102790 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.706+0000 7f659e59c640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f658c0a2b80 0x7f658c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f65900058c0 tx=0x7f6590005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.709+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65880bc900 con 0x7f65a0102790 2024-09-12T12:14:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:35.909+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f65a010a150 con 0x7f65a0102790 2024-09-12T12:14:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.378+0000 7f65977fe640 1 -- 172.21.15.81:0/223288746 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f65880bc200 con 0x7f65a0102790 2024-09-12T12:14:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T12:14:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f658c0a2b80 msgr2=0x7f658c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f658c0a2b80 0x7f658c0a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f65900058c0 tx=0x7f6590005c60 comp rx=0 tx=0).stop 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 msgr2=0x7f65a0198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a0198a90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6588006010 tx=0x7f65880042f0 comp rx=0 tx=0).stop 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 shutdown_connections 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f658c0a2b80 0x7f658c0a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65a0106f10 0x7f65a019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a0102790 0x7f65a0198a90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 --2- 172.21.15.81:0/223288746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65a0101de0 0x7f65a0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 >> 172.21.15.81:0/223288746 conn(0x7f65a00fd8c0 msgr2=0x7f65a00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 shutdown_connections 2024-09-12T12:14:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:36.380+0000 7f65a49ec640 1 -- 172.21.15.81:0/223288746 wait complete. 2024-09-12T12:14:36.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:36 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/223288746' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:14:36.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:36 smithi173 ceph-mon[35326]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T12:14:36.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:36 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/223288746' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:14:36.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:36 smithi103 ceph-mon[35094]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T12:14:36.732 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:36 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/223288746' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T12:14:36.732 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:36 smithi081 ceph-mon[30948]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T12:14:37.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:14:37.281 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:37.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:37 smithi081 ceph-mon[30948]: pgmap v270: 97 pgs: 29 creating+peering, 42 unknown, 26 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:37.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:37 smithi081 ceph-mon[30948]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:14:37.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:37 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/223288746' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:14:37.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:37 smithi081 ceph-mon[30948]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T12:14:37.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:37 smithi081 ceph-mon[30948]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T12:14:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:37 smithi173 ceph-mon[35326]: pgmap v270: 97 pgs: 29 creating+peering, 42 unknown, 26 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:37 smithi173 ceph-mon[35326]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:14:37.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:37 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/223288746' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:14:37.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:37 smithi173 ceph-mon[35326]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T12:14:37.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:37 smithi173 ceph-mon[35326]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T12:14:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:37 smithi103 ceph-mon[35094]: pgmap v270: 97 pgs: 29 creating+peering, 42 unknown, 26 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:14:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:37 smithi103 ceph-mon[35094]: osdmap e77: 12 total, 12 up, 12 in 2024-09-12T12:14:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:37 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/223288746' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T12:14:37.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:37 smithi103 ceph-mon[35094]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T12:14:37.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:37 smithi103 ceph-mon[35094]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.704+0000 7f8599230640 1 -- 172.21.15.81:0/2956303265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594102ef0 msgr2=0x7f859410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.704+0000 7f8599230640 1 --2- 172.21.15.81:0/2956303265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594102ef0 0x7f859410da40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8584009900 tx=0x7f858402a480 comp rx=0 tx=0).stop 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 -- 172.21.15.81:0/2956303265 shutdown_connections 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 --2- 172.21.15.81:0/2956303265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594102ef0 0x7f859410da40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 --2- 172.21.15.81:0/2956303265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102570 0x7f85941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 --2- 172.21.15.81:0/2956303265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594100e20 0x7f8594101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 -- 172.21.15.81:0/2956303265 >> 172.21.15.81:0/2956303265 conn(0x7f85940fc7d0 msgr2=0x7f85940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 -- 172.21.15.81:0/2956303265 shutdown_connections 2024-09-12T12:14:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 -- 172.21.15.81:0/2956303265 wait complete. 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.705+0000 7f8599230640 1 Processor -- start 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 -- start start 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 0x7f859410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594102570 0x7f859410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102ef0 0x7f859410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f85941121e0 con 0x7f8594100e20 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8594112060 con 0x7f8594102570 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8599230640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8594112360 con 0x7f8594102ef0 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 0x7f859410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 0x7f859410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52564/0 (socket says 172.21.15.81:52564) 2024-09-12T12:14:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 -- 172.21.15.81:0/1171115293 learned_addr learned my addr 172.21.15.81:0/1171115293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f859359e640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102ef0 0x7f859410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f859259c640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594102570 0x7f859410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 -- 172.21.15.81:0/1171115293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102ef0 msgr2=0x7f859410ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102ef0 0x7f859410ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 -- 172.21.15.81:0/1171115293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594102570 msgr2=0x7f859410ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594102570 0x7f859410ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 -- 172.21.15.81:0/1171115293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85941a6a80 con 0x7f8594100e20 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f859259c640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594102570 0x7f859410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f859359e640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102ef0 0x7f859410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.706+0000 7f8592d9d640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 0x7f859410e4d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f858c00cce0 tx=0x7f858c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.707+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c004b20 con 0x7f8594100e20 2024-09-12T12:14:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.707+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f858c004cc0 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.707+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85941a6d70 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.707+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c00f870 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.707+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85941a7250 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.708+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8594101200 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.709+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f858c00fa10 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.710+0000 7f858bfff640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f85800a2b80 0x7f85800a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.710+0000 7f859259c640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f85800a2b80 0x7f85800a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.710+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f858c0cf4f0 con 0x7f8594100e20 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.710+0000 7f859259c640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f85800a2b80 0x7f85800a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f857c006fd0 tx=0x7f857c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.713+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f858c014030 con 0x7f8594100e20 2024-09-12T12:14:37.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.880+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f859410fa00 con 0x7f8594100e20 2024-09-12T12:14:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.882+0000 7f858bfff640 1 -- 172.21.15.81:0/1171115293 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22303 (secure 0 0 0) 0x7f858c09c500 con 0x7f8594100e20 2024-09-12T12:14:37.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:37.882 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:35.910751+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f85800a2b80 msgr2=0x7f85800a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f85800a2b80 0x7f85800a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f857c006fd0 tx=0x7f857c008040 comp rx=0 tx=0).stop 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 msgr2=0x7f859410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 0x7f859410e4d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f858c00cce0 tx=0x7f858c00a620 comp rx=0 tx=0).stop 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 shutdown_connections 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f85800a2b80 0x7f85800a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8594102ef0 0x7f859410ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8594102570 0x7f859410ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 --2- 172.21.15.81:0/1171115293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8594100e20 0x7f859410e4d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:37.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 >> 172.21.15.81:0/1171115293 conn(0x7f85940fc7d0 msgr2=0x7f85941067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:37.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 shutdown_connections 2024-09-12T12:14:37.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:37.884+0000 7f8599230640 1 -- 172.21.15.81:0/1171115293 wait complete. 2024-09-12T12:14:38.473 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:38 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] up:active 2024-09-12T12:14:38.473 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:38 smithi081 ceph-mon[30948]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:38.473 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:38 smithi081 ceph-mon[30948]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:38.473 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:38 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1171115293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:38.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:14:38.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:38 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] up:active 2024-09-12T12:14:38.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:38 smithi173 ceph-mon[35326]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:38.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:38 smithi173 ceph-mon[35326]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:38.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:38 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1171115293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:38.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:38 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] up:active 2024-09-12T12:14:38.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:38 smithi103 ceph-mon[35094]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:38.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:38 smithi103 ceph-mon[35094]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:38.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:38 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1171115293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:38.745 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 -- 172.21.15.81:0/2267761040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574100e20 msgr2=0x7f1574101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 --2- 172.21.15.81:0/2267761040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574100e20 0x7f1574101200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f156c009900 tx=0x7f156c02a480 comp rx=0 tx=0).stop 2024-09-12T12:14:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 -- 172.21.15.81:0/2267761040 shutdown_connections 2024-09-12T12:14:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 --2- 172.21.15.81:0/2267761040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574102ef0 0x7f157410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 --2- 172.21.15.81:0/2267761040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1574102570 0x7f15741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 --2- 172.21.15.81:0/2267761040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574100e20 0x7f1574101200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 -- 172.21.15.81:0/2267761040 >> 172.21.15.81:0/2267761040 conn(0x7f15740fc7d0 msgr2=0x7f15740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 -- 172.21.15.81:0/2267761040 shutdown_connections 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 -- 172.21.15.81:0/2267761040 wait complete. 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 Processor -- start 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 -- start start 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.220+0000 7f157ab3b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574100e20 0x7f15741986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f157ab3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 0x7f1574198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f157ab3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1574102ef0 0x7f157419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f157ab3b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1574112230 con 0x7f1574102570 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f157ab3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f15741120b0 con 0x7f1574102ef0 2024-09-12T12:14:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f157ab3b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f15741123b0 con 0x7f1574100e20 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 0x7f1574198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 0x7f1574198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52586/0 (socket says 172.21.15.81:52586) 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 -- 172.21.15.81:0/1673604858 learned_addr learned my addr 172.21.15.81:0/1673604858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f15788d7640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574100e20 0x7f15741986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 -- 172.21.15.81:0/1673604858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574100e20 msgr2=0x7f15741986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574100e20 0x7f15741986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 -- 172.21.15.81:0/1673604858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1574102ef0 msgr2=0x7f157419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f15790d8640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1574102ef0 0x7f157419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1574102ef0 0x7f157419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 -- 172.21.15.81:0/1673604858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157419d660 con 0x7f1574102570 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f15788d7640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574100e20 0x7f15741986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1573fff640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 0x7f1574198bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f156400ba50 tx=0x7f156400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564019070 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157419d950 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f156400cbe0 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.221+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564007770 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.222+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15741a5230 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.222+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1574101200 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.223+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f156401c070 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.224+0000 7f1571ffb640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15600a2b80 0x7f15600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.224+0000 7f15788d7640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15600a2b80 0x7f15600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.224+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f15640ce590 con 0x7f1574102570 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.224+0000 7f15788d7640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15600a2b80 0x7f15600a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f156c000c00 tx=0x7f156c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.228+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f156409b640 con 0x7f1574102570 2024-09-12T12:14:39.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.395+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15741a5430 con 0x7f1574102570 2024-09-12T12:14:39.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:39 smithi081 ceph-mon[30948]: pgmap v272: 97 pgs: 20 creating+peering, 11 unknown, 66 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-12T12:14:39.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:39 smithi081 ceph-mon[30948]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:14:39.396 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:39 smithi081 ceph-mon[30948]: Cluster is now healthy 2024-09-12T12:14:39.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.397+0000 7f1571ffb640 1 -- 172.21.15.81:0/1673604858 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22303 (secure 0 0 0) 0x7f156409af40 con 0x7f1574102570 2024-09-12T12:14:39.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:39.397 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:35.910751+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:14:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15600a2b80 msgr2=0x7f15600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15600a2b80 0x7f15600a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f156c000c00 tx=0x7f156c005a20 comp rx=0 tx=0).stop 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 msgr2=0x7f1574198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 0x7f1574198bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f156400ba50 tx=0x7f156400bf10 comp rx=0 tx=0).stop 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 shutdown_connections 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f15600a2b80 0x7f15600a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1574102ef0 0x7f157419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1574102570 0x7f1574198bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 --2- 172.21.15.81:0/1673604858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1574100e20 0x7f15741986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 >> 172.21.15.81:0/1673604858 conn(0x7f15740fc7d0 msgr2=0x7f15740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 shutdown_connections 2024-09-12T12:14:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:39.399+0000 7f157ab3b640 1 -- 172.21.15.81:0/1673604858 wait complete. 2024-09-12T12:14:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:39 smithi173 ceph-mon[35326]: pgmap v272: 97 pgs: 20 creating+peering, 11 unknown, 66 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-12T12:14:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:39 smithi173 ceph-mon[35326]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:14:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:39 smithi173 ceph-mon[35326]: Cluster is now healthy 2024-09-12T12:14:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:39 smithi103 ceph-mon[35094]: pgmap v272: 97 pgs: 20 creating+peering, 11 unknown, 66 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 6 op/s 2024-09-12T12:14:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:39 smithi103 ceph-mon[35094]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T12:14:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:39 smithi103 ceph-mon[35094]: Cluster is now healthy 2024-09-12T12:14:40.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T12:14:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:40.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:40 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1673604858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:40.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:40 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1673604858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:40 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1673604858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:40.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.817+0000 7fdafa40b640 1 -- 172.21.15.81:0/3906698786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4101420 msgr2=0x7fdaf410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:40.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.817+0000 7fdafa40b640 1 --2- 172.21.15.81:0/3906698786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4101420 0x7fdaf410d950 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009cd0 tx=0x7fdaec02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 -- 172.21.15.81:0/3906698786 shutdown_connections 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 --2- 172.21.15.81:0/3906698786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4101420 0x7fdaf410d950 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 --2- 172.21.15.81:0/3906698786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaf4100a80 0x7fdaf4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 --2- 172.21.15.81:0/3906698786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf4106a80 0x7fdaf4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 -- 172.21.15.81:0/3906698786 >> 172.21.15.81:0/3906698786 conn(0x7fdaf40fc7a0 msgr2=0x7fdaf40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 -- 172.21.15.81:0/3906698786 shutdown_connections 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 -- 172.21.15.81:0/3906698786 wait complete. 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 Processor -- start 2024-09-12T12:14:40.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.818+0000 7fdafa40b640 1 -- start start 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf4100a80 0x7fdaf4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaf4101420 0x7fdaf4198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 0x7fdaf419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4110fa0 con 0x7fdaf4106a80 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4110e20 con 0x7fdaf4101420 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4111120 con 0x7fdaf4100a80 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 0x7fdaf419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 0x7fdaf419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52612/0 (socket says 172.21.15.81:52612) 2024-09-12T12:14:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 -- 172.21.15.81:0/4015005416 learned_addr learned my addr 172.21.15.81:0/4015005416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf37fe640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaf4101420 0x7fdaf4198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf3fff640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf4100a80 0x7fdaf4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 -- 172.21.15.81:0/4015005416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf4100a80 msgr2=0x7fdaf4198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf4100a80 0x7fdaf4198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 -- 172.21.15.81:0/4015005416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaf4101420 msgr2=0x7fdaf4198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaf4101420 0x7fdaf4198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 -- 172.21.15.81:0/4015005416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf419d3b0 con 0x7fdaf4106a80 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf89a8640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 0x7fdaf419ccd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009ca0 tx=0x7fdaec003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec004040 con 0x7fdaf4106a80 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaec0046e0 con 0x7fdaf4106a80 2024-09-12T12:14:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf419d640 con 0x7fdaf4106a80 2024-09-12T12:14:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.819+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaec030de0 con 0x7fdaf4106a80 2024-09-12T12:14:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.820+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf41a4f80 con 0x7fdaf4106a80 2024-09-12T12:14:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.820+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf4106e60 con 0x7fdaf4106a80 2024-09-12T12:14:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.821+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdaec0305a0 con 0x7fdaf4106a80 2024-09-12T12:14:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.822+0000 7fdaf17fa640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdadc0a2b80 0x7fdadc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.822+0000 7fdaf3fff640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdadc0a2b80 0x7fdadc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.822+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fdaec02e030 con 0x7fdaf4106a80 2024-09-12T12:14:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.823+0000 7fdaf3fff640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdadc0a2b80 0x7fdadc0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdae400ab60 tx=0x7fdae400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:40.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:40.826+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdaec04b060 con 0x7fdaf4106a80 2024-09-12T12:14:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.026+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdaf41a5150 con 0x7fdaf4106a80 2024-09-12T12:14:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.395+0000 7fdaf17fa640 1 -- 172.21.15.81:0/4015005416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fdaec0bd6d0 con 0x7fdaf4106a80 2024-09-12T12:14:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdadc0a2b80 msgr2=0x7fdadc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdadc0a2b80 0x7fdadc0a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdae400ab60 tx=0x7fdae400a2d0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 msgr2=0x7fdaf419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 0x7fdaf419ccd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009ca0 tx=0x7fdaec003f80 comp rx=0 tx=0).stop 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 shutdown_connections 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdadc0a2b80 0x7fdadc0a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaf4106a80 0x7fdaf419ccd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaf4101420 0x7fdaf4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 --2- 172.21.15.81:0/4015005416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaf4100a80 0x7fdaf4198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 >> 172.21.15.81:0/4015005416 conn(0x7fdaf40fc7a0 msgr2=0x7fdaf406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 shutdown_connections 2024-09-12T12:14:41.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:41.398+0000 7fdafa40b640 1 -- 172.21.15.81:0/4015005416 wait complete. 2024-09-12T12:14:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:41 smithi173 ceph-mon[35326]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:14:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:41 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/4015005416' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:14:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:41 smithi103 ceph-mon[35094]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:14:41.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:41 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/4015005416' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:14:41.686 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:14:41 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: 2024-09-12T12:14:41.404+0000 7f9c61d72640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T12:14:41.770 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:41 smithi081 ceph-mon[30948]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T12:14:41.770 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:41 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/4015005416' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T12:14:42.093 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-12T12:14:42.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-12T12:14:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:42.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:42 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/4015005416' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:14:42.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:42 smithi103 ceph-mon[35094]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:42.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:42 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/4015005416' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:14:42.833 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:42 smithi081 ceph-mon[30948]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:42.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:42 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/4015005416' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T12:14:42.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:42 smithi173 ceph-mon[35326]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T12:14:42.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 -- 172.21.15.81:0/3989366187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448106a80 msgr2=0x7f5448106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 --2- 172.21.15.81:0/3989366187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448106a80 0x7f5448106e60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f543c009930 tx=0x7f543c02a420 comp rx=0 tx=0).stop 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 -- 172.21.15.81:0/3989366187 shutdown_connections 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 --2- 172.21.15.81:0/3989366187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448101420 0x7f544810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 --2- 172.21.15.81:0/3989366187 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5448100a80 0x7f5448100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 --2- 172.21.15.81:0/3989366187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448106a80 0x7f5448106e60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 -- 172.21.15.81:0/3989366187 >> 172.21.15.81:0/3989366187 conn(0x7f54480fc7a0 msgr2=0x7f54480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 -- 172.21.15.81:0/3989366187 shutdown_connections 2024-09-12T12:14:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.915+0000 7f544f087640 1 -- 172.21.15.81:0/3989366187 wait complete. 2024-09-12T12:14:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 Processor -- start 2024-09-12T12:14:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 -- start start 2024-09-12T12:14:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 0x7f5448197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5448101420 0x7f54481977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448106a80 0x7f5448197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5448110fe0 con 0x7f5448100a80 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5448110e60 con 0x7f5448106a80 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544f087640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5448111160 con 0x7f5448101420 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 0x7f5448197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 0x7f5448197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59342/0 (socket says 172.21.15.81:59342) 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 -- 172.21.15.81:0/735384996 learned_addr learned my addr 172.21.15.81:0/735384996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f5447fff640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5448101420 0x7f54481977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544d624640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448106a80 0x7f5448197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 -- 172.21.15.81:0/735384996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5448101420 msgr2=0x7f54481977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5448101420 0x7f54481977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 -- 172.21.15.81:0/735384996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448106a80 msgr2=0x7f5448197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448106a80 0x7f5448197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 -- 172.21.15.81:0/735384996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54481a6ad0 con 0x7f5448100a80 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544d624640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448106a80 0x7f5448197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.916+0000 7f544ce23640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 0x7f5448197260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f543c009a50 tx=0x7f543c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.917+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c03f030 con 0x7f5448100a80 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.917+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f543c003af0 con 0x7f5448100a80 2024-09-12T12:14:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.917+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54481a6d60 con 0x7f5448100a80 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.917+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c035070 con 0x7f5448100a80 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.917+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54481a71e0 con 0x7f5448100a80 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.918+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5448100ee0 con 0x7f5448100a80 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.919+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f543c042030 con 0x7f5448100a80 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.919+0000 7f5445ffb640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54380a2b80 0x7f54380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.920+0000 7f5447fff640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54380a2b80 0x7f54380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.920+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f543c0ef790 con 0x7f5448100a80 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.920+0000 7f5447fff640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54380a2b80 0x7f54380a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f54481993c0 tx=0x7f5434009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:42.923+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f543c0bc840 con 0x7f5448100a80 2024-09-12T12:14:43.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.127+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f544802d7c0 con 0x7f5448100a80 2024-09-12T12:14:43.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.176+0000 7f5445ffb640 1 -- 172.21.15.81:0/735384996 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f543c0bc140 con 0x7f5448100a80 2024-09-12T12:14:43.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54380a2b80 msgr2=0x7f54380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54380a2b80 0x7f54380a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f54481993c0 tx=0x7f5434009110 comp rx=0 tx=0).stop 2024-09-12T12:14:43.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 msgr2=0x7f5448197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:43.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 0x7f5448197260 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f543c009a50 tx=0x7f543c004270 comp rx=0 tx=0).stop 2024-09-12T12:14:43.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 shutdown_connections 2024-09-12T12:14:43.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f54380a2b80 0x7f54380a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5448106a80 0x7f5448197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5448101420 0x7f54481977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 --2- 172.21.15.81:0/735384996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5448100a80 0x7f5448197260 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:43.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 >> 172.21.15.81:0/735384996 conn(0x7f54480fc7a0 msgr2=0x7f54480fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:43.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 shutdown_connections 2024-09-12T12:14:43.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:43.178+0000 7f544f087640 1 -- 172.21.15.81:0/735384996 wait complete. 2024-09-12T12:14:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T12:14:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/735384996' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T12:14:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:14:43.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:14:43.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/735384996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T12:14:43.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-12T12:14:43.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:43 smithi103 ceph-mon[35094]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/735384996' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/735384996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-12T12:14:43.691 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:43 smithi081 ceph-mon[30948]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-12T12:14:43.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T12:14:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-12T12:14:43.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/735384996' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-12T12:14:43.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T12:14:43.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T12:14:43.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/735384996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-12T12:14:43.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-12T12:14:43.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:43 smithi173 ceph-mon[35326]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-12T12:14:44.087 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1975317233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74100e20 msgr2=0x7fdd74101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1975317233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74100e20 0x7fdd74101200 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd64009900 tx=0x7fdd6402a480 comp rx=0 tx=0).stop 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1975317233 shutdown_connections 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1975317233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102ef0 0x7fdd7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1975317233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74102570 0x7fdd741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1975317233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74100e20 0x7fdd74101200 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1975317233 >> 172.21.15.81:0/1975317233 conn(0x7fdd740fc7d0 msgr2=0x7fdd740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1975317233 shutdown_connections 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1975317233 wait complete. 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.583+0000 7fdd7a78d640 1 Processor -- start 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 -- start start 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74100e20 0x7fdd741a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102570 0x7fdd741a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 0x7fdd7419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd74112200 con 0x7fdd74102ef0 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd74112080 con 0x7fdd74100e20 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd7a78d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdd74112380 con 0x7fdd74102570 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 0x7fdd7419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 0x7fdd7419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59366/0 (socket says 172.21.15.81:59366) 2024-09-12T12:14:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 -- 172.21.15.81:0/1503006660 learned_addr learned my addr 172.21.15.81:0/1503006660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd73fff640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74100e20 0x7fdd741a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd737fe640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102570 0x7fdd741a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 -- 172.21.15.81:0/1503006660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102570 msgr2=0x7fdd741a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102570 0x7fdd741a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 -- 172.21.15.81:0/1503006660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74100e20 msgr2=0x7fdd741a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74100e20 0x7fdd741a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 -- 172.21.15.81:0/1503006660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7419ad00 con 0x7fdd74102ef0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd73fff640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74100e20 0x7fdd741a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.584+0000 7fdd78d2a640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 0x7fdd7419a5d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00b970 tx=0x7fdd6c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.585+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c019070 con 0x7fdd74102ef0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.585+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7419aff0 con 0x7fdd74102ef0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.585+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd741a72e0 con 0x7fdd74102ef0 2024-09-12T12:14:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.585+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd6c00cb40 con 0x7fdd74102ef0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.585+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c01d6e0 con 0x7fdd74102ef0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.586+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd54005290 con 0x7fdd74102ef0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.587+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdd6c01c070 con 0x7fdd74102ef0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.587+0000 7fdd717fa640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdd600a2b80 0x7fdd600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.588+0000 7fdd73fff640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdd600a2b80 0x7fdd600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.588+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fdd6c0ce8a0 con 0x7fdd74102ef0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.588+0000 7fdd73fff640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdd600a2b80 0x7fdd600a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd64005ab0 tx=0x7fdd64005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.591+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd6c014c40 con 0x7fdd74102ef0 2024-09-12T12:14:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:44.791+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fdd54005580 con 0x7fdd74102ef0 2024-09-12T12:14:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.185+0000 7fdd717fa640 1 -- 172.21.15.81:0/1503006660 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fdd6c09b950 con 0x7fdd74102ef0 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.187+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdd600a2b80 msgr2=0x7fdd600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.187+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdd600a2b80 0x7fdd600a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdd64005ab0 tx=0x7fdd64005a20 comp rx=0 tx=0).stop 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.187+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 msgr2=0x7fdd7419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.187+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 0x7fdd7419a5d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00b970 tx=0x7fdd6c00be30 comp rx=0 tx=0).stop 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 shutdown_connections 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdd600a2b80 0x7fdd600a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd74102ef0 0x7fdd7419a5d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd74102570 0x7fdd741a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 --2- 172.21.15.81:0/1503006660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd74100e20 0x7fdd741a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 >> 172.21.15.81:0/1503006660 conn(0x7fdd740fc7d0 msgr2=0x7fdd74106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 shutdown_connections 2024-09-12T12:14:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:45.188+0000 7fdd7a78d640 1 -- 172.21.15.81:0/1503006660 wait complete. 2024-09-12T12:14:45.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] up:active 2024-09-12T12:14:45.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:14:45.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-12T12:14:45.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-12T12:14:45.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T12:14:45.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: pgmap v275: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T12:14:45.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:45 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1503006660' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:14:45.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] up:active 2024-09-12T12:14:45.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:14:45.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-12T12:14:45.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-12T12:14:45.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T12:14:45.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: pgmap v275: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T12:14:45.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:45 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1503006660' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:14:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] up:active 2024-09-12T12:14:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T12:14:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-12T12:14:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-12T12:14:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T12:14:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: pgmap v275: 97 pgs: 97 active+clean; 580 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-09-12T12:14:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:45 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1503006660' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T12:14:45.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T12:14:46.103 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:46.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:46 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1503006660' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:14:46.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:46 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] up:active 2024-09-12T12:14:46.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:46 smithi081 ceph-mon[30948]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T12:14:46.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:46 smithi081 ceph-mon[30948]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-12T12:14:46.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:46 smithi081 ceph-mon[30948]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-12T12:14:46.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:46 smithi081 ceph-mon[30948]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 -- 172.21.15.81:0/335585849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d4102da0 msgr2=0x7f98d4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 --2- 172.21.15.81:0/335585849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d4102da0 0x7f98d4103180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009900 tx=0x7f98c402a480 comp rx=0 tx=0).stop 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 -- 172.21.15.81:0/335585849 shutdown_connections 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 --2- 172.21.15.81:0/335585849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d410c180 0x7f98d410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 --2- 172.21.15.81:0/335585849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d41036c0 0x7f98d410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 --2- 172.21.15.81:0/335585849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d4102da0 0x7f98d4103180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 -- 172.21.15.81:0/335585849 >> 172.21.15.81:0/335585849 conn(0x7f98d40fc7a0 msgr2=0x7f98d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 -- 172.21.15.81:0/335585849 shutdown_connections 2024-09-12T12:14:46.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.614+0000 7f98d889f640 1 -- 172.21.15.81:0/335585849 wait complete. 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 Processor -- start 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 -- start start 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d4102da0 0x7f98d4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 0x7f98d4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d410c180 0x7f98d419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98d4112160 con 0x7f98d41036c0 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98d4111fe0 con 0x7f98d410c180 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.615+0000 7f98d889f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f98d41122e0 con 0x7f98d4102da0 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 0x7f98d4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 0x7f98d4198ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59382/0 (socket says 172.21.15.81:59382) 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 -- 172.21.15.81:0/3870052122 learned_addr learned my addr 172.21.15.81:0/3870052122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:46.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d259c640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d4102da0 0x7f98d4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 -- 172.21.15.81:0/3870052122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d4102da0 msgr2=0x7f98d4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d4102da0 0x7f98d4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 -- 172.21.15.81:0/3870052122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d410c180 msgr2=0x7f98d419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d2d9d640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d410c180 0x7f98d419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d410c180 0x7f98d419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 -- 172.21.15.81:0/3870052122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d419d610 con 0x7f98d41036c0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d259c640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d4102da0 0x7f98d4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d1d9b640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 0x7f98d4198ba0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98c800b4a0 tx=0x7f98c800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8014070 con 0x7f98d41036c0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d419d900 con 0x7f98d41036c0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f98c8010b10 con 0x7f98d41036c0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98c8017d60 con 0x7f98d41036c0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.616+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d41a51e0 con 0x7f98d41036c0 2024-09-12T12:14:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.617+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98d4103200 con 0x7f98d41036c0 2024-09-12T12:14:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.618+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f98c8017070 con 0x7f98d41036c0 2024-09-12T12:14:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.619+0000 7f98c37fe640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98bc0a2b80 0x7f98bc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.619+0000 7f98d259c640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98bc0a2b80 0x7f98bc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.619+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7f98c80ce780 con 0x7f98d41036c0 2024-09-12T12:14:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.620+0000 7f98d259c640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98bc0a2b80 0x7f98bc0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f98c4005ab0 tx=0x7f98c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:46.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.622+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98c809b790 con 0x7f98d41036c0 2024-09-12T12:14:46.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:46 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1503006660' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:14:46.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:46 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] up:active 2024-09-12T12:14:46.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:46 smithi173 ceph-mon[35326]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T12:14:46.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:46 smithi173 ceph-mon[35326]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-12T12:14:46.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:46 smithi173 ceph-mon[35326]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-12T12:14:46.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:46 smithi173 ceph-mon[35326]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-12T12:14:46.686 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: 2024-09-12T12:14:46.403+0000 7f9c61d72640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T12:14:46.686 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: 2024-09-12T12:14:46.403+0000 7f9c61d72640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T12:14:46.686 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: 2024-09-12T12:14:46.403+0000 7f9c61d72640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-12T12:14:46.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1503006660' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T12:14:46.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] up:active 2024-09-12T12:14:46.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-mon[35094]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-12T12:14:46.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-mon[35094]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-12T12:14:46.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-mon[35094]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-12T12:14:46.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:46 smithi103 ceph-mon[35094]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-12T12:14:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:46.825+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f98d41999c0 con 0x7f98d41036c0 2024-09-12T12:14:47.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.208+0000 7f98c37fe640 1 -- 172.21.15.81:0/3870052122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f98d41999c0 con 0x7f98d41036c0 2024-09-12T12:14:47.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98bc0a2b80 msgr2=0x7f98bc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:47.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98bc0a2b80 0x7f98bc0a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f98c4005ab0 tx=0x7f98c4005a20 comp rx=0 tx=0).stop 2024-09-12T12:14:47.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 msgr2=0x7f98d4198ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:47.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 0x7f98d4198ba0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98c800b4a0 tx=0x7f98c800b960 comp rx=0 tx=0).stop 2024-09-12T12:14:47.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 shutdown_connections 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98bc0a2b80 0x7f98bc0a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98d410c180 0x7f98d419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98d41036c0 0x7f98d4198ba0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 --2- 172.21.15.81:0/3870052122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98d4102da0 0x7f98d4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 >> 172.21.15.81:0/3870052122 conn(0x7f98d40fc7a0 msgr2=0x7f98d40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 shutdown_connections 2024-09-12T12:14:47.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:47.210+0000 7f98d889f640 1 -- 172.21.15.81:0/3870052122 wait complete. 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] up:active 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: Cluster is now healthy 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: pgmap v276: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-09-12T12:14:47.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:47 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3870052122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:14:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] up:active 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: Cluster is now healthy 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: pgmap v276: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-09-12T12:14:47.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:47 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3870052122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:14:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] up:active 2024-09-12T12:14:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: Cluster is now healthy 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: pgmap v276: 97 pgs: 97 active+clean; 581 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-09-12T12:14:47.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:47 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3870052122' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T12:14:47.891 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T12:14:47.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T12:14:48.135 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:48.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3870052122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:14:48.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] up:active 2024-09-12T12:14:48.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-mon[30948]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T12:14:48.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 -- 172.21.15.81:0/1806330117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4102790 msgr2=0x7efcc41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 --2- 172.21.15.81:0/1806330117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4102790 0x7efcc41067e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efcac009900 tx=0x7efcac02a410 comp rx=0 tx=0).stop 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 -- 172.21.15.81:0/1806330117 shutdown_connections 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 --2- 172.21.15.81:0/1806330117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcc4106f10 0x7efcc410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 --2- 172.21.15.81:0/1806330117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4102790 0x7efcc41067e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 --2- 172.21.15.81:0/1806330117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc4101de0 0x7efcc41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 -- 172.21.15.81:0/1806330117 >> 172.21.15.81:0/1806330117 conn(0x7efcc40fd8c0 msgr2=0x7efcc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 -- 172.21.15.81:0/1806330117 shutdown_connections 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.615+0000 7efccaa34640 1 -- 172.21.15.81:0/1806330117 wait complete. 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 Processor -- start 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 -- start start 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 0x7efcc419a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc4102790 0x7efcc419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcc4106f10 0x7efcc419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efcc41120d0 con 0x7efcc4101de0 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4111f50 con 0x7efcc4106f10 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efccaa34640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4112250 con 0x7efcc4102790 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 0x7efcc419a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 0x7efcc419a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59400/0 (socket says 172.21.15.81:59400) 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 -- 172.21.15.81:0/2284682533 learned_addr learned my addr 172.21.15.81:0/2284682533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 -- 172.21.15.81:0/2284682533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc4102790 msgr2=0x7efcc419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc4102790 0x7efcc419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 -- 172.21.15.81:0/2284682533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcc4106f10 msgr2=0x7efcc419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcc4106f10 0x7efcc419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 -- 172.21.15.81:0/2284682533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc419e700 con 0x7efcc4101de0 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.616+0000 7efcc3fff640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 0x7efcc419a7b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcb400b4a0 tx=0x7efcb400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.617+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4014070 con 0x7efcc4101de0 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.617+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc419e9f0 con 0x7efcc4101de0 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.617+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efcb4010b10 con 0x7efcc4101de0 2024-09-12T12:14:48.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.617+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb4017d60 con 0x7efcc4101de0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.617+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc41a7360 con 0x7efcc4101de0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.618+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc41021c0 con 0x7efcc4101de0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.619+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efcb4017070 con 0x7efcc4101de0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.619+0000 7efcc1ffb640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efcb00a2b80 0x7efcb00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.619+0000 7efcbbfff640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efcb00a2b80 0x7efcb00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.619+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7efcb40ce3d0 con 0x7efcc4101de0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.620+0000 7efcbbfff640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efcb00a2b80 0x7efcb00a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efcac0096c0 tx=0x7efcac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:48.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.623+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcb409b480 con 0x7efcc4101de0 2024-09-12T12:14:48.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:48 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3870052122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:14:48.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:48 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] up:active 2024-09-12T12:14:48.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:48 smithi173 ceph-mon[35326]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T12:14:48.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:48 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:14:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:48 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3870052122' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T12:14:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:48 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] up:active 2024-09-12T12:14:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:48 smithi103 ceph-mon[35094]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-12T12:14:48.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:48 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:14:48.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.812+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efcc4075430 con 0x7efcb00a2b80 2024-09-12T12:14:48.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.839+0000 7efcc1ffb640 1 -- 172.21.15.81:0/2284682533 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efcc4075430 con 0x7efcb00a2b80 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.841+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efcb00a2b80 msgr2=0x7efcb00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.841+0000 7efccaa34640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efcb00a2b80 0x7efcb00a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efcac0096c0 tx=0x7efcac000bc0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.841+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 msgr2=0x7efcc419a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.841+0000 7efccaa34640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 0x7efcc419a7b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efcb400b4a0 tx=0x7efcb400b960 comp rx=0 tx=0).stop 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 shutdown_connections 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efcb00a2b80 0x7efcb00a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efcc4106f10 0x7efcc419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcc4102790 0x7efcc419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 --2- 172.21.15.81:0/2284682533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc4101de0 0x7efcc419a7b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 >> 172.21.15.81:0/2284682533 conn(0x7efcc40fd8c0 msgr2=0x7efcc40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:48.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 shutdown_connections 2024-09-12T12:14:48.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:48.842+0000 7efccaa34640 1 -- 172.21.15.81:0/2284682533 wait complete. 2024-09-12T12:14:49.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:14:48.817+0000 7fd22c898640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:14:49.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:14:48.817+0000 7fd22c898640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:14:49.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:14:48.817+0000 7fd22c898640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:14:49.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:14:48.817+0000 7fd22c898640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:14:49.110 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:14:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:14:48.817+0000 7fd22c898640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:14:49.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T12:14:49.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-12T12:14:49.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T12:14:49.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-12T12:14:49.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T12:14:49.554 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-12T12:14:49.555 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:49 smithi081 ceph-mon[30948]: pgmap v277: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 855 B/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T12:14:49.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T12:14:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T12:14:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-12T12:14:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T12:14:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-12T12:14:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T12:14:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-12T12:14:49.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:49 smithi173 ceph-mon[35326]: pgmap v277: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 855 B/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T12:14:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-12T12:14:49.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-09-12T12:14:49.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-12T12:14:49.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-09-12T12:14:49.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-12T12:14:49.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-12T12:14:49.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:49 smithi103 ceph-mon[35094]: pgmap v277: 97 pgs: 97 active+clean; 583 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 855 B/s rd, 3.6 KiB/s wr, 15 op/s 2024-09-12T12:14:49.831 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 -- 172.21.15.81:0/3391726149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102ef0 msgr2=0x7f9fb810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/3391726149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102ef0 0x7f9fb810da40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009900 tx=0x7f9fb002a480 comp rx=0 tx=0).stop 2024-09-12T12:14:50.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 -- 172.21.15.81:0/3391726149 shutdown_connections 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/3391726149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102ef0 0x7f9fb810da40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/3391726149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8102570 0x7f9fb81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/3391726149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fb8100e20 0x7f9fb8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 -- 172.21.15.81:0/3391726149 >> 172.21.15.81:0/3391726149 conn(0x7f9fb80fc7d0 msgr2=0x7f9fb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 -- 172.21.15.81:0/3391726149 shutdown_connections 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 -- 172.21.15.81:0/3391726149 wait complete. 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.289+0000 7f9fbda2e640 1 Processor -- start 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 -- start start 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8100e20 0x7f9fb8199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 0x7f9fb8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fb8102ef0 0x7f9fb81a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb81110e0 con 0x7f9fb8102570 2024-09-12T12:14:50.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8110f60 con 0x7f9fb8102ef0 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb8111260 con 0x7f9fb8100e20 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 0x7f9fb8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 0x7f9fb8199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59440/0 (socket says 172.21.15.81:59440) 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 -- 172.21.15.81:0/1218958325 learned_addr learned my addr 172.21.15.81:0/1218958325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb6ffd640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8100e20 0x7f9fb8199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 -- 172.21.15.81:0/1218958325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8100e20 msgr2=0x7f9fb8199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8100e20 0x7f9fb8199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 -- 172.21.15.81:0/1218958325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fb8102ef0 msgr2=0x7f9fb81a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb77fe640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fb8102ef0 0x7f9fb81a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fb8102ef0 0x7f9fb81a4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 -- 172.21.15.81:0/1218958325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb81a49d0 con 0x7f9fb8102570 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb6ffd640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8100e20 0x7f9fb8199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fb67fc640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 0x7f9fb8199950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000b4a0 tx=0x7f9fa000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0014070 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fa0010b10 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.290+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb81a4ba0 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.291+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0017d60 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.291+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb81a5060 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.292+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb8101200 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.293+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f9fa0017070 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.294+0000 7f9fbca2c640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9fa40a2b80 0x7f9fa40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.294+0000 7f9fb6ffd640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9fa40a2b80 0x7f9fa40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.294+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f9fa00ce420 con 0x7f9fb8102570 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.294+0000 7f9fb6ffd640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9fa40a2b80 0x7f9fa40a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8005fd0 tx=0x7f9fa80093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.297+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9fa009b420 con 0x7f9fb8102570 2024-09-12T12:14:50.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.491+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9fb8106ee0 con 0x7f9fa40a2b80 2024-09-12T12:14:50.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-12T12:14:50.492 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:50 smithi081 ceph-mon[30948]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:14:50.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.515+0000 7f9fbca2c640 1 -- 172.21.15.81:0/1218958325 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9fb8106ee0 con 0x7f9fa40a2b80 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9fa40a2b80 msgr2=0x7f9fa40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9fa40a2b80 0x7f9fa40a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8005fd0 tx=0x7f9fa80093e0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 msgr2=0x7f9fb8199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 0x7f9fb8199950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000b4a0 tx=0x7f9fa000b960 comp rx=0 tx=0).stop 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 shutdown_connections 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f9fa40a2b80 0x7f9fa40a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fb8102ef0 0x7f9fb81a4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fb8102570 0x7f9fb8199950 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 --2- 172.21.15.81:0/1218958325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb8100e20 0x7f9fb8199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:50.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.517+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 >> 172.21.15.81:0/1218958325 conn(0x7f9fb80fc7d0 msgr2=0x7f9fb81067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:50.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.518+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 shutdown_connections 2024-09-12T12:14:50.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:50.518+0000 7f9fbda2e640 1 -- 172.21.15.81:0/1218958325 wait complete. 2024-09-12T12:14:50.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-12T12:14:50.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:50 smithi173 ceph-mon[35326]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:14:50.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='client.14691 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-12T12:14:50.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:50 smithi103 ceph-mon[35094]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T12:14:51.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T12:14:51.458 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:51.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:51 smithi081 ceph-mon[30948]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:14:51.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:51 smithi081 ceph-mon[30948]: pgmap v280: 97 pgs: 97 active+clean; 585 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.1 KiB/s wr, 24 op/s 2024-09-12T12:14:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:51 smithi173 ceph-mon[35326]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:14:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:51 smithi173 ceph-mon[35326]: pgmap v280: 97 pgs: 97 active+clean; 585 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.1 KiB/s wr, 24 op/s 2024-09-12T12:14:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:51 smithi103 ceph-mon[35094]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T12:14:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:51 smithi103 ceph-mon[35094]: pgmap v280: 97 pgs: 97 active+clean; 585 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6.1 KiB/s wr, 24 op/s 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.940+0000 7f45f0123640 1 -- 172.21.15.81:0/561669937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 msgr2=0x7f45e8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.940+0000 7f45f0123640 1 --2- 172.21.15.81:0/561669937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e8106e60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009930 tx=0x7f45dc02a420 comp rx=0 tx=0).stop 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- 172.21.15.81:0/561669937 shutdown_connections 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 --2- 172.21.15.81:0/561669937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 0x7f45e810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 --2- 172.21.15.81:0/561669937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8100a80 0x7f45e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 --2- 172.21.15.81:0/561669937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e8106e60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- 172.21.15.81:0/561669937 >> 172.21.15.81:0/561669937 conn(0x7f45e80fc7a0 msgr2=0x7f45e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- 172.21.15.81:0/561669937 shutdown_connections 2024-09-12T12:14:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- 172.21.15.81:0/561669937 wait complete. 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 Processor -- start 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- start start 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8100a80 0x7f45e8197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 0x7f45e8197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45e8111060 con 0x7f45e8106a80 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45e8110ee0 con 0x7f45e8100a80 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.941+0000 7f45f0123640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f45e81111e0 con 0x7f45e8101420 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e819be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59460/0 (socket says 172.21.15.81:59460) 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 -- 172.21.15.81:0/912491056 learned_addr learned my addr 172.21.15.81:0/912491056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45edebf640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8100a80 0x7f45e8197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ed6be640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 0x7f45e8197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 -- 172.21.15.81:0/912491056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 msgr2=0x7f45e8197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 0x7f45e8197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 -- 172.21.15.81:0/912491056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8100a80 msgr2=0x7f45e8197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8100a80 0x7f45e8197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 -- 172.21.15.81:0/912491056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e819c530 con 0x7f45e8106a80 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ed6be640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 0x7f45e8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45ee6c0640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e819be50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b970 tx=0x7f45e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0019070 con 0x7f45e8106a80 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f45e000cb40 con 0x7f45e8106a80 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e819c820 con 0x7f45e8106a80 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0007700 con 0x7f45e8106a80 2024-09-12T12:14:51.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.942+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e81a4100 con 0x7f45e8106a80 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.943+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e8100f60 con 0x7f45e8106a80 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.944+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f45e001c070 con 0x7f45e8106a80 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.945+0000 7f45daffd640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f45d40a2c90 0x7f45d40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.945+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f45e00ce960 con 0x7f45e8106a80 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.945+0000 7f45edebf640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f45d40a2c90 0x7f45d40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.945+0000 7f45edebf640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f45d40a2c90 0x7f45d40a5150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009900 tx=0x7f45dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:51.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:51.948+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e009b320 con 0x7f45e8106a80 2024-09-12T12:14:52.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.141+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f45e8062630 con 0x7f45d40a2c90 2024-09-12T12:14:52.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.145+0000 7f45daffd640 1 -- 172.21.15.81:0/912491056 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f45e8062630 con 0x7f45d40a2c90 2024-09-12T12:14:52.145 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_0/2ecaf178-b788-4826-95db-d3014cbdadf3 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.147+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f45d40a2c90 msgr2=0x7f45d40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.147+0000 7f45f0123640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f45d40a2c90 0x7f45d40a5150 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009900 tx=0x7f45dc0058d0 comp rx=0 tx=0).stop 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.147+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 msgr2=0x7f45e819be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.147+0000 7f45f0123640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e819be50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f45e000b970 tx=0x7f45e000be30 comp rx=0 tx=0).stop 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 shutdown_connections 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f45d40a2c90 0x7f45d40a5150 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e8106a80 0x7f45e819be50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45e8101420 0x7f45e8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:52.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 --2- 172.21.15.81:0/912491056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45e8100a80 0x7f45e8197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:52.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 >> 172.21.15.81:0/912491056 conn(0x7f45e80fc7a0 msgr2=0x7f45e80fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:52.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 shutdown_connections 2024-09-12T12:14:52.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:52.148+0000 7f45f0123640 1 -- 172.21.15.81:0/912491056 wait complete. 2024-09-12T12:14:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:52 smithi081 ceph-mon[30948]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:52.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:52 smithi081 ceph-mon[30948]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T12:14:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:52 smithi173 ceph-mon[35326]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:52 smithi173 ceph-mon[35326]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T12:14:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:52 smithi103 ceph-mon[35094]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:52 smithi103 ceph-mon[35094]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-12T12:14:52.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T12:14:53.080 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:53.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:53 smithi081 ceph-mon[30948]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:53.457 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:53 smithi081 ceph-mon[30948]: pgmap v281: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.4 KiB/s wr, 28 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 -- 172.21.15.81:0/1885246190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134101de0 msgr2=0x7f01341021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 --2- 172.21.15.81:0/1885246190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134101de0 0x7f01341021c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0130009900 tx=0x7f013002a410 comp rx=0 tx=0).stop 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 -- 172.21.15.81:0/1885246190 shutdown_connections 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 --2- 172.21.15.81:0/1885246190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0134106f10 0x7f013410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 --2- 172.21.15.81:0/1885246190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134102790 0x7f01341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 --2- 172.21.15.81:0/1885246190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134101de0 0x7f01341021c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 -- 172.21.15.81:0/1885246190 >> 172.21.15.81:0/1885246190 conn(0x7f01340fd8c0 msgr2=0x7f01340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 -- 172.21.15.81:0/1885246190 shutdown_connections 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.541+0000 7f013b67e640 1 -- 172.21.15.81:0/1885246190 wait complete. 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 Processor -- start 2024-09-12T12:14:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 -- start start 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0134101de0 0x7f0134198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134102790 0x7f0134198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 0x7f013419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01341120d0 con 0x7f0134106f10 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0134111f50 con 0x7f0134102790 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f013b67e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0134112250 con 0x7f0134101de0 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f0139c1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 0x7f013419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f0139c1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 0x7f013419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54882/0 (socket says 172.21.15.81:54882) 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f0139c1b640 1 -- 172.21.15.81:0/2972725021 learned_addr learned my addr 172.21.15.81:0/2972725021 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.542+0000 7f0138c19640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134102790 0x7f0134198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:53.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f013941a640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0134101de0 0x7f0134198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f0139c1b640 1 -- 172.21.15.81:0/2972725021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0134101de0 msgr2=0x7f0134198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f0139c1b640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0134101de0 0x7f0134198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f0139c1b640 1 -- 172.21.15.81:0/2972725021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134102790 msgr2=0x7f0134198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f0139c1b640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134102790 0x7f0134198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f0139c1b640 1 -- 172.21.15.81:0/2972725021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013419d4e0 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f0139c1b640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 0x7f013419ce00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f012c00b970 tx=0x7f012c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c019070 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f012c00cb40 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013419d7d0 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c007700 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.543+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01341a50b0 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.544+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01341021c0 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.545+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f012c01c070 con 0x7f0134106f10 2024-09-12T12:14:53.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.546+0000 7f012a7fc640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f01200a2c90 0x7f01200a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.546+0000 7f013941a640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f01200a2c90 0x7f01200a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.546+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f012c0ce960 con 0x7f0134106f10 2024-09-12T12:14:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.546+0000 7f013941a640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f01200a2c90 0x7f01200a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0130005ab0 tx=0x7f0130005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:53.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.549+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f012c09b320 con 0x7f0134106f10 2024-09-12T12:14:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:53 smithi173 ceph-mon[35326]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:53 smithi173 ceph-mon[35326]: pgmap v281: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.4 KiB/s wr, 28 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:53 smithi103 ceph-mon[35094]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:53 smithi103 ceph-mon[35094]: pgmap v281: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.4 KiB/s wr, 28 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:53.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.739+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0134062630 con 0x7f01200a2c90 2024-09-12T12:14:53.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.765+0000 7f012a7fc640 1 -- 172.21.15.81:0/2972725021 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0134062630 con 0x7f01200a2c90 2024-09-12T12:14:53.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f01200a2c90 msgr2=0x7f01200a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f01200a2c90 0x7f01200a5150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0130005ab0 tx=0x7f0130005a20 comp rx=0 tx=0).stop 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 msgr2=0x7f013419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 0x7f013419ce00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f012c00b970 tx=0x7f012c00be30 comp rx=0 tx=0).stop 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 shutdown_connections 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f01200a2c90 0x7f01200a5150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0134106f10 0x7f013419ce00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134102790 0x7f0134198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 --2- 172.21.15.81:0/2972725021 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0134101de0 0x7f0134198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 >> 172.21.15.81:0/2972725021 conn(0x7f01340fd8c0 msgr2=0x7f01340feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.767+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 shutdown_connections 2024-09-12T12:14:53.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:53.768+0000 7f013b67e640 1 -- 172.21.15.81:0/2972725021 wait complete. 2024-09-12T12:14:54.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T12:14:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 -- 172.21.15.81:0/4108877357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01036e0 msgr2=0x7f98f0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 --2- 172.21.15.81:0/4108877357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01036e0 0x7f98f0107b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009930 tx=0x7f98e402a420 comp rx=0 tx=0).stop 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 -- 172.21.15.81:0/4108877357 shutdown_connections 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 --2- 172.21.15.81:0/4108877357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f01082a0 0x7f98f010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 --2- 172.21.15.81:0/4108877357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01036e0 0x7f98f0107b90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 --2- 172.21.15.81:0/4108877357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f0102d30 0x7f98f0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 -- 172.21.15.81:0/4108877357 >> 172.21.15.81:0/4108877357 conn(0x7f98f00fc7d0 msgr2=0x7f98f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 -- 172.21.15.81:0/4108877357 shutdown_connections 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.215+0000 7f98f67be640 1 -- 172.21.15.81:0/4108877357 wait complete. 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 Processor -- start 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 -- start start 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f0102d30 0x7f98f0198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f01036e0 0x7f98f0198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 0x7f98f019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0112200 con 0x7f98f01082a0 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0112080 con 0x7f98f01036e0 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f67be640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0112380 con 0x7f98f0102d30 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f4d5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 0x7f98f019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f4d5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 0x7f98f019cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54900/0 (socket says 172.21.15.81:54900) 2024-09-12T12:14:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.216+0000 7f98f4d5b640 1 -- 172.21.15.81:0/372460170 learned_addr learned my addr 172.21.15.81:0/372460170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98effff640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f0102d30 0x7f98f0198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98ef7fe640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f01036e0 0x7f98f0198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f4d5b640 1 -- 172.21.15.81:0/372460170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f0102d30 msgr2=0x7f98f0198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f4d5b640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f0102d30 0x7f98f0198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f4d5b640 1 -- 172.21.15.81:0/372460170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f01036e0 msgr2=0x7f98f0198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f4d5b640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f01036e0 0x7f98f0198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f4d5b640 1 -- 172.21.15.81:0/372460170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f019d6d0 con 0x7f98f01082a0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98ef7fe640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f01036e0 0x7f98f0198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f4d5b640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 0x7f98f019cff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98e800cad0 tx=0x7f98e800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e800ad60 con 0x7f98f01082a0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f98e8004b20 con 0x7f98f01082a0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f019d9c0 con 0x7f98f01082a0 2024-09-12T12:14:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e800f6f0 con 0x7f98f01082a0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.217+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f01a52a0 con 0x7f98f01082a0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.218+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f0103110 con 0x7f98f01082a0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.219+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f98e8004cd0 con 0x7f98f01082a0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.220+0000 7f98ed7fa640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98d80a2c10 0x7f98d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.220+0000 7f98effff640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98d80a2c10 0x7f98d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.220+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f98e80cf140 con 0x7f98f01082a0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.220+0000 7f98effff640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98d80a2c10 0x7f98d80a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009990 tx=0x7f98e0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.224+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98e8014030 con 0x7f98f01082a0 2024-09-12T12:14:55.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.419+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f98f0062630 con 0x7f98d80a2c10 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.423+0000 7f98ed7fa640 1 -- 172.21.15.81:0/372460170 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f98f0062630 con 0x7f98d80a2c10 2024-09-12T12:14:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_1/e8e9a179-a1ef-4114-8e62-e75fa260ee80 2024-09-12T12:14:55.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98d80a2c10 msgr2=0x7f98d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98d80a2c10 0x7f98d80a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009990 tx=0x7f98e0009110 comp rx=0 tx=0).stop 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 msgr2=0x7f98f019cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 0x7f98f019cff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f98e800cad0 tx=0x7f98e800ced0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 shutdown_connections 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f98d80a2c10 0x7f98d80a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f01082a0 0x7f98f019cff0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98f01036e0 0x7f98f0198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 --2- 172.21.15.81:0/372460170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98f0102d30 0x7f98f0198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.425+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 >> 172.21.15.81:0/372460170 conn(0x7f98f00fc7d0 msgr2=0x7f98f0105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.426+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 shutdown_connections 2024-09-12T12:14:55.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:55.426+0000 7f98f67be640 1 -- 172.21.15.81:0/372460170 wait complete. 2024-09-12T12:14:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:55 smithi173 ceph-mon[35326]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:55 smithi173 ceph-mon[35326]: pgmap v282: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 26 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:55 smithi103 ceph-mon[35094]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:55 smithi103 ceph-mon[35094]: pgmap v282: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 26 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:55.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:55 smithi081 ceph-mon[30948]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:55.793 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:55 smithi081 ceph-mon[30948]: pgmap v282: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 26 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:56.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:14:56.367 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:56.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:56 smithi173 ceph-mon[35326]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:56.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:56 smithi103 ceph-mon[35094]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:56.739 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:56 smithi081 ceph-mon[30948]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 -- 172.21.15.81:0/2400806555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844106f10 msgr2=0x7f784410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 --2- 172.21.15.81:0/2400806555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844106f10 0x7f784410ea90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f783c009ca0 tx=0x7f783c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 -- 172.21.15.81:0/2400806555 shutdown_connections 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 --2- 172.21.15.81:0/2400806555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844106f10 0x7f784410ea90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 --2- 172.21.15.81:0/2400806555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844102790 0x7f78441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 --2- 172.21.15.81:0/2400806555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7844101de0 0x7f78441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 -- 172.21.15.81:0/2400806555 >> 172.21.15.81:0/2400806555 conn(0x7f78440fd8c0 msgr2=0x7f78440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:56.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 -- 172.21.15.81:0/2400806555 shutdown_connections 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.818+0000 7f784c2f6640 1 -- 172.21.15.81:0/2400806555 wait complete. 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 Processor -- start 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 -- start start 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844101de0 0x7f78440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 0x7f7844074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7844106f10 0x7f7844074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78441120d0 con 0x7f7844102790 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7844111f50 con 0x7f7844101de0 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784c2f6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7844112250 con 0x7f7844106f10 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 0x7f7844074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 0x7f7844074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54908/0 (socket says 172.21.15.81:54908) 2024-09-12T12:14:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 -- 172.21.15.81:0/3165133605 learned_addr learned my addr 172.21.15.81:0/3165133605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784a092640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844101de0 0x7f78440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784a893640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7844106f10 0x7f7844074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 -- 172.21.15.81:0/3165133605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7844106f10 msgr2=0x7f7844074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7844106f10 0x7f7844074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 -- 172.21.15.81:0/3165133605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844101de0 msgr2=0x7f78440744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844101de0 0x7f78440744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f7849891640 1 -- 172.21.15.81:0/3165133605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78441a69d0 con 0x7f7844102790 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.819+0000 7f784a092640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844101de0 0x7f78440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.820+0000 7f7849891640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 0x7f7844074a30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f783400d950 tx=0x7f783400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.820+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834017030 con 0x7f7844102790 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.820+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7834004020 con 0x7f7844102790 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.820+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78441a6cc0 con 0x7f7844102790 2024-09-12T12:14:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.820+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834004a00 con 0x7f7844102790 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.820+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78441a71b0 con 0x7f7844102790 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.821+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78441021c0 con 0x7f7844102790 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.822+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f78340041d0 con 0x7f7844102790 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.822+0000 7f783b7fe640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78300a2c10 0x7f78300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.823+0000 7f784a092640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78300a2c10 0x7f78300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.823+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f78340ceb90 con 0x7f7844102790 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.823+0000 7f784a092640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78300a2c10 0x7f78300a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7840006fd0 tx=0x7f7840008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:56.827+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f783409ba90 con 0x7f7844102790 2024-09-12T12:14:57.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.027+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7844109b60 con 0x7f7844102790 2024-09-12T12:14:57.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.028+0000 7f783b7fe640 1 -- 172.21.15.81:0/3165133605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11982 (secure 0 0 0) 0x7f783409b390 con 0x7f7844102790 2024-09-12T12:14:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:57.028 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-12T12:14:47:212167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:14:47.212145+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:14:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78300a2c10 msgr2=0x7f78300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78300a2c10 0x7f78300a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7840006fd0 tx=0x7f7840008040 comp rx=0 tx=0).stop 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 msgr2=0x7f7844074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 0x7f7844074a30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f783400d950 tx=0x7f783400de10 comp rx=0 tx=0).stop 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 shutdown_connections 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78300a2c10 0x7f78300a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7844106f10 0x7f7844074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7844102790 0x7f7844074a30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 --2- 172.21.15.81:0/3165133605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844101de0 0x7f78440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:57.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 >> 172.21.15.81:0/3165133605 conn(0x7f78440fd8c0 msgr2=0x7f78440febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:57.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 shutdown_connections 2024-09-12T12:14:57.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:57.030+0000 7f784c2f6640 1 -- 172.21.15.81:0/3165133605 wait complete. 2024-09-12T12:14:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:57 smithi173 ceph-mon[35326]: pgmap v283: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.4 KiB/s wr, 16 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:57 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3165133605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:57.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:57 smithi081 ceph-mon[30948]: pgmap v283: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.4 KiB/s wr, 16 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:57.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:57 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3165133605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:57 smithi103 ceph-mon[35094]: pgmap v283: 97 pgs: 97 active+clean; 610 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.4 KiB/s wr, 16 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:57 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3165133605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:14:57.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:14:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:58.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 -- 172.21.15.81:0/3069225885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f835410c170 msgr2=0x7f835410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 --2- 172.21.15.81:0/3069225885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f835410c170 0x7f835410e610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ca0 tx=0x7f834c02a950 comp rx=0 tx=0).stop 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 -- 172.21.15.81:0/3069225885 shutdown_connections 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 --2- 172.21.15.81:0/3069225885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f835410c170 0x7f835410e610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 --2- 172.21.15.81:0/3069225885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8354103660 0x7f835410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 --2- 172.21.15.81:0/3069225885 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8354102d40 0x7f8354103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 -- 172.21.15.81:0/3069225885 >> 172.21.15.81:0/3069225885 conn(0x7f83540fc7a0 msgr2=0x7f83540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 -- 172.21.15.81:0/3069225885 shutdown_connections 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.384+0000 7f8358c11640 1 -- 172.21.15.81:0/3069225885 wait complete. 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 Processor -- start 2024-09-12T12:14:58.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 -- start start 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 0x7f83541984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8354103660 0x7f83541989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835410c170 0x7f835419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8354112090 con 0x7f8354102d40 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8354111f10 con 0x7f835410c170 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8358c11640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8354112210 con 0x7f8354103660 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 0x7f83541984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 0x7f83541984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54926/0 (socket says 172.21.15.81:54926) 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 -- 172.21.15.81:0/2509780842 learned_addr learned my addr 172.21.15.81:0/2509780842 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f8352d9d640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835410c170 0x7f835419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 -- 172.21.15.81:0/2509780842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8354103660 msgr2=0x7f83541989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:58.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8354103660 0x7f83541989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 -- 172.21.15.81:0/2509780842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835410c170 msgr2=0x7f835419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.385+0000 7f835259c640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835410c170 0x7f835419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f835259c640 1 -- 172.21.15.81:0/2509780842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835419d460 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f835259c640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 0x7f83541984b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f834400c890 tx=0x7f834400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344004220 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835419d750 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83440043c0 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83541a5030 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.386+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344004b10 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.387+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8354103120 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.388+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f83440051b0 con 0x7f8354102d40 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.389+0000 7f83437fe640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f833c0a2c10 0x7f833c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:14:58.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.389+0000 7f8351d9b640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f833c0a2c10 0x7f833c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:14:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.389+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f83440cf140 con 0x7f8354102d40 2024-09-12T12:14:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.389+0000 7f8351d9b640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f833c0a2c10 0x7f833c0a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f835410d420 tx=0x7f8348005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:14:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.393+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8344014030 con 0x7f8354102d40 2024-09-12T12:14:58.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.563+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83541a5320 con 0x7f8354102d40 2024-09-12T12:14:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.564+0000 7f83437fe640 1 -- 172.21.15.81:0/2509780842 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22643 (secure 0 0 0) 0x7f834409c040 con 0x7f8354102d40 2024-09-12T12:14:58.565 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:14:58.565 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:50.215414+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:14:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f833c0a2c10 msgr2=0x7f833c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f833c0a2c10 0x7f833c0a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f835410d420 tx=0x7f8348005e70 comp rx=0 tx=0).stop 2024-09-12T12:14:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 msgr2=0x7f83541984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:14:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 0x7f83541984b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f834400c890 tx=0x7f834400cd50 comp rx=0 tx=0).stop 2024-09-12T12:14:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 shutdown_connections 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f833c0a2c10 0x7f833c0a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835410c170 0x7f835419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8354103660 0x7f83541989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 --2- 172.21.15.81:0/2509780842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8354102d40 0x7f83541984b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 >> 172.21.15.81:0/2509780842 conn(0x7f83540fc7a0 msgr2=0x7f83540fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 shutdown_connections 2024-09-12T12:14:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:14:58.567+0000 7f8358c11640 1 -- 172.21.15.81:0/2509780842 wait complete. 2024-09-12T12:14:59.289 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:14:59.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:14:59.539 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:14:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:59 smithi081 ceph-mon[30948]: pgmap v284: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 18 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:59.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:14:59 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2509780842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:59 smithi173 ceph-mon[35326]: pgmap v284: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 18 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:14:59 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2509780842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:14:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:59 smithi103 ceph-mon[35094]: pgmap v284: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 KiB/s wr, 18 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-12T12:14:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:14:59 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2509780842' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:00.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1957736421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c106f10 msgr2=0x7f4d6c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1957736421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c106f10 0x7f4d6c10ea90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009ca0 tx=0x7f4d6402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1957736421 shutdown_connections 2024-09-12T12:15:00.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1957736421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c106f10 0x7f4d6c10ea90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1957736421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d6c102790 0x7f4d6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1957736421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c101de0 0x7f4d6c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1957736421 >> 172.21.15.81:0/1957736421 conn(0x7f4d6c0fd8c0 msgr2=0x7f4d6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1957736421 shutdown_connections 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.015+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1957736421 wait complete. 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 Processor -- start 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 -- start start 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 0x7f4d6c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d6c102790 0x7f4d6c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c106f10 0x7f4d6c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c112090 con 0x7f4d6c101de0 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c111f10 con 0x7f4d6c102790 2024-09-12T12:15:00.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d70fd2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6c112210 con 0x7f4d6c106f10 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d6a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 0x7f4d6c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.016+0000 7f4d6a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 0x7f4d6c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54942/0 (socket says 172.21.15.81:54942) 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 -- 172.21.15.81:0/1923802291 learned_addr learned my addr 172.21.15.81:0/1923802291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6ad9d640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c106f10 0x7f4d6c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d61d9b640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d6c102790 0x7f4d6c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 -- 172.21.15.81:0/1923802291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c106f10 msgr2=0x7f4d6c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c106f10 0x7f4d6c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 -- 172.21.15.81:0/1923802291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d6c102790 msgr2=0x7f4d6c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d6c102790 0x7f4d6c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 -- 172.21.15.81:0/1923802291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6c19d3d0 con 0x7f4d6c101de0 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6ad9d640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c106f10 0x7f4d6c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:00.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d6a59c640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 0x7f4d6c198420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00d770 tx=0x7f4d5c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:00.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c017070 con 0x7f4d6c101de0 2024-09-12T12:15:00.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6c19d6c0 con 0x7f4d6c101de0 2024-09-12T12:15:00.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4d5c005520 con 0x7f4d6c101de0 2024-09-12T12:15:00.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c010460 con 0x7f4d6c101de0 2024-09-12T12:15:00.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.017+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6c1a4fa0 con 0x7f4d6c101de0 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.018+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6c1021c0 con 0x7f4d6c101de0 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.019+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4d5c004ea0 con 0x7f4d6c101de0 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.020+0000 7f4d63fff640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f4d580a2c10 0x7f4d580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.020+0000 7f4d61d9b640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f4d580a2c10 0x7f4d580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.020+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f4d5c0cf0a0 con 0x7f4d6c101de0 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.020+0000 7f4d61d9b640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f4d580a2c10 0x7f4d580a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c108880 tx=0x7f4d5400c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:00.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.023+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d5c09bfa0 con 0x7f4d6c101de0 2024-09-12T12:15:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.187+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d6c0feba0 con 0x7f4d580a2c10 2024-09-12T12:15:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.195+0000 7f4d63fff640 1 -- 172.21.15.81:0/1923802291 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258759 (secure 0 0 0) 0x7f4d6c0feba0 con 0x7f4d580a2c10 2024-09-12T12:15:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f4d580a2c10 msgr2=0x7f4d580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f4d580a2c10 0x7f4d580a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c108880 tx=0x7f4d5400c4a0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 msgr2=0x7f4d6c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 0x7f4d6c198420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00d770 tx=0x7f4d5c00dc30 comp rx=0 tx=0).stop 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 shutdown_connections 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f4d580a2c10 0x7f4d580a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d6c106f10 0x7f4d6c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4d6c102790 0x7f4d6c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 --2- 172.21.15.81:0/1923802291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c101de0 0x7f4d6c198420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 >> 172.21.15.81:0/1923802291 conn(0x7f4d6c0fd8c0 msgr2=0x7f4d6c0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 shutdown_connections 2024-09-12T12:15:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:00.198+0000 7f4d70fd2640 1 -- 172.21.15.81:0/1923802291 wait complete. 2024-09-12T12:15:01.057 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-12T12:14:58.338893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647922,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":264,"num_read_kb":249,"num_write":416,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365720,"kb_used_data":12272,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576104,"statfs":{"total":1151940427776,"available":1151565930496,"internally_reserved":0,"allocated":12566528,"data_stored":6966594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49827,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":109,"num_read_kb":113,"num_write":57,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.122816"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224002+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:14:50.224002+0000","last_peered":"2024-09-12T12:14:50.224002+0000","last_clean":"2024-09-12T12:14:50.224002+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:14:50.224002+0000","last_undegraded":"2024-09-12T12:14:50.224002+0000","last_fullsized":"2024-09-12T12:14:50.224002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223690+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:14:50.223690+0000","last_peered":"2024-09-12T12:14:50.223690+0000","last_clean":"2024-09-12T12:14:50.223690+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:14:50.223690+0000","last_undegraded":"2024-09-12T12:14:50.223690+0000","last_fullsized":"2024-09-12T12:14:50.223690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223645+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:14:50.223645+0000","last_peered":"2024-09-12T12:14:50.223645+0000","last_clean":"2024-09-12T12:14:50.223645+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:14:50.223645+0000","last_undegraded":"2024-09-12T12:14:50.223645+0000","last_fullsized":"2024-09-12T12:14:50.223645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.229646+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:14:50.229646+0000","last_peered":"2024-09-12T12:14:50.229646+0000","last_clean":"2024-09-12T12:14:50.229646+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:14:50.229646+0000","last_undegraded":"2024-09-12T12:14:50.229646+0000","last_fullsized":"2024-09-12T12:14:50.229646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226394+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:14:50.226394+0000","last_peered":"2024-09-12T12:14:50.226394+0000","last_clean":"2024-09-12T12:14:50.226394+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:14:50.226394+0000","last_undegraded":"2024-09-12T12:14:50.226394+0000","last_fullsized":"2024-09-12T12:14:50.226394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231616+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:14:50.231616+0000","last_peered":"2024-09-12T12:14:50.231616+0000","last_clean":"2024-09-12T12:14:50.231616+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:14:50.231616+0000","last_undegraded":"2024-09-12T12:14:50.231616+0000","last_fullsized":"2024-09-12T12:14:50.231616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225581+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:14:50.225581+0000","last_peered":"2024-09-12T12:14:50.225581+0000","last_clean":"2024-09-12T12:14:50.225581+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:14:50.225581+0000","last_undegraded":"2024-09-12T12:14:50.225581+0000","last_fullsized":"2024-09-12T12:14:50.225581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280008+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:14:50.280008+0000","last_peered":"2024-09-12T12:14:50.280008+0000","last_clean":"2024-09-12T12:14:50.280008+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:14:50.280008+0000","last_undegraded":"2024-09-12T12:14:50.280008+0000","last_fullsized":"2024-09-12T12:14:50.280008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219580+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:14:50.219580+0000","last_peered":"2024-09-12T12:14:50.219580+0000","last_clean":"2024-09-12T12:14:50.219580+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:14:50.219580+0000","last_undegraded":"2024-09-12T12:14:50.219580+0000","last_fullsized":"2024-09-12T12:14:50.219580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232075+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:14:50.232075+0000","last_peered":"2024-09-12T12:14:50.232075+0000","last_clean":"2024-09-12T12:14:50.232075+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:14:50.232075+0000","last_undegraded":"2024-09-12T12:14:50.232075+0000","last_fullsized":"2024-09-12T12:14:50.232075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225959+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:14:50.225959+0000","last_peered":"2024-09-12T12:14:50.225959+0000","last_clean":"2024-09-12T12:14:50.225959+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:14:50.225959+0000","last_undegraded":"2024-09-12T12:14:50.225959+0000","last_fullsized":"2024-09-12T12:14:50.225959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231338+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:14:50.231338+0000","last_peered":"2024-09-12T12:14:50.231338+0000","last_clean":"2024-09-12T12:14:50.231338+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:14:50.231338+0000","last_undegraded":"2024-09-12T12:14:50.231338+0000","last_fullsized":"2024-09-12T12:14:50.231338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219034+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:14:50.219034+0000","last_peered":"2024-09-12T12:14:50.219034+0000","last_clean":"2024-09-12T12:14:50.219034+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:14:50.219034+0000","last_undegraded":"2024-09-12T12:14:50.219034+0000","last_fullsized":"2024-09-12T12:14:50.219034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223267+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:14:50.223267+0000","last_peered":"2024-09-12T12:14:50.223267+0000","last_clean":"2024-09-12T12:14:50.223267+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:14:50.223267+0000","last_undegraded":"2024-09-12T12:14:50.223267+0000","last_fullsized":"2024-09-12T12:14:50.223267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223261+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:14:50.223261+0000","last_peered":"2024-09-12T12:14:50.223261+0000","last_clean":"2024-09-12T12:14:50.223261+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:14:50.223261+0000","last_undegraded":"2024-09-12T12:14:50.223261+0000","last_fullsized":"2024-09-12T12:14:50.223261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218950+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:14:50.218950+0000","last_peered":"2024-09-12T12:14:50.218950+0000","last_clean":"2024-09-12T12:14:50.218950+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:14:50.218950+0000","last_undegraded":"2024-09-12T12:14:50.218950+0000","last_fullsized":"2024-09-12T12:14:50.218950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224014+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:14:50.224014+0000","last_peered":"2024-09-12T12:14:50.224014+0000","last_clean":"2024-09-12T12:14:50.224014+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:14:50.224014+0000","last_undegraded":"2024-09-12T12:14:50.224014+0000","last_fullsized":"2024-09-12T12:14:50.224014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221508+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:14:50.221508+0000","last_peered":"2024-09-12T12:14:50.221508+0000","last_clean":"2024-09-12T12:14:50.221508+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:14:50.221508+0000","last_undegraded":"2024-09-12T12:14:50.221508+0000","last_fullsized":"2024-09-12T12:14:50.221508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228040+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:14:50.228040+0000","last_peered":"2024-09-12T12:14:50.228040+0000","last_clean":"2024-09-12T12:14:50.228040+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:14:50.228040+0000","last_undegraded":"2024-09-12T12:14:50.228040+0000","last_fullsized":"2024-09-12T12:14:50.228040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223932+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:14:50.223932+0000","last_peered":"2024-09-12T12:14:50.223932+0000","last_clean":"2024-09-12T12:14:50.223932+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:14:50.223932+0000","last_undegraded":"2024-09-12T12:14:50.223932+0000","last_fullsized":"2024-09-12T12:14:50.223932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219135+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:14:50.219135+0000","last_peered":"2024-09-12T12:14:50.219135+0000","last_clean":"2024-09-12T12:14:50.219135+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:14:50.219135+0000","last_undegraded":"2024-09-12T12:14:50.219135+0000","last_fullsized":"2024-09-12T12:14:50.219135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219137+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:14:50.219137+0000","last_peered":"2024-09-12T12:14:50.219137+0000","last_clean":"2024-09-12T12:14:50.219137+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:14:50.219137+0000","last_undegraded":"2024-09-12T12:14:50.219137+0000","last_fullsized":"2024-09-12T12:14:50.219137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280034+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:14:50.280034+0000","last_peered":"2024-09-12T12:14:50.280034+0000","last_clean":"2024-09-12T12:14:50.280034+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:14:50.280034+0000","last_undegraded":"2024-09-12T12:14:50.280034+0000","last_fullsized":"2024-09-12T12:14:50.280034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219819+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:14:50.219819+0000","last_peered":"2024-09-12T12:14:50.219819+0000","last_clean":"2024-09-12T12:14:50.219819+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:14:50.219819+0000","last_undegraded":"2024-09-12T12:14:50.219819+0000","last_fullsized":"2024-09-12T12:14:50.219819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280337+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:14:50.280337+0000","last_peered":"2024-09-12T12:14:50.280337+0000","last_clean":"2024-09-12T12:14:50.280337+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:14:50.280337+0000","last_undegraded":"2024-09-12T12:14:50.280337+0000","last_fullsized":"2024-09-12T12:14:50.280337+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227056+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:14:50.227056+0000","last_peered":"2024-09-12T12:14:50.227056+0000","last_clean":"2024-09-12T12:14:50.227056+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:14:50.227056+0000","last_undegraded":"2024-09-12T12:14:50.227056+0000","last_fullsized":"2024-09-12T12:14:50.227056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223841+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:14:50.223841+0000","last_peered":"2024-09-12T12:14:50.223841+0000","last_clean":"2024-09-12T12:14:50.223841+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:14:50.223841+0000","last_undegraded":"2024-09-12T12:14:50.223841+0000","last_fullsized":"2024-09-12T12:14:50.223841+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219032+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:14:50.219032+0000","last_peered":"2024-09-12T12:14:50.219032+0000","last_clean":"2024-09-12T12:14:50.219032+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:14:50.219032+0000","last_undegraded":"2024-09-12T12:14:50.219032+0000","last_fullsized":"2024-09-12T12:14:50.219032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223581+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:14:50.223581+0000","last_peered":"2024-09-12T12:14:50.223581+0000","last_clean":"2024-09-12T12:14:50.223581+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:14:50.223581+0000","last_undegraded":"2024-09-12T12:14:50.223581+0000","last_fullsized":"2024-09-12T12:14:50.223581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226653+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:14:50.226653+0000","last_peered":"2024-09-12T12:14:50.226653+0000","last_clean":"2024-09-12T12:14:50.226653+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:14:50.226653+0000","last_undegraded":"2024-09-12T12:14:50.226653+0000","last_fullsized":"2024-09-12T12:14:50.226653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226504+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:14:50.226504+0000","last_peered":"2024-09-12T12:14:50.226504+0000","last_clean":"2024-09-12T12:14:50.226504+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:14:50.226504+0000","last_undegraded":"2024-09-12T12:14:50.226504+0000","last_fullsized":"2024-09-12T12:14:50.226504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223567+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:14:50.223567+0000","last_peered":"2024-09-12T12:14:50.223567+0000","last_clean":"2024-09-12T12:14:50.223567+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:14:50.223567+0000","last_undegraded":"2024-09-12T12:14:50.223567+0000","last_fullsized":"2024-09-12T12:14:50.223567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226671+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:14:50.226671+0000","last_peered":"2024-09-12T12:14:50.226671+0000","last_clean":"2024-09-12T12:14:50.226671+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:14:50.226671+0000","last_undegraded":"2024-09-12T12:14:50.226671+0000","last_fullsized":"2024-09-12T12:14:50.226671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":38,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:52.235553+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:14:52.235553+0000","last_peered":"2024-09-12T12:14:52.235553+0000","last_clean":"2024-09-12T12:14:52.235553+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:14:52.235553+0000","last_undegraded":"2024-09-12T12:14:52.235553+0000","last_fullsized":"2024-09-12T12:14:52.235553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220157+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:14:50.220157+0000","last_peered":"2024-09-12T12:14:50.220157+0000","last_clean":"2024-09-12T12:14:50.220157+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:14:50.220157+0000","last_undegraded":"2024-09-12T12:14:50.220157+0000","last_fullsized":"2024-09-12T12:14:50.220157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231906+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:14:50.231906+0000","last_peered":"2024-09-12T12:14:50.231906+0000","last_clean":"2024-09-12T12:14:50.231906+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:14:50.231906+0000","last_undegraded":"2024-09-12T12:14:50.231906+0000","last_fullsized":"2024-09-12T12:14:50.231906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218706+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:14:50.218706+0000","last_peered":"2024-09-12T12:14:50.218706+0000","last_clean":"2024-09-12T12:14:50.218706+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:14:50.218706+0000","last_undegraded":"2024-09-12T12:14:50.218706+0000","last_fullsized":"2024-09-12T12:14:50.218706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280070+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:14:50.280070+0000","last_peered":"2024-09-12T12:14:50.280070+0000","last_clean":"2024-09-12T12:14:50.280070+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:14:50.280070+0000","last_undegraded":"2024-09-12T12:14:50.280070+0000","last_fullsized":"2024-09-12T12:14:50.280070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220009+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:14:50.220009+0000","last_peered":"2024-09-12T12:14:50.220009+0000","last_clean":"2024-09-12T12:14:50.220009+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:14:50.220009+0000","last_undegraded":"2024-09-12T12:14:50.220009+0000","last_fullsized":"2024-09-12T12:14:50.220009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221222+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:14:50.221222+0000","last_peered":"2024-09-12T12:14:50.221222+0000","last_clean":"2024-09-12T12:14:50.221222+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:14:50.221222+0000","last_undegraded":"2024-09-12T12:14:50.221222+0000","last_fullsized":"2024-09-12T12:14:50.221222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:56.239958+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:14:56.239958+0000","last_peered":"2024-09-12T12:14:56.239958+0000","last_clean":"2024-09-12T12:14:56.239958+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:14:56.239958+0000","last_undegraded":"2024-09-12T12:14:56.239958+0000","last_fullsized":"2024-09-12T12:14:56.239958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219468+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:14:50.219468+0000","last_peered":"2024-09-12T12:14:50.219468+0000","last_clean":"2024-09-12T12:14:50.219468+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:14:50.219468+0000","last_undegraded":"2024-09-12T12:14:50.219468+0000","last_fullsized":"2024-09-12T12:14:50.219468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225933+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:14:50.225933+0000","last_peered":"2024-09-12T12:14:50.225933+0000","last_clean":"2024-09-12T12:14:50.225933+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:14:50.225933+0000","last_undegraded":"2024-09-12T12:14:50.225933+0000","last_fullsized":"2024-09-12T12:14:50.225933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223934+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:14:50.223934+0000","last_peered":"2024-09-12T12:14:50.223934+0000","last_clean":"2024-09-12T12:14:50.223934+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:14:50.223934+0000","last_undegraded":"2024-09-12T12:14:50.223934+0000","last_fullsized":"2024-09-12T12:14:50.223934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220510+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:14:50.220510+0000","last_peered":"2024-09-12T12:14:50.220510+0000","last_clean":"2024-09-12T12:14:50.220510+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:14:50.220510+0000","last_undegraded":"2024-09-12T12:14:50.220510+0000","last_fullsized":"2024-09-12T12:14:50.220510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228850+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:14:50.228850+0000","last_peered":"2024-09-12T12:14:50.228850+0000","last_clean":"2024-09-12T12:14:50.228850+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:14:50.228850+0000","last_undegraded":"2024-09-12T12:14:50.228850+0000","last_fullsized":"2024-09-12T12:14:50.228850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'27","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:56.242842+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:14:56.242842+0000","last_peered":"2024-09-12T12:14:56.242842+0000","last_clean":"2024-09-12T12:14:56.242842+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:14:56.242842+0000","last_undegraded":"2024-09-12T12:14:56.242842+0000","last_fullsized":"2024-09-12T12:14:56.242842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227196+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:14:50.227196+0000","last_peered":"2024-09-12T12:14:50.227196+0000","last_clean":"2024-09-12T12:14:50.227196+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:14:50.227196+0000","last_undegraded":"2024-09-12T12:14:50.227196+0000","last_fullsized":"2024-09-12T12:14:50.227196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226197+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:14:50.226197+0000","last_peered":"2024-09-12T12:14:50.226197+0000","last_clean":"2024-09-12T12:14:50.226197+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:14:50.226197+0000","last_undegraded":"2024-09-12T12:14:50.226197+0000","last_fullsized":"2024-09-12T12:14:50.226197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218755+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:14:50.218755+0000","last_peered":"2024-09-12T12:14:50.218755+0000","last_clean":"2024-09-12T12:14:50.218755+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:14:50.218755+0000","last_undegraded":"2024-09-12T12:14:50.218755+0000","last_fullsized":"2024-09-12T12:14:50.218755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220324+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:14:50.220324+0000","last_peered":"2024-09-12T12:14:50.220324+0000","last_clean":"2024-09-12T12:14:50.220324+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:14:50.220324+0000","last_undegraded":"2024-09-12T12:14:50.220324+0000","last_fullsized":"2024-09-12T12:14:50.220324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225952+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:14:50.225952+0000","last_peered":"2024-09-12T12:14:50.225952+0000","last_clean":"2024-09-12T12:14:50.225952+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:14:50.225952+0000","last_undegraded":"2024-09-12T12:14:50.225952+0000","last_fullsized":"2024-09-12T12:14:50.225952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:53.234624+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:14:53.234624+0000","last_peered":"2024-09-12T12:14:53.234624+0000","last_clean":"2024-09-12T12:14:53.234624+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:14:53.234624+0000","last_undegraded":"2024-09-12T12:14:53.234624+0000","last_fullsized":"2024-09-12T12:14:53.234624+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225510+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:14:50.225510+0000","last_peered":"2024-09-12T12:14:50.225510+0000","last_clean":"2024-09-12T12:14:50.225510+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:14:50.225510+0000","last_undegraded":"2024-09-12T12:14:50.225510+0000","last_fullsized":"2024-09-12T12:14:50.225510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226487+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:14:50.226487+0000","last_peered":"2024-09-12T12:14:50.226487+0000","last_clean":"2024-09-12T12:14:50.226487+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:14:50.226487+0000","last_undegraded":"2024-09-12T12:14:50.226487+0000","last_fullsized":"2024-09-12T12:14:50.226487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220083+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:14:50.220083+0000","last_peered":"2024-09-12T12:14:50.220083+0000","last_clean":"2024-09-12T12:14:50.220083+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:14:50.220083+0000","last_undegraded":"2024-09-12T12:14:50.220083+0000","last_fullsized":"2024-09-12T12:14:50.220083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227405+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:14:50.227405+0000","last_peered":"2024-09-12T12:14:50.227405+0000","last_clean":"2024-09-12T12:14:50.227405+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:14:50.227405+0000","last_undegraded":"2024-09-12T12:14:50.227405+0000","last_fullsized":"2024-09-12T12:14:50.227405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223688+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:14:50.223688+0000","last_peered":"2024-09-12T12:14:50.223688+0000","last_clean":"2024-09-12T12:14:50.223688+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:14:50.223688+0000","last_undegraded":"2024-09-12T12:14:50.223688+0000","last_fullsized":"2024-09-12T12:14:50.223688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219270+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:14:50.219270+0000","last_peered":"2024-09-12T12:14:50.219270+0000","last_clean":"2024-09-12T12:14:50.219270+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:14:50.219270+0000","last_undegraded":"2024-09-12T12:14:50.219270+0000","last_fullsized":"2024-09-12T12:14:50.219270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225832+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:14:50.225832+0000","last_peered":"2024-09-12T12:14:50.225832+0000","last_clean":"2024-09-12T12:14:50.225832+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:14:50.225832+0000","last_undegraded":"2024-09-12T12:14:50.225832+0000","last_fullsized":"2024-09-12T12:14:50.225832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220411+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:14:50.220411+0000","last_peered":"2024-09-12T12:14:50.220411+0000","last_clean":"2024-09-12T12:14:50.220411+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:14:50.220411+0000","last_undegraded":"2024-09-12T12:14:50.220411+0000","last_fullsized":"2024-09-12T12:14:50.220411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225950+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:14:50.225950+0000","last_peered":"2024-09-12T12:14:50.225950+0000","last_clean":"2024-09-12T12:14:50.225950+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:14:50.225950+0000","last_undegraded":"2024-09-12T12:14:50.225950+0000","last_fullsized":"2024-09-12T12:14:50.225950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'5","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:53.236478+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:14:53.236478+0000","last_peered":"2024-09-12T12:14:53.236478+0000","last_clean":"2024-09-12T12:14:53.236478+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:14:53.236478+0000","last_undegraded":"2024-09-12T12:14:53.236478+0000","last_fullsized":"2024-09-12T12:14:53.236478+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226039+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:14:50.226039+0000","last_peered":"2024-09-12T12:14:50.226039+0000","last_clean":"2024-09-12T12:14:50.226039+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:14:50.226039+0000","last_undegraded":"2024-09-12T12:14:50.226039+0000","last_fullsized":"2024-09-12T12:14:50.226039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225717+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:14:50.225717+0000","last_peered":"2024-09-12T12:14:50.225717+0000","last_clean":"2024-09-12T12:14:50.225717+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:14:50.225717+0000","last_undegraded":"2024-09-12T12:14:50.225717+0000","last_fullsized":"2024-09-12T12:14:50.225717+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.230997+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:14:50.230997+0000","last_peered":"2024-09-12T12:14:50.230997+0000","last_clean":"2024-09-12T12:14:50.230997+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:14:50.230997+0000","last_undegraded":"2024-09-12T12:14:50.230997+0000","last_fullsized":"2024-09-12T12:14:50.230997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.222469+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:14:50.222469+0000","last_peered":"2024-09-12T12:14:50.222469+0000","last_clean":"2024-09-12T12:14:50.222469+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:14:50.222469+0000","last_undegraded":"2024-09-12T12:14:50.222469+0000","last_fullsized":"2024-09-12T12:14:50.222469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225688+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:14:50.225688+0000","last_peered":"2024-09-12T12:14:50.225688+0000","last_clean":"2024-09-12T12:14:50.225688+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:14:50.225688+0000","last_undegraded":"2024-09-12T12:14:50.225688+0000","last_fullsized":"2024-09-12T12:14:50.225688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218701+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:14:50.218701+0000","last_peered":"2024-09-12T12:14:50.218701+0000","last_clean":"2024-09-12T12:14:50.218701+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:14:50.218701+0000","last_undegraded":"2024-09-12T12:14:50.218701+0000","last_fullsized":"2024-09-12T12:14:50.218701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:53.234167+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:14:53.234167+0000","last_peered":"2024-09-12T12:14:53.234167+0000","last_clean":"2024-09-12T12:14:53.234167+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:14:53.234167+0000","last_undegraded":"2024-09-12T12:14:53.234167+0000","last_fullsized":"2024-09-12T12:14:53.234167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219869+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:14:50.219869+0000","last_peered":"2024-09-12T12:14:50.219869+0000","last_clean":"2024-09-12T12:14:50.219869+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:14:50.219869+0000","last_undegraded":"2024-09-12T12:14:50.219869+0000","last_fullsized":"2024-09-12T12:14:50.219869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:55.234224+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:14:55.234224+0000","last_peered":"2024-09-12T12:14:55.234224+0000","last_clean":"2024-09-12T12:14:55.234224+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:14:55.234224+0000","last_undegraded":"2024-09-12T12:14:55.234224+0000","last_fullsized":"2024-09-12T12:14:55.234224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231612+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:14:50.231612+0000","last_peered":"2024-09-12T12:14:50.231612+0000","last_clean":"2024-09-12T12:14:50.231612+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:14:50.231612+0000","last_undegraded":"2024-09-12T12:14:50.231612+0000","last_fullsized":"2024-09-12T12:14:50.231612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225099+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:14:50.225099+0000","last_peered":"2024-09-12T12:14:50.225099+0000","last_clean":"2024-09-12T12:14:50.225099+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:14:50.225099+0000","last_undegraded":"2024-09-12T12:14:50.225099+0000","last_fullsized":"2024-09-12T12:14:50.225099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231738+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:14:50.231738+0000","last_peered":"2024-09-12T12:14:50.231738+0000","last_clean":"2024-09-12T12:14:50.231738+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:14:50.231738+0000","last_undegraded":"2024-09-12T12:14:50.231738+0000","last_fullsized":"2024-09-12T12:14:50.231738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227316+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:14:50.227316+0000","last_peered":"2024-09-12T12:14:50.227316+0000","last_clean":"2024-09-12T12:14:50.227316+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:14:50.227316+0000","last_undegraded":"2024-09-12T12:14:50.227316+0000","last_fullsized":"2024-09-12T12:14:50.227316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219126+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:14:50.219126+0000","last_peered":"2024-09-12T12:14:50.219126+0000","last_clean":"2024-09-12T12:14:50.219126+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:14:50.219126+0000","last_undegraded":"2024-09-12T12:14:50.219126+0000","last_fullsized":"2024-09-12T12:14:50.219126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:54.388976+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:14:54.388976+0000","last_peered":"2024-09-12T12:14:54.388976+0000","last_clean":"2024-09-12T12:14:54.388976+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:14:54.388976+0000","last_undegraded":"2024-09-12T12:14:54.388976+0000","last_fullsized":"2024-09-12T12:14:54.388976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280423+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:14:50.280423+0000","last_peered":"2024-09-12T12:14:50.280423+0000","last_clean":"2024-09-12T12:14:50.280423+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:14:50.280423+0000","last_undegraded":"2024-09-12T12:14:50.280423+0000","last_fullsized":"2024-09-12T12:14:50.280423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231076+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:14:50.231076+0000","last_peered":"2024-09-12T12:14:50.231076+0000","last_clean":"2024-09-12T12:14:50.231076+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:14:50.231076+0000","last_undegraded":"2024-09-12T12:14:50.231076+0000","last_fullsized":"2024-09-12T12:14:50.231076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223746+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:14:50.223746+0000","last_peered":"2024-09-12T12:14:50.223746+0000","last_clean":"2024-09-12T12:14:50.223746+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:14:50.223746+0000","last_undegraded":"2024-09-12T12:14:50.223746+0000","last_fullsized":"2024-09-12T12:14:50.223746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219067+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:14:50.219067+0000","last_peered":"2024-09-12T12:14:50.219067+0000","last_clean":"2024-09-12T12:14:50.219067+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:14:50.219067+0000","last_undegraded":"2024-09-12T12:14:50.219067+0000","last_fullsized":"2024-09-12T12:14:50.219067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226116+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:14:50.226116+0000","last_peered":"2024-09-12T12:14:50.226116+0000","last_clean":"2024-09-12T12:14:50.226116+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:14:50.226116+0000","last_undegraded":"2024-09-12T12:14:50.226116+0000","last_fullsized":"2024-09-12T12:14:50.226116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280169+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:14:50.280169+0000","last_peered":"2024-09-12T12:14:50.280169+0000","last_clean":"2024-09-12T12:14:50.280169+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:14:50.280169+0000","last_undegraded":"2024-09-12T12:14:50.280169+0000","last_fullsized":"2024-09-12T12:14:50.280169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223582+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:14:50.223582+0000","last_peered":"2024-09-12T12:14:50.223582+0000","last_clean":"2024-09-12T12:14:50.223582+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:14:50.223582+0000","last_undegraded":"2024-09-12T12:14:50.223582+0000","last_fullsized":"2024-09-12T12:14:50.223582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226774+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:14:50.226774+0000","last_peered":"2024-09-12T12:14:50.226774+0000","last_clean":"2024-09-12T12:14:50.226774+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:14:50.226774+0000","last_undegraded":"2024-09-12T12:14:50.226774+0000","last_fullsized":"2024-09-12T12:14:50.226774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280155+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:14:50.280155+0000","last_peered":"2024-09-12T12:14:50.280155+0000","last_clean":"2024-09-12T12:14:50.280155+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:14:50.280155+0000","last_undegraded":"2024-09-12T12:14:50.280155+0000","last_fullsized":"2024-09-12T12:14:50.280155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226514+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:14:50.226514+0000","last_peered":"2024-09-12T12:14:50.226514+0000","last_clean":"2024-09-12T12:14:50.226514+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:14:50.226514+0000","last_undegraded":"2024-09-12T12:14:50.226514+0000","last_fullsized":"2024-09-12T12:14:50.226514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225702+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:14:50.225702+0000","last_peered":"2024-09-12T12:14:50.225702+0000","last_clean":"2024-09-12T12:14:50.225702+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:14:50.225702+0000","last_undegraded":"2024-09-12T12:14:50.225702+0000","last_fullsized":"2024-09-12T12:14:50.225702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232265+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:14:50.232265+0000","last_peered":"2024-09-12T12:14:50.232265+0000","last_clean":"2024-09-12T12:14:50.232265+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:14:50.232265+0000","last_undegraded":"2024-09-12T12:14:50.232265+0000","last_fullsized":"2024-09-12T12:14:50.232265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226949+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:14:50.226949+0000","last_peered":"2024-09-12T12:14:50.226949+0000","last_clean":"2024-09-12T12:14:50.226949+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:14:50.226949+0000","last_undegraded":"2024-09-12T12:14:50.226949+0000","last_fullsized":"2024-09-12T12:14:50.226949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219147+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:14:50.219147+0000","last_peered":"2024-09-12T12:14:50.219147+0000","last_clean":"2024-09-12T12:14:50.219147+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:14:50.219147+0000","last_undegraded":"2024-09-12T12:14:50.219147+0000","last_fullsized":"2024-09-12T12:14:50.219147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'12","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.241528+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:14:50.241528+0000","last_peered":"2024-09-12T12:14:50.241528+0000","last_clean":"2024-09-12T12:14:50.241528+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:14:50.241528+0000","last_undegraded":"2024-09-12T12:14:50.241528+0000","last_fullsized":"2024-09-12T12:14:50.241528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223893+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:14:50.223893+0000","last_peered":"2024-09-12T12:14:50.223893+0000","last_clean":"2024-09-12T12:14:50.223893+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:14:50.223893+0000","last_undegraded":"2024-09-12T12:14:50.223893+0000","last_fullsized":"2024-09-12T12:14:50.223893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280619+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:14:50.280619+0000","last_peered":"2024-09-12T12:14:50.280619+0000","last_clean":"2024-09-12T12:14:50.280619+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:14:50.280619+0000","last_undegraded":"2024-09-12T12:14:50.280619+0000","last_fullsized":"2024-09-12T12:14:50.280619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280520+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:14:50.280520+0000","last_peered":"2024-09-12T12:14:50.280520+0000","last_clean":"2024-09-12T12:14:50.280520+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:14:50.280520+0000","last_undegraded":"2024-09-12T12:14:50.280520+0000","last_fullsized":"2024-09-12T12:14:50.280520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'13","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:56.234837+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:14:56.234837+0000","last_peered":"2024-09-12T12:14:56.234837+0000","last_clean":"2024-09-12T12:14:56.234837+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:14:56.234837+0000","last_undegraded":"2024-09-12T12:14:56.234837+0000","last_fullsized":"2024-09-12T12:14:56.234837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57320,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":128,"num_read_kb":130,"num_write":233,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":516096,"data_stored":153866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":423209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1548288,"data_stored":1055303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":423139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":423517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528356,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32636,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712516,"statfs":{"total":95995035648,"available":95961616384,"internally_reserved":0,"allocated":1486848,"data_stored":1016430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":423249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28492,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716660,"statfs":{"total":95995035648,"available":95965859840,"internally_reserved":0,"allocated":1495040,"data_stored":1015598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018930,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":422681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":465447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":905216,"data_stored":451109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":897024,"data_stored":424195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":43210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":51848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:01.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:15:01.309 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:01 smithi103 ceph-mon[35094]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:01 smithi103 ceph-mon[35094]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 13 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:15:01.713 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:01 smithi081 ceph-mon[30948]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:01.713 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:01 smithi081 ceph-mon[30948]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 13 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:15:01.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 -- 172.21.15.81:0/903783664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8106f20 msgr2=0x7f94f810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:01.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 --2- 172.21.15.81:0/903783664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8106f20 0x7f94f810eaa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009ca0 tx=0x7f94f002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 -- 172.21.15.81:0/903783664 shutdown_connections 2024-09-12T12:15:01.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 --2- 172.21.15.81:0/903783664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8106f20 0x7f94f810eaa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 --2- 172.21.15.81:0/903783664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f81027a0 0x7f94f81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 --2- 172.21.15.81:0/903783664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f8101df0 0x7f94f81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 -- 172.21.15.81:0/903783664 >> 172.21.15.81:0/903783664 conn(0x7f94f80fd8b0 msgr2=0x7f94f80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 -- 172.21.15.81:0/903783664 shutdown_connections 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.791+0000 7f94fefab640 1 -- 172.21.15.81:0/903783664 wait complete. 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 Processor -- start 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 -- start start 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 0x7f94f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f81027a0 0x7f94f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f8106f20 0x7f94f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81120a0 con 0x7f94f8101df0 2024-09-12T12:15:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8111f20 con 0x7f94f8106f20 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fefab640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8112220 con 0x7f94f81027a0 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 0x7f94f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 0x7f94f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54960/0 (socket says 172.21.15.81:54960) 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 -- 172.21.15.81:0/2309134270 learned_addr learned my addr 172.21.15.81:0/2309134270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fd548640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f8106f20 0x7f94f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 -- 172.21.15.81:0/2309134270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f81027a0 msgr2=0x7f94f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94f7fff640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f81027a0 0x7f94f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f81027a0 0x7f94f8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 -- 172.21.15.81:0/2309134270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f8106f20 msgr2=0x7f94f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f8106f20 0x7f94f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fcd47640 1 -- 172.21.15.81:0/2309134270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f81a6980 con 0x7f94f8101df0 2024-09-12T12:15:01.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.792+0000 7f94fd548640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f8106f20 0x7f94f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.793+0000 7f94fcd47640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 0x7f94f80744f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00c970 tx=0x7f94ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.793+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec007bb0 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.793+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f81a6c70 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.793+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f94ec007d50 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.793+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00f4b0 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.793+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f81a71b0 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.794+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f81021d0 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.795+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f94ec0046c0 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.795+0000 7f94f5ffb640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94e80a2c10 0x7f94e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.796+0000 7f94f7fff640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94e80a2c10 0x7f94e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.796+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f94ec0cef40 con 0x7f94f8101df0 2024-09-12T12:15:01.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.796+0000 7f94f7fff640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94e80a2c10 0x7f94e80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94f8075f80 tx=0x7f94e4005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:01.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.800+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94ec014030 con 0x7f94f8101df0 2024-09-12T12:15:01.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:01 smithi173 ceph-mon[35326]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:01.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:01 smithi173 ceph-mon[35326]: pgmap v285: 97 pgs: 97 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.9 KiB/s wr, 13 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:15:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.962+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94f8062630 con 0x7f94e80a2c10 2024-09-12T12:15:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.968+0000 7f94f5ffb640 1 -- 172.21.15.81:0/2309134270 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258759 (secure 0 0 0) 0x7f94f8062630 con 0x7f94e80a2c10 2024-09-12T12:15:01.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:15:01.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94e80a2c10 msgr2=0x7f94e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:01.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94e80a2c10 0x7f94e80a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94f8075f80 tx=0x7f94e4005be0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 msgr2=0x7f94f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:01.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 0x7f94f80744f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00c970 tx=0x7f94ec00ce30 comp rx=0 tx=0).stop 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 shutdown_connections 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f94e80a2c10 0x7f94e80a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f94f8106f20 0x7f94f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94f81027a0 0x7f94f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 --2- 172.21.15.81:0/2309134270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94f8101df0 0x7f94f80744f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.971+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 >> 172.21.15.81:0/2309134270 conn(0x7f94f80fd8b0 msgr2=0x7f94f80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.972+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 shutdown_connections 2024-09-12T12:15:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:01.972+0000 7f94fefab640 1 -- 172.21.15.81:0/2309134270 wait complete. 2024-09-12T12:15:02.789 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-12T12:15:00.339350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647922,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":284,"num_read_kb":254,"num_write":416,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365744,"kb_used_data":12312,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576080,"statfs":{"total":1151940427776,"available":1151565905920,"internally_reserved":0,"allocated":12607488,"data_stored":6998923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49127,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":102,"num_write":33,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.121627"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224002+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:14:50.224002+0000","last_peered":"2024-09-12T12:14:50.224002+0000","last_clean":"2024-09-12T12:14:50.224002+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:14:50.224002+0000","last_undegraded":"2024-09-12T12:14:50.224002+0000","last_fullsized":"2024-09-12T12:14:50.224002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223690+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:14:50.223690+0000","last_peered":"2024-09-12T12:14:50.223690+0000","last_clean":"2024-09-12T12:14:50.223690+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:14:50.223690+0000","last_undegraded":"2024-09-12T12:14:50.223690+0000","last_fullsized":"2024-09-12T12:14:50.223690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223645+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:14:50.223645+0000","last_peered":"2024-09-12T12:14:50.223645+0000","last_clean":"2024-09-12T12:14:50.223645+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:14:50.223645+0000","last_undegraded":"2024-09-12T12:14:50.223645+0000","last_fullsized":"2024-09-12T12:14:50.223645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.229646+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:14:50.229646+0000","last_peered":"2024-09-12T12:14:50.229646+0000","last_clean":"2024-09-12T12:14:50.229646+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:14:50.229646+0000","last_undegraded":"2024-09-12T12:14:50.229646+0000","last_fullsized":"2024-09-12T12:14:50.229646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226394+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:14:50.226394+0000","last_peered":"2024-09-12T12:14:50.226394+0000","last_clean":"2024-09-12T12:14:50.226394+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:14:50.226394+0000","last_undegraded":"2024-09-12T12:14:50.226394+0000","last_fullsized":"2024-09-12T12:14:50.226394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231616+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:14:50.231616+0000","last_peered":"2024-09-12T12:14:50.231616+0000","last_clean":"2024-09-12T12:14:50.231616+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:14:50.231616+0000","last_undegraded":"2024-09-12T12:14:50.231616+0000","last_fullsized":"2024-09-12T12:14:50.231616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225581+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:14:50.225581+0000","last_peered":"2024-09-12T12:14:50.225581+0000","last_clean":"2024-09-12T12:14:50.225581+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:14:50.225581+0000","last_undegraded":"2024-09-12T12:14:50.225581+0000","last_fullsized":"2024-09-12T12:14:50.225581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280008+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:14:50.280008+0000","last_peered":"2024-09-12T12:14:50.280008+0000","last_clean":"2024-09-12T12:14:50.280008+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:14:50.280008+0000","last_undegraded":"2024-09-12T12:14:50.280008+0000","last_fullsized":"2024-09-12T12:14:50.280008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219580+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:14:50.219580+0000","last_peered":"2024-09-12T12:14:50.219580+0000","last_clean":"2024-09-12T12:14:50.219580+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:14:50.219580+0000","last_undegraded":"2024-09-12T12:14:50.219580+0000","last_fullsized":"2024-09-12T12:14:50.219580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232075+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:14:50.232075+0000","last_peered":"2024-09-12T12:14:50.232075+0000","last_clean":"2024-09-12T12:14:50.232075+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:14:50.232075+0000","last_undegraded":"2024-09-12T12:14:50.232075+0000","last_fullsized":"2024-09-12T12:14:50.232075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225959+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:14:50.225959+0000","last_peered":"2024-09-12T12:14:50.225959+0000","last_clean":"2024-09-12T12:14:50.225959+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:14:50.225959+0000","last_undegraded":"2024-09-12T12:14:50.225959+0000","last_fullsized":"2024-09-12T12:14:50.225959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231338+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:14:50.231338+0000","last_peered":"2024-09-12T12:14:50.231338+0000","last_clean":"2024-09-12T12:14:50.231338+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:14:50.231338+0000","last_undegraded":"2024-09-12T12:14:50.231338+0000","last_fullsized":"2024-09-12T12:14:50.231338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219034+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:14:50.219034+0000","last_peered":"2024-09-12T12:14:50.219034+0000","last_clean":"2024-09-12T12:14:50.219034+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:14:50.219034+0000","last_undegraded":"2024-09-12T12:14:50.219034+0000","last_fullsized":"2024-09-12T12:14:50.219034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223267+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:14:50.223267+0000","last_peered":"2024-09-12T12:14:50.223267+0000","last_clean":"2024-09-12T12:14:50.223267+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:14:50.223267+0000","last_undegraded":"2024-09-12T12:14:50.223267+0000","last_fullsized":"2024-09-12T12:14:50.223267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223261+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:14:50.223261+0000","last_peered":"2024-09-12T12:14:50.223261+0000","last_clean":"2024-09-12T12:14:50.223261+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:14:50.223261+0000","last_undegraded":"2024-09-12T12:14:50.223261+0000","last_fullsized":"2024-09-12T12:14:50.223261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218950+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:14:50.218950+0000","last_peered":"2024-09-12T12:14:50.218950+0000","last_clean":"2024-09-12T12:14:50.218950+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:14:50.218950+0000","last_undegraded":"2024-09-12T12:14:50.218950+0000","last_fullsized":"2024-09-12T12:14:50.218950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224014+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:14:50.224014+0000","last_peered":"2024-09-12T12:14:50.224014+0000","last_clean":"2024-09-12T12:14:50.224014+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:14:50.224014+0000","last_undegraded":"2024-09-12T12:14:50.224014+0000","last_fullsized":"2024-09-12T12:14:50.224014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221508+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:14:50.221508+0000","last_peered":"2024-09-12T12:14:50.221508+0000","last_clean":"2024-09-12T12:14:50.221508+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:14:50.221508+0000","last_undegraded":"2024-09-12T12:14:50.221508+0000","last_fullsized":"2024-09-12T12:14:50.221508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228040+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:14:50.228040+0000","last_peered":"2024-09-12T12:14:50.228040+0000","last_clean":"2024-09-12T12:14:50.228040+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:14:50.228040+0000","last_undegraded":"2024-09-12T12:14:50.228040+0000","last_fullsized":"2024-09-12T12:14:50.228040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223932+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:14:50.223932+0000","last_peered":"2024-09-12T12:14:50.223932+0000","last_clean":"2024-09-12T12:14:50.223932+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:14:50.223932+0000","last_undegraded":"2024-09-12T12:14:50.223932+0000","last_fullsized":"2024-09-12T12:14:50.223932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219135+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:14:50.219135+0000","last_peered":"2024-09-12T12:14:50.219135+0000","last_clean":"2024-09-12T12:14:50.219135+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:14:50.219135+0000","last_undegraded":"2024-09-12T12:14:50.219135+0000","last_fullsized":"2024-09-12T12:14:50.219135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219137+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:14:50.219137+0000","last_peered":"2024-09-12T12:14:50.219137+0000","last_clean":"2024-09-12T12:14:50.219137+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:14:50.219137+0000","last_undegraded":"2024-09-12T12:14:50.219137+0000","last_fullsized":"2024-09-12T12:14:50.219137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280034+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:14:50.280034+0000","last_peered":"2024-09-12T12:14:50.280034+0000","last_clean":"2024-09-12T12:14:50.280034+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:14:50.280034+0000","last_undegraded":"2024-09-12T12:14:50.280034+0000","last_fullsized":"2024-09-12T12:14:50.280034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219819+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:14:50.219819+0000","last_peered":"2024-09-12T12:14:50.219819+0000","last_clean":"2024-09-12T12:14:50.219819+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:14:50.219819+0000","last_undegraded":"2024-09-12T12:14:50.219819+0000","last_fullsized":"2024-09-12T12:14:50.219819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280337+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:14:50.280337+0000","last_peered":"2024-09-12T12:14:50.280337+0000","last_clean":"2024-09-12T12:14:50.280337+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:14:50.280337+0000","last_undegraded":"2024-09-12T12:14:50.280337+0000","last_fullsized":"2024-09-12T12:14:50.280337+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227056+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:14:50.227056+0000","last_peered":"2024-09-12T12:14:50.227056+0000","last_clean":"2024-09-12T12:14:50.227056+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:14:50.227056+0000","last_undegraded":"2024-09-12T12:14:50.227056+0000","last_fullsized":"2024-09-12T12:14:50.227056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223841+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:14:50.223841+0000","last_peered":"2024-09-12T12:14:50.223841+0000","last_clean":"2024-09-12T12:14:50.223841+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:14:50.223841+0000","last_undegraded":"2024-09-12T12:14:50.223841+0000","last_fullsized":"2024-09-12T12:14:50.223841+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219032+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:14:50.219032+0000","last_peered":"2024-09-12T12:14:50.219032+0000","last_clean":"2024-09-12T12:14:50.219032+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:14:50.219032+0000","last_undegraded":"2024-09-12T12:14:50.219032+0000","last_fullsized":"2024-09-12T12:14:50.219032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223581+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:14:50.223581+0000","last_peered":"2024-09-12T12:14:50.223581+0000","last_clean":"2024-09-12T12:14:50.223581+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:14:50.223581+0000","last_undegraded":"2024-09-12T12:14:50.223581+0000","last_fullsized":"2024-09-12T12:14:50.223581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226653+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:14:50.226653+0000","last_peered":"2024-09-12T12:14:50.226653+0000","last_clean":"2024-09-12T12:14:50.226653+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:14:50.226653+0000","last_undegraded":"2024-09-12T12:14:50.226653+0000","last_fullsized":"2024-09-12T12:14:50.226653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226504+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:14:50.226504+0000","last_peered":"2024-09-12T12:14:50.226504+0000","last_clean":"2024-09-12T12:14:50.226504+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:14:50.226504+0000","last_undegraded":"2024-09-12T12:14:50.226504+0000","last_fullsized":"2024-09-12T12:14:50.226504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223567+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:14:50.223567+0000","last_peered":"2024-09-12T12:14:50.223567+0000","last_clean":"2024-09-12T12:14:50.223567+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:14:50.223567+0000","last_undegraded":"2024-09-12T12:14:50.223567+0000","last_fullsized":"2024-09-12T12:14:50.223567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226671+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:14:50.226671+0000","last_peered":"2024-09-12T12:14:50.226671+0000","last_clean":"2024-09-12T12:14:50.226671+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:14:50.226671+0000","last_undegraded":"2024-09-12T12:14:50.226671+0000","last_fullsized":"2024-09-12T12:14:50.226671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":43,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:57.241824+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:14:57.241824+0000","last_peered":"2024-09-12T12:14:57.241824+0000","last_clean":"2024-09-12T12:14:57.241824+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:14:57.241824+0000","last_undegraded":"2024-09-12T12:14:57.241824+0000","last_fullsized":"2024-09-12T12:14:57.241824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220157+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:14:50.220157+0000","last_peered":"2024-09-12T12:14:50.220157+0000","last_clean":"2024-09-12T12:14:50.220157+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:14:50.220157+0000","last_undegraded":"2024-09-12T12:14:50.220157+0000","last_fullsized":"2024-09-12T12:14:50.220157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231906+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:14:50.231906+0000","last_peered":"2024-09-12T12:14:50.231906+0000","last_clean":"2024-09-12T12:14:50.231906+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:14:50.231906+0000","last_undegraded":"2024-09-12T12:14:50.231906+0000","last_fullsized":"2024-09-12T12:14:50.231906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218706+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:14:50.218706+0000","last_peered":"2024-09-12T12:14:50.218706+0000","last_clean":"2024-09-12T12:14:50.218706+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:14:50.218706+0000","last_undegraded":"2024-09-12T12:14:50.218706+0000","last_fullsized":"2024-09-12T12:14:50.218706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280070+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:14:50.280070+0000","last_peered":"2024-09-12T12:14:50.280070+0000","last_clean":"2024-09-12T12:14:50.280070+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:14:50.280070+0000","last_undegraded":"2024-09-12T12:14:50.280070+0000","last_fullsized":"2024-09-12T12:14:50.280070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220009+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:14:50.220009+0000","last_peered":"2024-09-12T12:14:50.220009+0000","last_clean":"2024-09-12T12:14:50.220009+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:14:50.220009+0000","last_undegraded":"2024-09-12T12:14:50.220009+0000","last_fullsized":"2024-09-12T12:14:50.220009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221222+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:14:50.221222+0000","last_peered":"2024-09-12T12:14:50.221222+0000","last_clean":"2024-09-12T12:14:50.221222+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:14:50.221222+0000","last_undegraded":"2024-09-12T12:14:50.221222+0000","last_fullsized":"2024-09-12T12:14:50.221222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:56.239958+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:14:56.239958+0000","last_peered":"2024-09-12T12:14:56.239958+0000","last_clean":"2024-09-12T12:14:56.239958+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:14:56.239958+0000","last_undegraded":"2024-09-12T12:14:56.239958+0000","last_fullsized":"2024-09-12T12:14:56.239958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219468+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:14:50.219468+0000","last_peered":"2024-09-12T12:14:50.219468+0000","last_clean":"2024-09-12T12:14:50.219468+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:14:50.219468+0000","last_undegraded":"2024-09-12T12:14:50.219468+0000","last_fullsized":"2024-09-12T12:14:50.219468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225933+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:14:50.225933+0000","last_peered":"2024-09-12T12:14:50.225933+0000","last_clean":"2024-09-12T12:14:50.225933+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:14:50.225933+0000","last_undegraded":"2024-09-12T12:14:50.225933+0000","last_fullsized":"2024-09-12T12:14:50.225933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223934+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:14:50.223934+0000","last_peered":"2024-09-12T12:14:50.223934+0000","last_clean":"2024-09-12T12:14:50.223934+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:14:50.223934+0000","last_undegraded":"2024-09-12T12:14:50.223934+0000","last_fullsized":"2024-09-12T12:14:50.223934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220510+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:14:50.220510+0000","last_peered":"2024-09-12T12:14:50.220510+0000","last_clean":"2024-09-12T12:14:50.220510+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:14:50.220510+0000","last_undegraded":"2024-09-12T12:14:50.220510+0000","last_fullsized":"2024-09-12T12:14:50.220510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228850+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:14:50.228850+0000","last_peered":"2024-09-12T12:14:50.228850+0000","last_clean":"2024-09-12T12:14:50.228850+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:14:50.228850+0000","last_undegraded":"2024-09-12T12:14:50.228850+0000","last_fullsized":"2024-09-12T12:14:50.228850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'27","reported_seq":75,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:56.242842+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:14:56.242842+0000","last_peered":"2024-09-12T12:14:56.242842+0000","last_clean":"2024-09-12T12:14:56.242842+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:14:56.242842+0000","last_undegraded":"2024-09-12T12:14:56.242842+0000","last_fullsized":"2024-09-12T12:14:56.242842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227196+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:14:50.227196+0000","last_peered":"2024-09-12T12:14:50.227196+0000","last_clean":"2024-09-12T12:14:50.227196+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:14:50.227196+0000","last_undegraded":"2024-09-12T12:14:50.227196+0000","last_fullsized":"2024-09-12T12:14:50.227196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226197+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:14:50.226197+0000","last_peered":"2024-09-12T12:14:50.226197+0000","last_clean":"2024-09-12T12:14:50.226197+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:14:50.226197+0000","last_undegraded":"2024-09-12T12:14:50.226197+0000","last_fullsized":"2024-09-12T12:14:50.226197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218755+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:14:50.218755+0000","last_peered":"2024-09-12T12:14:50.218755+0000","last_clean":"2024-09-12T12:14:50.218755+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:14:50.218755+0000","last_undegraded":"2024-09-12T12:14:50.218755+0000","last_fullsized":"2024-09-12T12:14:50.218755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220324+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:14:50.220324+0000","last_peered":"2024-09-12T12:14:50.220324+0000","last_clean":"2024-09-12T12:14:50.220324+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:14:50.220324+0000","last_undegraded":"2024-09-12T12:14:50.220324+0000","last_fullsized":"2024-09-12T12:14:50.220324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225952+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:14:50.225952+0000","last_peered":"2024-09-12T12:14:50.225952+0000","last_clean":"2024-09-12T12:14:50.225952+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:14:50.225952+0000","last_undegraded":"2024-09-12T12:14:50.225952+0000","last_fullsized":"2024-09-12T12:14:50.225952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:58.242608+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:14:58.242608+0000","last_peered":"2024-09-12T12:14:58.242608+0000","last_clean":"2024-09-12T12:14:58.242608+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:14:58.242608+0000","last_undegraded":"2024-09-12T12:14:58.242608+0000","last_fullsized":"2024-09-12T12:14:58.242608+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225510+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:14:50.225510+0000","last_peered":"2024-09-12T12:14:50.225510+0000","last_clean":"2024-09-12T12:14:50.225510+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:14:50.225510+0000","last_undegraded":"2024-09-12T12:14:50.225510+0000","last_fullsized":"2024-09-12T12:14:50.225510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226487+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:14:50.226487+0000","last_peered":"2024-09-12T12:14:50.226487+0000","last_clean":"2024-09-12T12:14:50.226487+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:14:50.226487+0000","last_undegraded":"2024-09-12T12:14:50.226487+0000","last_fullsized":"2024-09-12T12:14:50.226487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220083+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:14:50.220083+0000","last_peered":"2024-09-12T12:14:50.220083+0000","last_clean":"2024-09-12T12:14:50.220083+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:14:50.220083+0000","last_undegraded":"2024-09-12T12:14:50.220083+0000","last_fullsized":"2024-09-12T12:14:50.220083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227405+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:14:50.227405+0000","last_peered":"2024-09-12T12:14:50.227405+0000","last_clean":"2024-09-12T12:14:50.227405+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:14:50.227405+0000","last_undegraded":"2024-09-12T12:14:50.227405+0000","last_fullsized":"2024-09-12T12:14:50.227405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223688+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:14:50.223688+0000","last_peered":"2024-09-12T12:14:50.223688+0000","last_clean":"2024-09-12T12:14:50.223688+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:14:50.223688+0000","last_undegraded":"2024-09-12T12:14:50.223688+0000","last_fullsized":"2024-09-12T12:14:50.223688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219270+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:14:50.219270+0000","last_peered":"2024-09-12T12:14:50.219270+0000","last_clean":"2024-09-12T12:14:50.219270+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:14:50.219270+0000","last_undegraded":"2024-09-12T12:14:50.219270+0000","last_fullsized":"2024-09-12T12:14:50.219270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225832+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:14:50.225832+0000","last_peered":"2024-09-12T12:14:50.225832+0000","last_clean":"2024-09-12T12:14:50.225832+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:14:50.225832+0000","last_undegraded":"2024-09-12T12:14:50.225832+0000","last_fullsized":"2024-09-12T12:14:50.225832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220411+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:14:50.220411+0000","last_peered":"2024-09-12T12:14:50.220411+0000","last_clean":"2024-09-12T12:14:50.220411+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:14:50.220411+0000","last_undegraded":"2024-09-12T12:14:50.220411+0000","last_fullsized":"2024-09-12T12:14:50.220411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225950+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:14:50.225950+0000","last_peered":"2024-09-12T12:14:50.225950+0000","last_clean":"2024-09-12T12:14:50.225950+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:14:50.225950+0000","last_undegraded":"2024-09-12T12:14:50.225950+0000","last_fullsized":"2024-09-12T12:14:50.225950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'5","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:58.243046+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:14:58.243046+0000","last_peered":"2024-09-12T12:14:58.243046+0000","last_clean":"2024-09-12T12:14:58.243046+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:14:58.243046+0000","last_undegraded":"2024-09-12T12:14:58.243046+0000","last_fullsized":"2024-09-12T12:14:58.243046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226039+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:14:50.226039+0000","last_peered":"2024-09-12T12:14:50.226039+0000","last_clean":"2024-09-12T12:14:50.226039+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:14:50.226039+0000","last_undegraded":"2024-09-12T12:14:50.226039+0000","last_fullsized":"2024-09-12T12:14:50.226039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225717+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:14:50.225717+0000","last_peered":"2024-09-12T12:14:50.225717+0000","last_clean":"2024-09-12T12:14:50.225717+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:14:50.225717+0000","last_undegraded":"2024-09-12T12:14:50.225717+0000","last_fullsized":"2024-09-12T12:14:50.225717+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.230997+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:14:50.230997+0000","last_peered":"2024-09-12T12:14:50.230997+0000","last_clean":"2024-09-12T12:14:50.230997+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:14:50.230997+0000","last_undegraded":"2024-09-12T12:14:50.230997+0000","last_fullsized":"2024-09-12T12:14:50.230997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.222469+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:14:50.222469+0000","last_peered":"2024-09-12T12:14:50.222469+0000","last_clean":"2024-09-12T12:14:50.222469+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:14:50.222469+0000","last_undegraded":"2024-09-12T12:14:50.222469+0000","last_fullsized":"2024-09-12T12:14:50.222469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225688+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:14:50.225688+0000","last_peered":"2024-09-12T12:14:50.225688+0000","last_clean":"2024-09-12T12:14:50.225688+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:14:50.225688+0000","last_undegraded":"2024-09-12T12:14:50.225688+0000","last_fullsized":"2024-09-12T12:14:50.225688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218701+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:14:50.218701+0000","last_peered":"2024-09-12T12:14:50.218701+0000","last_clean":"2024-09-12T12:14:50.218701+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:14:50.218701+0000","last_undegraded":"2024-09-12T12:14:50.218701+0000","last_fullsized":"2024-09-12T12:14:50.218701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":41,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:58.242097+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:14:58.242097+0000","last_peered":"2024-09-12T12:14:58.242097+0000","last_clean":"2024-09-12T12:14:58.242097+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:14:58.242097+0000","last_undegraded":"2024-09-12T12:14:58.242097+0000","last_fullsized":"2024-09-12T12:14:58.242097+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219869+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:14:50.219869+0000","last_peered":"2024-09-12T12:14:50.219869+0000","last_clean":"2024-09-12T12:14:50.219869+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:14:50.219869+0000","last_undegraded":"2024-09-12T12:14:50.219869+0000","last_fullsized":"2024-09-12T12:14:50.219869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:55.234224+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:14:55.234224+0000","last_peered":"2024-09-12T12:14:55.234224+0000","last_clean":"2024-09-12T12:14:55.234224+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:14:55.234224+0000","last_undegraded":"2024-09-12T12:14:55.234224+0000","last_fullsized":"2024-09-12T12:14:55.234224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231612+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:14:50.231612+0000","last_peered":"2024-09-12T12:14:50.231612+0000","last_clean":"2024-09-12T12:14:50.231612+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:14:50.231612+0000","last_undegraded":"2024-09-12T12:14:50.231612+0000","last_fullsized":"2024-09-12T12:14:50.231612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225099+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:14:50.225099+0000","last_peered":"2024-09-12T12:14:50.225099+0000","last_clean":"2024-09-12T12:14:50.225099+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:14:50.225099+0000","last_undegraded":"2024-09-12T12:14:50.225099+0000","last_fullsized":"2024-09-12T12:14:50.225099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231738+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:14:50.231738+0000","last_peered":"2024-09-12T12:14:50.231738+0000","last_clean":"2024-09-12T12:14:50.231738+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:14:50.231738+0000","last_undegraded":"2024-09-12T12:14:50.231738+0000","last_fullsized":"2024-09-12T12:14:50.231738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227316+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:14:50.227316+0000","last_peered":"2024-09-12T12:14:50.227316+0000","last_clean":"2024-09-12T12:14:50.227316+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:14:50.227316+0000","last_undegraded":"2024-09-12T12:14:50.227316+0000","last_fullsized":"2024-09-12T12:14:50.227316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219126+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:14:50.219126+0000","last_peered":"2024-09-12T12:14:50.219126+0000","last_clean":"2024-09-12T12:14:50.219126+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:14:50.219126+0000","last_undegraded":"2024-09-12T12:14:50.219126+0000","last_fullsized":"2024-09-12T12:14:50.219126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'11","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:54.388976+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:14:54.388976+0000","last_peered":"2024-09-12T12:14:54.388976+0000","last_clean":"2024-09-12T12:14:54.388976+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:14:54.388976+0000","last_undegraded":"2024-09-12T12:14:54.388976+0000","last_fullsized":"2024-09-12T12:14:54.388976+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280423+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:14:50.280423+0000","last_peered":"2024-09-12T12:14:50.280423+0000","last_clean":"2024-09-12T12:14:50.280423+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:14:50.280423+0000","last_undegraded":"2024-09-12T12:14:50.280423+0000","last_fullsized":"2024-09-12T12:14:50.280423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231076+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:14:50.231076+0000","last_peered":"2024-09-12T12:14:50.231076+0000","last_clean":"2024-09-12T12:14:50.231076+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:14:50.231076+0000","last_undegraded":"2024-09-12T12:14:50.231076+0000","last_fullsized":"2024-09-12T12:14:50.231076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223746+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:14:50.223746+0000","last_peered":"2024-09-12T12:14:50.223746+0000","last_clean":"2024-09-12T12:14:50.223746+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:14:50.223746+0000","last_undegraded":"2024-09-12T12:14:50.223746+0000","last_fullsized":"2024-09-12T12:14:50.223746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219067+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:14:50.219067+0000","last_peered":"2024-09-12T12:14:50.219067+0000","last_clean":"2024-09-12T12:14:50.219067+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:14:50.219067+0000","last_undegraded":"2024-09-12T12:14:50.219067+0000","last_fullsized":"2024-09-12T12:14:50.219067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226116+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:14:50.226116+0000","last_peered":"2024-09-12T12:14:50.226116+0000","last_clean":"2024-09-12T12:14:50.226116+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:14:50.226116+0000","last_undegraded":"2024-09-12T12:14:50.226116+0000","last_fullsized":"2024-09-12T12:14:50.226116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280169+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:14:50.280169+0000","last_peered":"2024-09-12T12:14:50.280169+0000","last_clean":"2024-09-12T12:14:50.280169+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:14:50.280169+0000","last_undegraded":"2024-09-12T12:14:50.280169+0000","last_fullsized":"2024-09-12T12:14:50.280169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223582+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:14:50.223582+0000","last_peered":"2024-09-12T12:14:50.223582+0000","last_clean":"2024-09-12T12:14:50.223582+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:14:50.223582+0000","last_undegraded":"2024-09-12T12:14:50.223582+0000","last_fullsized":"2024-09-12T12:14:50.223582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226774+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:14:50.226774+0000","last_peered":"2024-09-12T12:14:50.226774+0000","last_clean":"2024-09-12T12:14:50.226774+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:14:50.226774+0000","last_undegraded":"2024-09-12T12:14:50.226774+0000","last_fullsized":"2024-09-12T12:14:50.226774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280155+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:14:50.280155+0000","last_peered":"2024-09-12T12:14:50.280155+0000","last_clean":"2024-09-12T12:14:50.280155+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:14:50.280155+0000","last_undegraded":"2024-09-12T12:14:50.280155+0000","last_fullsized":"2024-09-12T12:14:50.280155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226514+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:14:50.226514+0000","last_peered":"2024-09-12T12:14:50.226514+0000","last_clean":"2024-09-12T12:14:50.226514+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:14:50.226514+0000","last_undegraded":"2024-09-12T12:14:50.226514+0000","last_fullsized":"2024-09-12T12:14:50.226514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225702+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:14:50.225702+0000","last_peered":"2024-09-12T12:14:50.225702+0000","last_clean":"2024-09-12T12:14:50.225702+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:14:50.225702+0000","last_undegraded":"2024-09-12T12:14:50.225702+0000","last_fullsized":"2024-09-12T12:14:50.225702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232265+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:14:50.232265+0000","last_peered":"2024-09-12T12:14:50.232265+0000","last_clean":"2024-09-12T12:14:50.232265+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:14:50.232265+0000","last_undegraded":"2024-09-12T12:14:50.232265+0000","last_fullsized":"2024-09-12T12:14:50.232265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226949+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:14:50.226949+0000","last_peered":"2024-09-12T12:14:50.226949+0000","last_clean":"2024-09-12T12:14:50.226949+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:14:50.226949+0000","last_undegraded":"2024-09-12T12:14:50.226949+0000","last_fullsized":"2024-09-12T12:14:50.226949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219147+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:14:50.219147+0000","last_peered":"2024-09-12T12:14:50.219147+0000","last_clean":"2024-09-12T12:14:50.219147+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:14:50.219147+0000","last_undegraded":"2024-09-12T12:14:50.219147+0000","last_fullsized":"2024-09-12T12:14:50.219147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'12","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.241528+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:14:50.241528+0000","last_peered":"2024-09-12T12:14:50.241528+0000","last_clean":"2024-09-12T12:14:50.241528+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:14:50.241528+0000","last_undegraded":"2024-09-12T12:14:50.241528+0000","last_fullsized":"2024-09-12T12:14:50.241528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223893+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:14:50.223893+0000","last_peered":"2024-09-12T12:14:50.223893+0000","last_clean":"2024-09-12T12:14:50.223893+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:14:50.223893+0000","last_undegraded":"2024-09-12T12:14:50.223893+0000","last_fullsized":"2024-09-12T12:14:50.223893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280619+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:14:50.280619+0000","last_peered":"2024-09-12T12:14:50.280619+0000","last_clean":"2024-09-12T12:14:50.280619+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:14:50.280619+0000","last_undegraded":"2024-09-12T12:14:50.280619+0000","last_fullsized":"2024-09-12T12:14:50.280619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280520+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:14:50.280520+0000","last_peered":"2024-09-12T12:14:50.280520+0000","last_clean":"2024-09-12T12:14:50.280520+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:14:50.280520+0000","last_undegraded":"2024-09-12T12:14:50.280520+0000","last_fullsized":"2024-09-12T12:14:50.280520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'13","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:56.234837+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:14:56.234837+0000","last_peered":"2024-09-12T12:14:56.234837+0000","last_clean":"2024-09-12T12:14:56.234837+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:14:56.234837+0000","last_undegraded":"2024-09-12T12:14:56.234837+0000","last_fullsized":"2024-09-12T12:14:56.234837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57320,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":148,"num_read_kb":135,"num_write":233,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":171960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678033,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":423209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1548288,"data_stored":1055303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":423139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":423517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528356,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32636,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712516,"statfs":{"total":95995035648,"available":95961616384,"internally_reserved":0,"allocated":1486848,"data_stored":1016430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":423249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888111,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1015715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":422681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":950272,"data_stored":474494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607619,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":474274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":897024,"data_stored":424195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":51848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:02.793 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:15:02.794 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T12:15:02.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T12:15:03.041 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.453+0000 7fc2803e9640 1 -- 172.21.15.81:0/1932037804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 msgr2=0x7fc278100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:03.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.453+0000 7fc2803e9640 1 --2- 172.21.15.81:0/1932037804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc278100f10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc268009ca0 tx=0x7fc26802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.453+0000 7fc2803e9640 1 -- 172.21.15.81:0/1932037804 shutdown_connections 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.453+0000 7fc2803e9640 1 --2- 172.21.15.81:0/1932037804 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2781026d0 0x7fc278108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 --2- 172.21.15.81:0/1932037804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc278101d10 0x7fc278102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 --2- 172.21.15.81:0/1932037804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc278100f10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- 172.21.15.81:0/1932037804 >> 172.21.15.81:0/1932037804 conn(0x7fc2780fc2a0 msgr2=0x7fc2780fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- 172.21.15.81:0/1932037804 shutdown_connections 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- 172.21.15.81:0/1932037804 wait complete. 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 Processor -- start 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- start start 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc27806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc278101d10 0x7fc27819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:03.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2781026d0 0x7fc27819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810c9b0 con 0x7fc278100b10 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810c830 con 0x7fc2781026d0 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc2803e9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc27810cb30 con 0x7fc278101d10 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.454+0000 7fc27e185640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc27806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc27806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54464/0 (socket says 172.21.15.81:54464) 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 -- 172.21.15.81:0/108071314 learned_addr learned my addr 172.21.15.81:0/108071314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e986640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2781026d0 0x7fc27819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27d984640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc278101d10 0x7fc27819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 -- 172.21.15.81:0/108071314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc278101d10 msgr2=0x7fc27819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc278101d10 0x7fc27819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 -- 172.21.15.81:0/108071314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2781026d0 msgr2=0x7fc27819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:03.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2781026d0 0x7fc27819f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 -- 172.21.15.81:0/108071314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27819fe00 con 0x7fc278100b10 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc27e185640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc27806b2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc268000f80 tx=0x7fc26802f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26802fdf0 con 0x7fc278100b10 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc268030ac0 con 0x7fc278100b10 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2781a0030 con 0x7fc278100b10 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc268046c30 con 0x7fc278100b10 2024-09-12T12:15:03.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.455+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2781a0640 con 0x7fc278100b10 2024-09-12T12:15:03.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.456+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc278107f60 con 0x7fc278100b10 2024-09-12T12:15:03.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.457+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc268030c70 con 0x7fc278100b10 2024-09-12T12:15:03.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.458+0000 7fc2777fe640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc2600a2c90 0x7fc2600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:03.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.458+0000 7fc27d984640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc2600a2c90 0x7fc2600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:03.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.458+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc2680f0830 con 0x7fc278100b10 2024-09-12T12:15:03.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.458+0000 7fc27d984640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc2600a2c90 0x7fc2600a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc27806b870 tx=0x7fc26c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:03.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.462+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2680bd7c0 con 0x7fc278100b10 2024-09-12T12:15:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:03 smithi103 ceph-mon[35094]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:03 smithi103 ceph-mon[35094]: pgmap v286: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:15:03.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.689+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc27802d9c0 con 0x7fc278100b10 2024-09-12T12:15:03.689 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:03 smithi081 ceph-mon[30948]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:03.690 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:03 smithi081 ceph-mon[30948]: pgmap v286: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:15:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.691+0000 7fc2777fe640 1 -- 172.21.15.81:0/108071314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc2680bd0c0 con 0x7fc278100b10 2024-09-12T12:15:03.692 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-12T12:15:03.692 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBH2+Jmoe0wKRAAzhmwR6d4jZdyxlTX5ndRDQ== 2024-09-12T12:15:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc2600a2c90 msgr2=0x7fc2600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc2600a2c90 0x7fc2600a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc27806b870 tx=0x7fc26c008040 comp rx=0 tx=0).stop 2024-09-12T12:15:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 msgr2=0x7fc27806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:03.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc27806b2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc268000f80 tx=0x7fc26802f840 comp rx=0 tx=0).stop 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 shutdown_connections 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc2600a2c90 0x7fc2600a5150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2781026d0 0x7fc27819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc278101d10 0x7fc27819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 --2- 172.21.15.81:0/108071314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc278100b10 0x7fc27806b2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 >> 172.21.15.81:0/108071314 conn(0x7fc2780fc2a0 msgr2=0x7fc278105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 shutdown_connections 2024-09-12T12:15:03.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:03.695+0000 7fc2803e9640 1 -- 172.21.15.81:0/108071314 wait complete. 2024-09-12T12:15:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:03 smithi173 ceph-mon[35326]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:03 smithi173 ceph-mon[35326]: pgmap v286: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-12T12:15:04.508 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:15:04.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T12:15:04.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T12:15:04.547 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T12:15:04.547 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T12:15:04.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T12:15:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:04 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/108071314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:15:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:04 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/108071314' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:15:04.833 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:04.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:04 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/108071314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:15:04.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:04 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/108071314' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:15:04.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:04 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/108071314' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T12:15:04.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:04 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/108071314' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T12:15:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 -- 172.21.15.81:0/2380958979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67201082a0 msgr2=0x7f672010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 --2- 172.21.15.81:0/2380958979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67201082a0 0x7f672010ec40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6718009cd0 tx=0x7f671802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 -- 172.21.15.81:0/2380958979 shutdown_connections 2024-09-12T12:15:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 --2- 172.21.15.81:0/2380958979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67201082a0 0x7f672010ec40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 --2- 172.21.15.81:0/2380958979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67201036e0 0x7f6720107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 --2- 172.21.15.81:0/2380958979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6720102d30 0x7f6720103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 -- 172.21.15.81:0/2380958979 >> 172.21.15.81:0/2380958979 conn(0x7f67200fc7d0 msgr2=0x7f67200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 -- 172.21.15.81:0/2380958979 shutdown_connections 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 -- 172.21.15.81:0/2380958979 wait complete. 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.358+0000 7f6727b62640 1 Processor -- start 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 -- start start 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 0x7f6720198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67201036e0 0x7f6720198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67201082a0 0x7f672019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67201121c0 con 0x7f6720102d30 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6720112040 con 0x7f67201082a0 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6720112340 con 0x7f67201036e0 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 0x7f6720198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:05.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 0x7f6720198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54474/0 (socket says 172.21.15.81:54474) 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 -- 172.21.15.81:0/1942182351 learned_addr learned my addr 172.21.15.81:0/1942182351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67250fd640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67201036e0 0x7f6720198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 -- 172.21.15.81:0/1942182351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67201036e0 msgr2=0x7f6720198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67201036e0 0x7f6720198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 -- 172.21.15.81:0/1942182351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67201082a0 msgr2=0x7f672019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67201082a0 0x7f672019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 -- 172.21.15.81:0/1942182351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672019d5b0 con 0x7f6720102d30 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f67258fe640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 0x7f6720198600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f671c00d950 tx=0x7f671c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c017070 con 0x7f6720102d30 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f671c009c30 con 0x7f6720102d30 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672019d8a0 con 0x7f6720102d30 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.359+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c00f740 con 0x7f6720102d30 2024-09-12T12:15:05.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.360+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67201a5180 con 0x7f6720102d30 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.361+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6720103110 con 0x7f6720102d30 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.362+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f671c010a80 con 0x7f6720102d30 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.362+0000 7f6716ffd640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f670c0a2c90 0x7f670c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.363+0000 7f67250fd640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f670c0a2c90 0x7f670c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.363+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f671c0ced60 con 0x7f6720102d30 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.363+0000 7f67250fd640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f670c0a2c90 0x7f670c0a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6710005d90 tx=0x7f6710005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:05.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.367+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f671c009de0 con 0x7f6720102d30 2024-09-12T12:15:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.580+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f67201a53e0 con 0x7f6720102d30 2024-09-12T12:15:05.581 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:05 smithi081 ceph-mon[30948]: pgmap v287: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-12T12:15:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.585+0000 7f6716ffd640 1 -- 172.21.15.81:0/1942182351 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263198 (secure 0 0 0) 0x7f671c09bc60 con 0x7f6720102d30 2024-09-12T12:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f670c0a2c90 msgr2=0x7f670c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f670c0a2c90 0x7f670c0a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6710005d90 tx=0x7f6710005d20 comp rx=0 tx=0).stop 2024-09-12T12:15:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 msgr2=0x7f6720198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 0x7f6720198600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f671c00d950 tx=0x7f671c00de10 comp rx=0 tx=0).stop 2024-09-12T12:15:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 shutdown_connections 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f670c0a2c90 0x7f670c0a5150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67201082a0 0x7f672019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67201036e0 0x7f6720198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 --2- 172.21.15.81:0/1942182351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6720102d30 0x7f6720198600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 >> 172.21.15.81:0/1942182351 conn(0x7f67200fc7d0 msgr2=0x7f6720105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 shutdown_connections 2024-09-12T12:15:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:05.588+0000 7f6727b62640 1 -- 172.21.15.81:0/1942182351 wait complete. 2024-09-12T12:15:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:05 smithi103 ceph-mon[35094]: pgmap v287: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-12T12:15:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:05 smithi173 ceph-mon[35326]: pgmap v287: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-12T12:15:06.295 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":4236049851},{"type":"v1","addr":"172.21.15.81:6801","nonce":4236049851}]},"active_addr":"172.21.15.81:6801/4236049851","active_change":"2024-09-12T12:07:48.253680+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":22849456}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":4279243684}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2649443491}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1340615058}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":997024104}]}]} 2024-09-12T12:15:06.301 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T12:15:06.301 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T12:15:06.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:15:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:06.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:06 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1942182351' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:15:06.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:06 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1942182351' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:15:06.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:06 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1942182351' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T12:15:07.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 -- 172.21.15.81:0/2911066545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500102570 msgr2=0x7f65001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 --2- 172.21.15.81:0/2911066545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500102570 0x7f65001029b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009900 tx=0x7f64e802a480 comp rx=0 tx=0).stop 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 -- 172.21.15.81:0/2911066545 shutdown_connections 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 --2- 172.21.15.81:0/2911066545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102ef0 0x7f650010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 --2- 172.21.15.81:0/2911066545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500102570 0x7f65001029b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 --2- 172.21.15.81:0/2911066545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500100e20 0x7f6500101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 -- 172.21.15.81:0/2911066545 >> 172.21.15.81:0/2911066545 conn(0x7f65000fc7d0 msgr2=0x7f65000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 -- 172.21.15.81:0/2911066545 shutdown_connections 2024-09-12T12:15:07.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 -- 172.21.15.81:0/2911066545 wait complete. 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 Processor -- start 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.000+0000 7f6505af1640 1 -- start start 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 0x7f65001973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102570 0x7f6500197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500102ef0 0x7f650019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65001110a0 con 0x7f6500100e20 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6500110f20 con 0x7f6500102570 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6500111220 con 0x7f6500102ef0 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 0x7f65001973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 0x7f65001973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54498/0 (socket says 172.21.15.81:54498) 2024-09-12T12:15:07.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 -- 172.21.15.81:0/2908226841 learned_addr learned my addr 172.21.15.81:0/2908226841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64feffd640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102570 0x7f6500197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64fffff640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500102ef0 0x7f650019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 -- 172.21.15.81:0/2908226841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500102ef0 msgr2=0x7f650019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500102ef0 0x7f650019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 -- 172.21.15.81:0/2908226841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102570 msgr2=0x7f6500197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102570 0x7f6500197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 -- 172.21.15.81:0/2908226841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650019c370 con 0x7f6500100e20 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64feffd640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102570 0x7f6500197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64fffff640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500102ef0 0x7f650019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64ff7fe640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 0x7f65001973c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64f000cce0 tx=0x7f64f000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:07.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f000f650 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650019c660 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f64f000fcf0 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0018d20 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.001+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65001a3f40 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.002+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6500101200 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.004+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f64f000f7f0 con 0x7f6500100e20 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.004+0000 7f64fcff9640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f64ec0a2c10 0x7f64ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.005+0000 7f64feffd640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f64ec0a2c10 0x7f64ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:07.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.005+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f64f00cf9f0 con 0x7f6500100e20 2024-09-12T12:15:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.005+0000 7f64feffd640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f64ec0a2c10 0x7f64ec0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65000feca0 tx=0x7f64e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:07.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.007+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64f0014030 con 0x7f6500100e20 2024-09-12T12:15:07.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.174+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65001a4170 con 0x7f6500100e20 2024-09-12T12:15:07.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.176+0000 7f64fcff9640 1 -- 172.21.15.81:0/2908226841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22643 (secure 0 0 0) 0x7f64f009c980 con 0x7f6500100e20 2024-09-12T12:15:07.176 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:07.177 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:50.215414+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f64ec0a2c10 msgr2=0x7f64ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f64ec0a2c10 0x7f64ec0a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65000feca0 tx=0x7f64e8005a20 comp rx=0 tx=0).stop 2024-09-12T12:15:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 msgr2=0x7f65001973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 0x7f65001973c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64f000cce0 tx=0x7f64f000a620 comp rx=0 tx=0).stop 2024-09-12T12:15:07.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 shutdown_connections 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f64ec0a2c10 0x7f64ec0a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6500102ef0 0x7f650019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6500102570 0x7f6500197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 --2- 172.21.15.81:0/2908226841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6500100e20 0x7f65001973c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 >> 172.21.15.81:0/2908226841 conn(0x7f65000fc7d0 msgr2=0x7f6500105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 shutdown_connections 2024-09-12T12:15:07.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:07.178+0000 7f6505af1640 1 -- 172.21.15.81:0/2908226841 wait complete. 2024-09-12T12:15:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:07 smithi081 ceph-mon[30948]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T12:15:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:07 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2908226841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:07 smithi103 ceph-mon[35094]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T12:15:07.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:07 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2908226841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:07.887 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T12:15:07.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:15:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:07 smithi173 ceph-mon[35326]: pgmap v288: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-12T12:15:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:07 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2908226841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 -- 172.21.15.81:0/3928606257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 msgr2=0x7f37b81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 --2- 172.21.15.81:0/3928606257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b81067f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37ac009900 tx=0x7f37ac02a410 comp rx=0 tx=0).stop 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 -- 172.21.15.81:0/3928606257 shutdown_connections 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 --2- 172.21.15.81:0/3928606257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8106f20 0x7f37b810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 --2- 172.21.15.81:0/3928606257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b81067f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 --2- 172.21.15.81:0/3928606257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37b8101df0 0x7f37b81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 -- 172.21.15.81:0/3928606257 >> 172.21.15.81:0/3928606257 conn(0x7f37b80fd8b0 msgr2=0x7f37b80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 -- 172.21.15.81:0/3928606257 shutdown_connections 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.594+0000 7f37c065c640 1 -- 172.21.15.81:0/3928606257 wait complete. 2024-09-12T12:15:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 Processor -- start 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 -- start start 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8101df0 0x7f37b81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37b8106f20 0x7f37b819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37b81120e0 con 0x7f37b81027a0 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8111f60 con 0x7f37b8101df0 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37c065c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8112260 con 0x7f37b8106f20 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37bdbf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37bdbf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b8198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54526/0 (socket says 172.21.15.81:54526) 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.595+0000 7f37bdbf7640 1 -- 172.21.15.81:0/566567781 learned_addr learned my addr 172.21.15.81:0/566567781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37be3f8640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8101df0 0x7f37b81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37bdbf7640 1 -- 172.21.15.81:0/566567781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37b8106f20 msgr2=0x7f37b819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37bdbf7640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37b8106f20 0x7f37b819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37bdbf7640 1 -- 172.21.15.81:0/566567781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8101df0 msgr2=0x7f37b81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37bdbf7640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8101df0 0x7f37b81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37bdbf7640 1 -- 172.21.15.81:0/566567781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b819d550 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37be3f8640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8101df0 0x7f37b81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37bdbf7640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b8198ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37ac006010 tx=0x7f37ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac03f030 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37ac003d00 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b819d7e0 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac035070 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.596+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b81a5120 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.597+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b81021d0 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.598+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f37ac042030 con 0x7f37b81027a0 2024-09-12T12:15:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.599+0000 7f37b77fe640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f37a00a2c90 0x7f37a00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.599+0000 7f37be3f8640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f37a00a2c90 0x7f37a00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.599+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f37ac0efaa0 con 0x7f37b81027a0 2024-09-12T12:15:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.599+0000 7f37be3f8640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f37a00a2c90 0x7f37a00a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f37a8005c40 tx=0x7f37a80082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.603+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37ac0bc9a0 con 0x7f37b81027a0 2024-09-12T12:15:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.769+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37b802d7c0 con 0x7f37b81027a0 2024-09-12T12:15:08.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.771+0000 7f37b77fe640 1 -- 172.21.15.81:0/566567781 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22643 (secure 0 0 0) 0x7f37ac0bc2a0 con 0x7f37b81027a0 2024-09-12T12:15:08.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:08.773 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:50.215414+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f37a00a2c90 msgr2=0x7f37a00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f37a00a2c90 0x7f37a00a5150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f37a8005c40 tx=0x7f37a80082f0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 msgr2=0x7f37b8198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b8198ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f37ac006010 tx=0x7f37ac0042f0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 shutdown_connections 2024-09-12T12:15:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f37a00a2c90 0x7f37a00a5150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37b8106f20 0x7f37b819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b81027a0 0x7f37b8198ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 --2- 172.21.15.81:0/566567781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37b8101df0 0x7f37b81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:08.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 >> 172.21.15.81:0/566567781 conn(0x7f37b80fd8b0 msgr2=0x7f37b80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 shutdown_connections 2024-09-12T12:15:08.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:08.773+0000 7f37c065c640 1 -- 172.21.15.81:0/566567781 wait complete. 2024-09-12T12:15:09.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T12:15:09.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T12:15:09.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T12:15:09.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T12:15:09.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T12:15:09.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T12:15:09.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T12:15:09.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T12:15:09.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T12:15:09.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T12:15:09.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T12:15:09.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T12:15:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:09 smithi103 ceph-mon[35094]: pgmap v289: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-12T12:15:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:09 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/566567781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:09 smithi081 ceph-mon[30948]: pgmap v289: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-12T12:15:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:09 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/566567781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:09 smithi173 ceph-mon[35326]: pgmap v289: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-09-12T12:15:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:09 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/566567781' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.403 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.412 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.418 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 -- 172.21.15.81:0/3417439386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 msgr2=0x7fd29c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:10.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/3417439386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c10e610 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd294009ca0 tx=0x7fd29402a950 comp rx=0 tx=0).stop 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 -- 172.21.15.81:0/3417439386 shutdown_connections 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/3417439386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c10e610 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/3417439386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd29c103660 0x7fd29c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/3417439386 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c102d40 0x7fd29c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 -- 172.21.15.81:0/3417439386 >> 172.21.15.81:0/3417439386 conn(0x7fd29c0fc7a0 msgr2=0x7fd29c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 -- 172.21.15.81:0/3417439386 shutdown_connections 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.611+0000 7fd2a44ff640 1 -- 172.21.15.81:0/3417439386 wait complete. 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 Processor -- start 2024-09-12T12:15:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 -- start start 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd29c102d40 0x7fd29c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c103660 0x7fd29c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c1120f0 con 0x7fd29c10c170 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c111f70 con 0x7fd29c102d40 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a44ff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c112270 con 0x7fd29c103660 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54556/0 (socket says 172.21.15.81:54556) 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 -- 172.21.15.81:0/2161327818 learned_addr learned my addr 172.21.15.81:0/2161327818 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a229b640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd29c102d40 0x7fd29c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a1a9a640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c103660 0x7fd29c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 -- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c103660 msgr2=0x7fd29c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c103660 0x7fd29c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 -- 172.21.15.81:0/2161327818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd29c102d40 msgr2=0x7fd29c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd29c102d40 0x7fd29c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a2a9c640 1 -- 172.21.15.81:0/2161327818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c19d4c0 con 0x7fd29c10c170 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a229b640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd29c102d40 0x7fd29c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.612+0000 7fd2a1a9a640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c103660 0x7fd29c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.613+0000 7fd2a2a9c640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c19cde0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd294005cc0 tx=0x7fd294030e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.613+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294034040 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.613+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c19d750 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.613+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd294003e00 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.613+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2940456e0 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.613+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c1a5090 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.614+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd29c0fed90 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.615+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd294037020 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.615+0000 7fd28f7fe640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd2880a2c10 0x7fd2880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd2a229b640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd2880a2c10 0x7fd2880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fd2940f02e0 con 0x7fd29c10c170 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd28f7fe640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] conn(0x7fd2880ac6c0 0x7fd2880aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 --> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd29402c030 con 0x7fd2880ac6c0 2024-09-12T12:15:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fd2940f07c0 con 0x7fd29c10c170 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd2a229b640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd2880a2c10 0x7fd2880a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2900099b0 tx=0x7fd290008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.616+0000 7fd2a1a9a640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] conn(0x7fd2880ac6c0 0x7fd2880aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.617+0000 7fd2a1a9a640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] conn(0x7fd2880ac6c0 0x7fd2880aeb60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.617+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== osd.5 v2:172.21.15.173:6808/1780701631 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd29402c030 con 0x7fd2880ac6c0 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.631+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 --> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd29c06b070 con 0x7fd2880ac6c0 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.631+0000 7fd28f7fe640 1 -- 172.21.15.81:0/2161327818 <== osd.5 v2:172.21.15.173:6808/1780701631 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd29c06b070 con 0x7fd2880ac6c0 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] conn(0x7fd2880ac6c0 msgr2=0x7fd2880aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] conn(0x7fd2880ac6c0 0x7fd2880aeb60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd2880a2c10 msgr2=0x7fd2880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd2880a2c10 0x7fd2880a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2900099b0 tx=0x7fd290008040 comp rx=0 tx=0).stop 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 msgr2=0x7fd29c19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 --2- 172.21.15.81:0/2161327818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd29c10c170 0x7fd29c19cde0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd294005cc0 tx=0x7fd294030e10 comp rx=0 tx=0).stop 2024-09-12T12:15:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a2a9c640 1 -- 172.21.15.81:0/2161327818 reap_dead start 2024-09-12T12:15:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 shutdown_connections 2024-09-12T12:15:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 >> 172.21.15.81:0/2161327818 conn(0x7fd29c0fc7a0 msgr2=0x7fd29c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 shutdown_connections 2024-09-12T12:15:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:10.632+0000 7fd2a44ff640 1 -- 172.21.15.81:0/2161327818 wait complete. 2024-09-12T12:15:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:10.856 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:11.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:11 smithi081 ceph-mon[30948]: pgmap v290: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-12T12:15:11.870 INFO:teuthology.orchestra.run.smithi081.stdout:146028888114 2024-09-12T12:15:11.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T12:15:11.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:11 smithi173 ceph-mon[35326]: pgmap v290: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-12T12:15:11.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:11 smithi103 ceph-mon[35094]: pgmap v290: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-12T12:15:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 -- 172.21.15.81:0/3142693619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c1037a0 msgr2=0x7f7c2c10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 --2- 172.21.15.81:0/3142693619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c1037a0 0x7f7c2c10bc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009900 tx=0x7f7c2002a410 comp rx=0 tx=0).stop 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 -- 172.21.15.81:0/3142693619 shutdown_connections 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 --2- 172.21.15.81:0/3142693619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c2c10c2f0 0x7f7c2c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 --2- 172.21.15.81:0/3142693619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c1037a0 0x7f7c2c10bc00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 --2- 172.21.15.81:0/3142693619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c102df0 0x7f7c2c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.039+0000 7f7c31582640 1 -- 172.21.15.81:0/3142693619 >> 172.21.15.81:0/3142693619 conn(0x7f7c2c0fc7d0 msgr2=0x7f7c2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.040+0000 7f7c31582640 1 -- 172.21.15.81:0/3142693619 shutdown_connections 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.040+0000 7f7c31582640 1 -- 172.21.15.81:0/3142693619 wait complete. 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.040+0000 7f7c31582640 1 Processor -- start 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 -- start start 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c102df0 0x7f7c2c100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c1037a0 0x7f7c2c100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c2c10c2f0 0x7f7c2c1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c112210 con 0x7f7c2c102df0 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c112090 con 0x7f7c2c10c2f0 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c31582640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c112390 con 0x7f7c2c1037a0 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c102df0 0x7f7c2c100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c102df0 0x7f7c2c100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54572/0 (socket says 172.21.15.81:54572) 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 -- 172.21.15.81:0/23918819 learned_addr learned my addr 172.21.15.81:0/23918819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2b7fe640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c2c10c2f0 0x7f7c2c1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2a7fc640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c1037a0 0x7f7c2c100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 -- 172.21.15.81:0/23918819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c1037a0 msgr2=0x7f7c2c100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c2c1037a0 0x7f7c2c100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 -- 172.21.15.81:0/23918819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c2c10c2f0 msgr2=0x7f7c2c1014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c2c10c2f0 0x7f7c2c1014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 -- 172.21.15.81:0/23918819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c1a6b90 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.041+0000 7f7c2affd640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c102df0 0x7f7c2c100a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c890 tx=0x7f7c1c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.042+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004220 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.042+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c1a6e80 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.042+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c1c0043c0 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.042+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004b10 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.042+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c1a7330 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.043+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c2c062900 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.044+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7c1c0051b0 con 0x7f7c2c102df0 2024-09-12T12:15:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.044+0000 7f7c13fff640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7c140a2c10 0x7f7c140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c2a7fc640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7c140a2c10 0x7f7c140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f7c1c0cf230 con 0x7f7c2c102df0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c13fff640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] conn(0x7f7c140ac6c0 0x7f7c140aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 --> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c1c012ec0 con 0x7f7c140ac6c0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f7c1c0d6050 con 0x7f7c2c102df0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c2b7fe640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] conn(0x7f7c140ac6c0 0x7f7c140aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c2a7fc640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7c140a2c10 0x7f7c140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009230 tx=0x7f7c20009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.045+0000 7f7c2b7fe640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] conn(0x7f7c140ac6c0 0x7f7c140aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.046+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== osd.3 v2:172.21.15.81:6810/839409711 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c1c012ec0 con 0x7f7c140ac6c0 2024-09-12T12:15:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.068+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 --> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c2c062d30 con 0x7f7c140ac6c0 2024-09-12T12:15:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c13fff640 1 -- 172.21.15.81:0/23918819 <== osd.3 v2:172.21.15.81:6810/839409711 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c2c062d30 con 0x7f7c140ac6c0 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] conn(0x7f7c140ac6c0 msgr2=0x7f7c140aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] conn(0x7f7c140ac6c0 0x7f7c140aeb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7c140a2c10 msgr2=0x7f7c140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7c140a2c10 0x7f7c140a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009230 tx=0x7f7c20009610 comp rx=0 tx=0).stop 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c102df0 msgr2=0x7f7c2c100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 --2- 172.21.15.81:0/23918819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2c102df0 0x7f7c2c100a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00c890 tx=0x7f7c1c00cd50 comp rx=0 tx=0).stop 2024-09-12T12:15:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c2b7fe640 1 -- 172.21.15.81:0/23918819 reap_dead start 2024-09-12T12:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.069+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 shutdown_connections 2024-09-12T12:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.070+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 >> 172.21.15.81:0/23918819 conn(0x7f7c2c0fc7d0 msgr2=0x7f7c2c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.070+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 shutdown_connections 2024-09-12T12:15:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.070+0000 7f7c31582640 1 -- 172.21.15.81:0/23918819 wait complete. 2024-09-12T12:15:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 -- 172.21.15.81:0/12500903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102ef0 msgr2=0x7fb58c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 --2- 172.21.15.81:0/12500903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102ef0 0x7fb58c10da40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb584009ca0 tx=0x7fb58402a950 comp rx=0 tx=0).stop 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 -- 172.21.15.81:0/12500903 shutdown_connections 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 --2- 172.21.15.81:0/12500903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102ef0 0x7fb58c10da40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 --2- 172.21.15.81:0/12500903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c102570 0x7fb58c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 --2- 172.21.15.81:0/12500903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb58c100e20 0x7fb58c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 -- 172.21.15.81:0/12500903 >> 172.21.15.81:0/12500903 conn(0x7fb58c0fc7d0 msgr2=0x7fb58c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 -- 172.21.15.81:0/12500903 shutdown_connections 2024-09-12T12:15:12.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.551+0000 7fb592680640 1 -- 172.21.15.81:0/12500903 wait complete. 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 Processor -- start 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 -- start start 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb58c100e20 0x7fb58c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102570 0x7fb58c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c102ef0 0x7fb58c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1110a0 con 0x7fb58c102570 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c110f20 con 0x7fb58c100e20 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb592680640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c111220 con 0x7fb58c102ef0 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102570 0x7fb58c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102570 0x7fb58c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45616/0 (socket says 172.21.15.81:45616) 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 -- 172.21.15.81:0/607717773 learned_addr learned my addr 172.21.15.81:0/607717773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb58bfff640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb58c100e20 0x7fb58c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb590c1d640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c102ef0 0x7fb58c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 -- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c102ef0 msgr2=0x7fb58c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c102ef0 0x7fb58c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 -- 172.21.15.81:0/607717773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb58c100e20 msgr2=0x7fb58c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb58c100e20 0x7fb58c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 -- 172.21.15.81:0/607717773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58c1a48b0 con 0x7fb58c102570 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb590c1d640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb58c102ef0 0x7fb58c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb583fff640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102570 0x7fb58c199830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c890 tx=0x7fb57400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.552+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574004220 con 0x7fb58c102570 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.553+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58c1a4a80 con 0x7fb58c102570 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.553+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5740043c0 con 0x7fb58c102570 2024-09-12T12:15:12.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.553+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574004b10 con 0x7fb58c102570 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.553+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58c1a4fc0 con 0x7fb58c102570 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.553+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb58c0fe620 con 0x7fb58c102570 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.555+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb5740051b0 con 0x7fb58c102570 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.555+0000 7fb589ffb640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb5780a2c10 0x7fb5780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb58bfff640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb5780a2c10 0x7fb5780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fb5740cf320 con 0x7fb58c102570 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb589ffb640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] conn(0x7fb5780ac6c0 0x7fb5780aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 --> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb574012ec0 con 0x7fb5780ac6c0 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fb5740cf800 con 0x7fb58c102570 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb58bfff640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb5780a2c10 0x7fb5780a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb57c005e10 tx=0x7fb57c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb590c1d640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] conn(0x7fb5780ac6c0 0x7fb5780aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.556+0000 7fb590c1d640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] conn(0x7fb5780ac6c0 0x7fb5780aeb60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.557+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== osd.8 v2:172.21.15.173:6816/754254770 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb574012ec0 con 0x7fb5780ac6c0 2024-09-12T12:15:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 --> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb58c1021b0 con 0x7fb5780ac6c0 2024-09-12T12:15:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb589ffb640 1 -- 172.21.15.81:0/607717773 <== osd.8 v2:172.21.15.173:6816/754254770 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb58c1021b0 con 0x7fb5780ac6c0 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] conn(0x7fb5780ac6c0 msgr2=0x7fb5780aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] conn(0x7fb5780ac6c0 0x7fb5780aeb60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb5780a2c10 msgr2=0x7fb5780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fb5780a2c10 0x7fb5780a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb57c005e10 tx=0x7fb57c005da0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102570 msgr2=0x7fb58c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb592680640 1 --2- 172.21.15.81:0/607717773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb58c102570 0x7fb58c199830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c890 tx=0x7fb57400cd50 comp rx=0 tx=0).stop 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.571+0000 7fb590c1d640 1 -- 172.21.15.81:0/607717773 reap_dead start 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.572+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 shutdown_connections 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.572+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 >> 172.21.15.81:0/607717773 conn(0x7fb58c0fc7d0 msgr2=0x7fb58c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.572+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 shutdown_connections 2024-09-12T12:15:12.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.572+0000 7fb592680640 1 -- 172.21.15.81:0/607717773 wait complete. 2024-09-12T12:15:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 -- 172.21.15.81:0/3573742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102ef0 msgr2=0x7f5ad010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/3573742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102ef0 0x7f5ad010da40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009ca0 tx=0x7f5ac802a950 comp rx=0 tx=0).stop 2024-09-12T12:15:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 -- 172.21.15.81:0/3573742 shutdown_connections 2024-09-12T12:15:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/3573742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102ef0 0x7f5ad010da40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/3573742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ad0102570 0x7f5ad01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/3573742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 0x7f5ad0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 -- 172.21.15.81:0/3573742 >> 172.21.15.81:0/3573742 conn(0x7f5ad00fc7d0 msgr2=0x7f5ad00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 -- 172.21.15.81:0/3573742 shutdown_connections 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.744+0000 7f5ad85ec640 1 -- 172.21.15.81:0/3573742 wait complete. 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 Processor -- start 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 -- start start 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 0x7f5ad0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102570 0x7f5ad0199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ad0102ef0 0x7f5ad01a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad01110e0 con 0x7f5ad0102570 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0110f60 con 0x7f5ad0100e20 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad85ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0111260 con 0x7f5ad0102ef0 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad5b87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102570 0x7f5ad0199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad6388640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 0x7f5ad0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad6388640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 0x7f5ad0199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:55582/0 (socket says 172.21.15.81:55582) 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.745+0000 7f5ad6388640 1 -- 172.21.15.81:0/1401196008 learned_addr learned my addr 172.21.15.81:0/1401196008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:12.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6b89640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ad0102ef0 0x7f5ad01a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6388640 1 -- 172.21.15.81:0/1401196008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ad0102ef0 msgr2=0x7f5ad01a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6388640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ad0102ef0 0x7f5ad01a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6388640 1 -- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102570 msgr2=0x7f5ad0199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6388640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0102570 0x7f5ad0199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6388640 1 -- 172.21.15.81:0/1401196008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad01a49f0 con 0x7f5ad0100e20 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6b89640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ad0102ef0 0x7f5ad01a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad6388640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 0x7f5ad0199430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00d950 tx=0x7f5acc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc017070 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad01a4bc0 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5acc009c30 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00f740 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.746+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad01a5100 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.747+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ad01071f0 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.749+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5acc010a80 con 0x7f5ad0100e20 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ac77fe640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5abc0a2c10 0x7f5abc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ad5b87640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5abc0a2c10 0x7f5abc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f5acc0cf1b0 con 0x7f5ad0100e20 2024-09-12T12:15:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ac77fe640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] conn(0x7f5abc0ac6c0 0x7f5abc0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 --> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5acc016ec0 con 0x7f5abc0ac6c0 2024-09-12T12:15:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f5acc0cf690 con 0x7f5ad0100e20 2024-09-12T12:15:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ad6b89640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] conn(0x7f5abc0ac6c0 0x7f5abc0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:12.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ad5b87640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5abc0a2c10 0x7f5abc0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ad006aac0 tx=0x7f5ac0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.750+0000 7f5ad6b89640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] conn(0x7f5abc0ac6c0 0x7f5abc0aeb60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.751+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== osd.9 v2:172.21.15.81:6826/4277266165 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5acc016ec0 con 0x7f5abc0ac6c0 2024-09-12T12:15:12.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 --> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ad01021b0 con 0x7f5abc0ac6c0 2024-09-12T12:15:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ac77fe640 1 -- 172.21.15.81:0/1401196008 <== osd.9 v2:172.21.15.81:6826/4277266165 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5ad01021b0 con 0x7f5abc0ac6c0 2024-09-12T12:15:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] conn(0x7f5abc0ac6c0 msgr2=0x7f5abc0aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] conn(0x7f5abc0ac6c0 0x7f5abc0aeb60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5abc0a2c10 msgr2=0x7f5abc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5abc0a2c10 0x7f5abc0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5ad006aac0 tx=0x7f5ac0008040 comp rx=0 tx=0).stop 2024-09-12T12:15:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 msgr2=0x7f5ad0199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 --2- 172.21.15.81:0/1401196008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ad0100e20 0x7f5ad0199430 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00d950 tx=0x7f5acc00de10 comp rx=0 tx=0).stop 2024-09-12T12:15:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad6b89640 1 -- 172.21.15.81:0/1401196008 reap_dead start 2024-09-12T12:15:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 shutdown_connections 2024-09-12T12:15:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 >> 172.21.15.81:0/1401196008 conn(0x7f5ad00fc7d0 msgr2=0x7f5ad01067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 shutdown_connections 2024-09-12T12:15:12.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:12.765+0000 7f5ad85ec640 1 -- 172.21.15.81:0/1401196008 wait complete. 2024-09-12T12:15:13.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:13 smithi081 ceph-mon[30948]: pgmap v291: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T12:15:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:13 smithi173 ceph-mon[35326]: pgmap v291: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T12:15:13.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:13 smithi103 ceph-mon[35094]: pgmap v291: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 -- 172.21.15.81:0/593987527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb41082a0 msgr2=0x7fbfb410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/593987527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb41082a0 0x7fbfb410ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009cd0 tx=0x7fbfac02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 -- 172.21.15.81:0/593987527 shutdown_connections 2024-09-12T12:15:14.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/593987527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb41082a0 0x7fbfb410ec40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/593987527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfb41036e0 0x7fbfb4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/593987527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb4102d30 0x7fbfb4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 -- 172.21.15.81:0/593987527 >> 172.21.15.81:0/593987527 conn(0x7fbfb40fc7d0 msgr2=0x7fbfb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 -- 172.21.15.81:0/593987527 shutdown_connections 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 -- 172.21.15.81:0/593987527 wait complete. 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.301+0000 7fbfbabd4640 1 Processor -- start 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 -- start start 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb4102d30 0x7fbfb41985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfb41036e0 0x7fbfb4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb41082a0 0x7fbfb419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41121c0 con 0x7fbfb4102d30 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4112040 con 0x7fbfb41082a0 2024-09-12T12:15:14.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfbabd4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4112340 con 0x7fbfb41036e0 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb4102d30 0x7fbfb41985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb4102d30 0x7fbfb41985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45684/0 (socket says 172.21.15.81:45684) 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 -- 172.21.15.81:0/4071192662 learned_addr learned my addr 172.21.15.81:0/4071192662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb9171640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb41082a0 0x7fbfb419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb3fff640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfb41036e0 0x7fbfb4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 -- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfb41036e0 msgr2=0x7fbfb4198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfb41036e0 0x7fbfb4198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 -- 172.21.15.81:0/4071192662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb41082a0 msgr2=0x7fbfb419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfb41082a0 0x7fbfb419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb8970640 1 -- 172.21.15.81:0/4071192662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb419d5a0 con 0x7fbfb4102d30 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.302+0000 7fbfb3fff640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfb41036e0 0x7fbfb4198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:14.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.303+0000 7fbfb8970640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb4102d30 0x7fbfb41985f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800d950 tx=0x7fbfa800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.303+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8017070 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.303+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfa8009c30 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.303+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800f740 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.303+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb419d890 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.303+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41a5170 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.304+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfb40fed30 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.305+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbfa8010a80 con 0x7fbfb4102d30 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.305+0000 7fbfb1ffb640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbfa40a2c90 0x7fbfa40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb3fff640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbfa40a2c90 0x7fbfa40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fbfa80cedb0 con 0x7fbfb4102d30 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb1ffb640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] conn(0x7fbfa40ac740 0x7fbfa40aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 --> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfa8004470 con 0x7fbfa40ac740 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fbfa80d13d0 con 0x7fbfb4102d30 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb3fff640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbfa40a2c90 0x7fbfa40a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0005e10 tx=0x7fbfa0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.306+0000 7fbfb9171640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] conn(0x7fbfa40ac740 0x7fbfa40aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.307+0000 7fbfb9171640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] conn(0x7fbfa40ac740 0x7fbfa40aebe0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.307+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== osd.11 v2:172.21.15.173:6824/2112038655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfa8004470 con 0x7fbfa40ac740 2024-09-12T12:15:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.323+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 --> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbfb406a850 con 0x7fbfa40ac740 2024-09-12T12:15:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfb1ffb640 1 -- 172.21.15.81:0/4071192662 <== osd.11 v2:172.21.15.173:6824/2112038655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbfb406a850 con 0x7fbfa40ac740 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] conn(0x7fbfa40ac740 msgr2=0x7fbfa40aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] conn(0x7fbfa40ac740 0x7fbfa40aebe0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbfa40a2c90 msgr2=0x7fbfa40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fbfa40a2c90 0x7fbfa40a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0005e10 tx=0x7fbfa0005da0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb4102d30 msgr2=0x7fbfb41985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 --2- 172.21.15.81:0/4071192662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbfb4102d30 0x7fbfb41985f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800d950 tx=0x7fbfa800de10 comp rx=0 tx=0).stop 2024-09-12T12:15:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfb9171640 1 -- 172.21.15.81:0/4071192662 reap_dead start 2024-09-12T12:15:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 shutdown_connections 2024-09-12T12:15:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 >> 172.21.15.81:0/4071192662 conn(0x7fbfb40fc7d0 msgr2=0x7fbfb40fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 shutdown_connections 2024-09-12T12:15:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.324+0000 7fbfbabd4640 1 -- 172.21.15.81:0/4071192662 wait complete. 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 -- 172.21.15.81:0/2834552882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4102d50 msgr2=0x7f95b4103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 --2- 172.21.15.81:0/2834552882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4102d50 0x7f95b4103130 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009900 tx=0x7f95b002a480 comp rx=0 tx=0).stop 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 -- 172.21.15.81:0/2834552882 shutdown_connections 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 --2- 172.21.15.81:0/2834552882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95b410c180 0x7f95b410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 --2- 172.21.15.81:0/2834552882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b4103670 0x7f95b410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 --2- 172.21.15.81:0/2834552882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4102d50 0x7f95b4103130 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 -- 172.21.15.81:0/2834552882 >> 172.21.15.81:0/2834552882 conn(0x7f95b40fc7d0 msgr2=0x7f95b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 -- 172.21.15.81:0/2834552882 shutdown_connections 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.513+0000 7f95bb28c640 1 -- 172.21.15.81:0/2834552882 wait complete. 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 Processor -- start 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 -- start start 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b4102d50 0x7f95b41009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4103670 0x7f95b4100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95b410c180 0x7f95b4101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95b41120a0 con 0x7f95b4103670 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4111f20 con 0x7f95b410c180 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95bb28c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f95b4112220 con 0x7f95b4102d50 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95b8827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4103670 0x7f95b4100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95b8827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4103670 0x7f95b4100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45694/0 (socket says 172.21.15.81:45694) 2024-09-12T12:15:14.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95b8827640 1 -- 172.21.15.81:0/796311544 learned_addr learned my addr 172.21.15.81:0/796311544 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.514+0000 7f95b9028640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b4102d50 0x7f95b41009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b9829640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95b410c180 0x7f95b4101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b8827640 1 -- 172.21.15.81:0/796311544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b4102d50 msgr2=0x7f95b41009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b8827640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95b4102d50 0x7f95b41009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b8827640 1 -- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95b410c180 msgr2=0x7f95b4101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b8827640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95b410c180 0x7f95b4101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b8827640 1 -- 172.21.15.81:0/796311544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b41a6aa0 con 0x7f95b4103670 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95b8827640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4103670 0x7f95b4100ef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d750 tx=0x7f95a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4017070 con 0x7f95b4103670 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f95a4005020 con 0x7f95b4103670 2024-09-12T12:15:14.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b41a6d90 con 0x7f95b4103670 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4004dd0 con 0x7f95b4103670 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.515+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b41a7270 con 0x7f95b4103670 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.516+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95b40628c0 con 0x7f95b4103670 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f95a40051d0 con 0x7f95b4103670 2024-09-12T12:15:14.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95aa7fc640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f95a00a2c90 0x7f95a00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f95a40cef30 con 0x7f95b4103670 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95b9028640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f95a00a2c90 0x7f95a00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95aa7fc640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] conn(0x7f95a00ac740 0x7f95a00aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:14.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 --> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95a00af2b0 con 0x7f95a00ac740 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.518+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f95a40cf2e0 con 0x7f95b4103670 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.519+0000 7f95b9829640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] conn(0x7f95a00ac740 0x7f95a00aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.519+0000 7f95b9028640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f95a00a2c90 0x7f95a00a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009230 tx=0x7f95b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.519+0000 7f95b9829640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] conn(0x7f95a00ac740 0x7f95a00aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.520+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== osd.7 v2:172.21.15.103:6816/4035639207 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95a00af2b0 con 0x7f95a00ac740 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.534+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 --> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95b4062cc0 con 0x7f95a00ac740 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.534+0000 7f95aa7fc640 1 -- 172.21.15.81:0/796311544 <== osd.7 v2:172.21.15.103:6816/4035639207 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f95b4062cc0 con 0x7f95a00ac740 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.534+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] conn(0x7f95a00ac740 msgr2=0x7f95a00aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] conn(0x7f95a00ac740 0x7f95a00aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f95a00a2c90 msgr2=0x7f95a00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f95a00a2c90 0x7f95a00a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95b0009230 tx=0x7f95b00058d0 comp rx=0 tx=0).stop 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4103670 msgr2=0x7f95b4100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:14.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 --2- 172.21.15.81:0/796311544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95b4103670 0x7f95b4100ef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d750 tx=0x7f95a400dc10 comp rx=0 tx=0).stop 2024-09-12T12:15:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95b9829640 1 -- 172.21.15.81:0/796311544 reap_dead start 2024-09-12T12:15:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 shutdown_connections 2024-09-12T12:15:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 >> 172.21.15.81:0/796311544 conn(0x7f95b40fc7d0 msgr2=0x7f95b40fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 shutdown_connections 2024-09-12T12:15:14.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:14.535+0000 7f95bb28c640 1 -- 172.21.15.81:0/796311544 wait complete. 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 -- 172.21.15.81:0/2053252417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac100a80 msgr2=0x7f8cac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/2053252417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac100a80 0x7f8cac100ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009930 tx=0x7f8c9402a420 comp rx=0 tx=0).stop 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 -- 172.21.15.81:0/2053252417 shutdown_connections 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/2053252417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cac101420 0x7f8cac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/2053252417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac100a80 0x7f8cac100ee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/2053252417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cac106a80 0x7f8cac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 -- 172.21.15.81:0/2053252417 >> 172.21.15.81:0/2053252417 conn(0x7f8cac0fc7a0 msgr2=0x7f8cac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 -- 172.21.15.81:0/2053252417 shutdown_connections 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.709+0000 7f8cb0c48640 1 -- 172.21.15.81:0/2053252417 wait complete. 2024-09-12T12:15:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 Processor -- start 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 -- start start 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cac100a80 0x7f8cac1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cac101420 0x7f8cac197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac106a80 0x7f8cac19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac110fe0 con 0x7f8cac106a80 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac110e60 con 0x7f8cac100a80 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8cb0c48640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac111160 con 0x7f8cac101420 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8caad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac106a80 0x7f8cac19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8caad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac106a80 0x7f8cac19bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45658/0 (socket says 172.21.15.81:45658) 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8caad9d640 1 -- 172.21.15.81:0/1634097378 learned_addr learned my addr 172.21.15.81:0/1634097378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.710+0000 7f8caa59c640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cac100a80 0x7f8cac1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8ca3fff640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cac101420 0x7f8cac197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8caad9d640 1 -- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cac101420 msgr2=0x7f8cac197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8caad9d640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8cac101420 0x7f8cac197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8caad9d640 1 -- 172.21.15.81:0/1634097378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cac100a80 msgr2=0x7f8cac1973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8caad9d640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cac100a80 0x7f8cac1973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8caad9d640 1 -- 172.21.15.81:0/1634097378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac19c390 con 0x7f8cac106a80 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8caad9d640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac106a80 0x7f8cac19bcb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400b970 tx=0x7f8ca400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4019070 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ca4014440 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac19c680 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40075d0 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.711+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1a3f60 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.712+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cac0fd740 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.713+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ca401c070 con 0x7f8cac106a80 2024-09-12T12:15:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8ca37fe640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8c980a2c10 0x7f8c980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8caa59c640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8c980a2c10 0x7f8c980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f8ca40ced20 con 0x7f8cac106a80 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8ca37fe640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] conn(0x7f8c980ac6c0 0x7f8c980aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 --> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c980af230 con 0x7f8c980ac6c0 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f8ca40cf200 con 0x7f8cac106a80 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8caa59c640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8c980a2c10 0x7f8c980a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00abe0 tx=0x7f8c9c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.714+0000 7f8ca3fff640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] conn(0x7f8c980ac6c0 0x7f8c980aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.715+0000 7f8ca3fff640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] conn(0x7f8c980ac6c0 0x7f8c980aeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.716+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== osd.2 v2:172.21.15.173:6800/3783460889 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c980af230 con 0x7f8c980ac6c0 2024-09-12T12:15:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.729+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 --> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cac1021c0 con 0x7f8c980ac6c0 2024-09-12T12:15:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.730+0000 7f8ca37fe640 1 -- 172.21.15.81:0/1634097378 <== osd.2 v2:172.21.15.173:6800/3783460889 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8cac1021c0 con 0x7f8c980ac6c0 2024-09-12T12:15:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.730+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] conn(0x7f8c980ac6c0 msgr2=0x7f8c980aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] conn(0x7f8c980ac6c0 0x7f8c980aeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8c980a2c10 msgr2=0x7f8c980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f8c980a2c10 0x7f8c980a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00abe0 tx=0x7f8c9c00a2d0 comp rx=0 tx=0).stop 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac106a80 msgr2=0x7f8cac19bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 --2- 172.21.15.81:0/1634097378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cac106a80 0x7f8cac19bcb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400b970 tx=0x7f8ca400bd70 comp rx=0 tx=0).stop 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8caad9d640 1 -- 172.21.15.81:0/1634097378 reap_dead start 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 shutdown_connections 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 >> 172.21.15.81:0/1634097378 conn(0x7f8cac0fc7a0 msgr2=0x7f8cac0fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 shutdown_connections 2024-09-12T12:15:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:13.731+0000 7f8cb0c48640 1 -- 172.21.15.81:0/1634097378 wait complete. 2024-09-12T12:15:15.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:15 smithi081 ceph-mon[30948]: pgmap v292: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:15:15.790 INFO:teuthology.orchestra.run.smithi081.stdout:73014444097 2024-09-12T12:15:15.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T12:15:15.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:15 smithi173 ceph-mon[35326]: pgmap v292: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:15:15.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:15 smithi103 ceph-mon[35094]: pgmap v292: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:15:16.343 INFO:teuthology.orchestra.run.smithi081.stdout:304942678037 2024-09-12T12:15:16.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T12:15:16.975 INFO:teuthology.orchestra.run.smithi081.stdout:98784247868 2024-09-12T12:15:16.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T12:15:17.536 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:17 smithi081 ceph-mon[30948]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:15:17.653 INFO:teuthology.orchestra.run.smithi081.stdout:223338299428 2024-09-12T12:15:17.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T12:15:17.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 -- 172.21.15.81:0/2296842066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0102dd0 msgr2=0x7f5eb01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 --2- 172.21.15.81:0/2296842066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0102dd0 0x7f5eb01031b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009900 tx=0x7f5ea402a480 comp rx=0 tx=0).stop 2024-09-12T12:15:17.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 -- 172.21.15.81:0/2296842066 shutdown_connections 2024-09-12T12:15:17.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 --2- 172.21.15.81:0/2296842066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5eb010c170 0x7f5eb010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 --2- 172.21.15.81:0/2296842066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb01036f0 0x7f5eb010bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 --2- 172.21.15.81:0/2296842066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0102dd0 0x7f5eb01031b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 -- 172.21.15.81:0/2296842066 >> 172.21.15.81:0/2296842066 conn(0x7f5eb00fc790 msgr2=0x7f5eb00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 -- 172.21.15.81:0/2296842066 shutdown_connections 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.785+0000 7f5eb7248640 1 -- 172.21.15.81:0/2296842066 wait complete. 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 Processor -- start 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 -- start start 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb0102dd0 0x7f5eb0198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5eb01036f0 0x7f5eb0198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb010c170 0x7f5eb019cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0112160 con 0x7f5eb010c170 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb0111fe0 con 0x7f5eb0102dd0 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb7248640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb01122e0 con 0x7f5eb01036f0 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb57e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb010c170 0x7f5eb019cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb57e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb010c170 0x7f5eb019cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45716/0 (socket says 172.21.15.81:45716) 2024-09-12T12:15:17.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb57e5640 1 -- 172.21.15.81:0/3768796340 learned_addr learned my addr 172.21.15.81:0/3768796340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:17.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb4fe4640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb0102dd0 0x7f5eb0198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eaffff640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5eb01036f0 0x7f5eb0198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb57e5640 1 -- 172.21.15.81:0/3768796340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5eb01036f0 msgr2=0x7f5eb0198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.786+0000 7f5eb57e5640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5eb01036f0 0x7f5eb0198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb57e5640 1 -- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb0102dd0 msgr2=0x7f5eb0198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb57e5640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb0102dd0 0x7f5eb0198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb57e5640 1 -- 172.21.15.81:0/3768796340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb019d640 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb4fe4640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5eb0102dd0 0x7f5eb0198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb57e5640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb010c170 0x7f5eb019cf60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800b970 tx=0x7f5ea800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8019070 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb019d930 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ea800cb40 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea801d6e0 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.787+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb01a5210 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.788+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5eb0062980 con 0x7f5eb010c170 2024-09-12T12:15:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.790+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5ea801c070 con 0x7f5eb010c170 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eadffb640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5ea00a2c90 0x7f5ea00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eb4fe4640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5ea00a2c90 0x7f5ea00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f5ea80cee20 con 0x7f5eb010c170 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eadffb640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] conn(0x7f5ea00ac740 0x7f5ea00aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 --> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea00af2b0 con 0x7f5ea00ac740 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f5ea80cf300 con 0x7f5eb010c170 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eb4fe4640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5ea00a2c90 0x7f5ea00a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4000c00 tx=0x7f5ea4032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.791+0000 7f5eaffff640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] conn(0x7f5ea00ac740 0x7f5ea00aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.792+0000 7f5eaffff640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] conn(0x7f5ea00ac740 0x7f5ea00aebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.793+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== osd.4 v2:172.21.15.103:6808/1884074772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea00af2b0 con 0x7f5ea00ac740 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.806+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 --> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5eb0062e00 con 0x7f5ea00ac740 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eadffb640 1 -- 172.21.15.81:0/3768796340 <== osd.4 v2:172.21.15.103:6808/1884074772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5eb0062e00 con 0x7f5ea00ac740 2024-09-12T12:15:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] conn(0x7f5ea00ac740 msgr2=0x7f5ea00aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] conn(0x7f5ea00ac740 0x7f5ea00aebe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5ea00a2c90 msgr2=0x7f5ea00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5ea00a2c90 0x7f5ea00a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4000c00 tx=0x7f5ea4032d60 comp rx=0 tx=0).stop 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb010c170 msgr2=0x7f5eb019cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 --2- 172.21.15.81:0/3768796340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb010c170 0x7f5eb019cf60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800b970 tx=0x7f5ea800be30 comp rx=0 tx=0).stop 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb57e5640 1 -- 172.21.15.81:0/3768796340 reap_dead start 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 shutdown_connections 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 >> 172.21.15.81:0/3768796340 conn(0x7f5eb00fc790 msgr2=0x7f5eb00fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 shutdown_connections 2024-09-12T12:15:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:17.807+0000 7f5eb7248640 1 -- 172.21.15.81:0/3768796340 wait complete. 2024-09-12T12:15:17.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:17 smithi173 ceph-mon[35326]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:15:17.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:17 smithi103 ceph-mon[35094]: pgmap v293: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-12T12:15:18.711 INFO:teuthology.orchestra.run.smithi081.stdout:193273528360 2024-09-12T12:15:18.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T12:15:19.524 INFO:teuthology.orchestra.run.smithi081.stdout:253403070495 2024-09-12T12:15:19.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T12:15:19.716 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:19 smithi081 ceph-mon[30948]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T12:15:19.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 -- 172.21.15.81:0/132404219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64100a70 msgr2=0x7fde64100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 --2- 172.21.15.81:0/132404219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64100a70 0x7fde64100ed0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde58009930 tx=0x7fde5802a420 comp rx=0 tx=0).stop 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 -- 172.21.15.81:0/132404219 shutdown_connections 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 --2- 172.21.15.81:0/132404219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde64101410 0x7fde6410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 --2- 172.21.15.81:0/132404219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64100a70 0x7fde64100ed0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 --2- 172.21.15.81:0/132404219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde64106a70 0x7fde64106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 -- 172.21.15.81:0/132404219 >> 172.21.15.81:0/132404219 conn(0x7fde640fc7d0 msgr2=0x7fde640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 -- 172.21.15.81:0/132404219 shutdown_connections 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 -- 172.21.15.81:0/132404219 wait complete. 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.796+0000 7fde697a0640 1 Processor -- start 2024-09-12T12:15:19.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 -- start start 2024-09-12T12:15:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde64100a70 0x7fde64199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde64101410 0x7fde641999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64106a70 0x7fde641a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde64110fd0 con 0x7fde64106a70 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde64110e50 con 0x7fde64101410 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde697a0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde64111150 con 0x7fde64100a70 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64106a70 0x7fde641a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64106a70 0x7fde641a4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45726/0 (socket says 172.21.15.81:45726) 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 -- 172.21.15.81:0/3056992 learned_addr learned my addr 172.21.15.81:0/3056992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde62ffd640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde64100a70 0x7fde64199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde627fc640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde64101410 0x7fde641999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 -- 172.21.15.81:0/3056992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde64100a70 msgr2=0x7fde64199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde64100a70 0x7fde64199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 -- 172.21.15.81:0/3056992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde64101410 msgr2=0x7fde641999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde64101410 0x7fde641999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.797+0000 7fde637fe640 1 -- 172.21.15.81:0/3056992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde641a4a40 con 0x7fde64106a70 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.798+0000 7fde637fe640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64106a70 0x7fde641a4500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00cad0 tx=0x7fde5c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.798+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00ad60 con 0x7fde64106a70 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.798+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde641a4c10 con 0x7fde64106a70 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.798+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde5c004b20 con 0x7fde64106a70 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.798+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00f6f0 con 0x7fde64106a70 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.798+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde641a50d0 con 0x7fde64106a70 2024-09-12T12:15:19.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.799+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde640628c0 con 0x7fde64106a70 2024-09-12T12:15:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.800+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fde5c00f890 con 0x7fde64106a70 2024-09-12T12:15:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde4bfff640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fde4c0a2c10 0x7fde4c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde62ffd640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fde4c0a2c10 0x7fde4c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fde5c0cf430 con 0x7fde64106a70 2024-09-12T12:15:19.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde4bfff640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] conn(0x7fde4c0ac6c0 0x7fde4c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:19.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 --> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde4c0af230 con 0x7fde4c0ac6c0 2024-09-12T12:15:19.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fde5c0cf910 con 0x7fde64106a70 2024-09-12T12:15:19.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde62ffd640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fde4c0a2c10 0x7fde4c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde54009990 tx=0x7fde54009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:19.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde627fc640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] conn(0x7fde4c0ac6c0 0x7fde4c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:19.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.801+0000 7fde627fc640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] conn(0x7fde4c0ac6c0 0x7fde4c0aeb60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:19.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.802+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== osd.0 v2:172.21.15.81:6802/1527983778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde4c0af230 con 0x7fde4c0ac6c0 2024-09-12T12:15:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.816+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 --> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fde64062d40 con 0x7fde4c0ac6c0 2024-09-12T12:15:19.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.816+0000 7fde4bfff640 1 -- 172.21.15.81:0/3056992 <== osd.0 v2:172.21.15.81:6802/1527983778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fde64062d40 con 0x7fde4c0ac6c0 2024-09-12T12:15:19.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.816+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] conn(0x7fde4c0ac6c0 msgr2=0x7fde4c0aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.816+0000 7fde697a0640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] conn(0x7fde4c0ac6c0 0x7fde4c0aeb60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fde4c0a2c10 msgr2=0x7fde4c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fde4c0a2c10 0x7fde4c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fde54009990 tx=0x7fde54009110 comp rx=0 tx=0).stop 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64106a70 msgr2=0x7fde641a4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 --2- 172.21.15.81:0/3056992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde64106a70 0x7fde641a4500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00cad0 tx=0x7fde5c00ced0 comp rx=0 tx=0).stop 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde637fe640 1 -- 172.21.15.81:0/3056992 reap_dead start 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 shutdown_connections 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 >> 172.21.15.81:0/3056992 conn(0x7fde640fc7d0 msgr2=0x7fde640fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 shutdown_connections 2024-09-12T12:15:19.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:19.817+0000 7fde697a0640 1 -- 172.21.15.81:0/3056992 wait complete. 2024-09-12T12:15:19.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:19 smithi173 ceph-mon[35326]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T12:15:19.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:19 smithi103 ceph-mon[35094]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-12T12:15:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:20.588 INFO:teuthology.orchestra.run.smithi081.stdout:34359738445 2024-09-12T12:15:20.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T12:15:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 -- 172.21.15.81:0/1901067306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102d30 msgr2=0x7f25e0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1901067306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102d30 0x7f25e0103110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009930 tx=0x7f25d802a420 comp rx=0 tx=0).stop 2024-09-12T12:15:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 -- 172.21.15.81:0/1901067306 shutdown_connections 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1901067306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e01082a0 0x7f25e010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1901067306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e01036e0 0x7f25e0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1901067306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e0102d30 0x7f25e0103110 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 -- 172.21.15.81:0/1901067306 >> 172.21.15.81:0/1901067306 conn(0x7f25e00fc7d0 msgr2=0x7f25e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 -- 172.21.15.81:0/1901067306 shutdown_connections 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.029+0000 7f25e4f41640 1 -- 172.21.15.81:0/1901067306 wait complete. 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 Processor -- start 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 -- start start 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e0102d30 0x7f25e01986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e01036e0 0x7f25e0198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e01082a0 0x7f25e019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112240 con 0x7f25e01082a0 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01120c0 con 0x7f25e0102d30 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25e4f41640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01123c0 con 0x7f25e01036e0 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e01082a0 0x7f25e019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e01082a0 0x7f25e019cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45754/0 (socket says 172.21.15.81:45754) 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 -- 172.21.15.81:0/1521536420 learned_addr learned my addr 172.21.15.81:0/1521536420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25de59c640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e0102d30 0x7f25e01986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ddd9b640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e01036e0 0x7f25e0198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 -- 172.21.15.81:0/1521536420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e01036e0 msgr2=0x7f25e0198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25e01036e0 0x7f25e0198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 -- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e0102d30 msgr2=0x7f25e01986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e0102d30 0x7f25e01986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.030+0000 7f25ded9d640 1 -- 172.21.15.81:0/1521536420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e019d670 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.031+0000 7f25ded9d640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e01082a0 0x7f25e019cf90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009fd0 tx=0x7f25d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.031+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011830 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.031+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f25d0016070 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.031+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e019d960 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.031+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d000f2e0 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.031+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a5240 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.032+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25e0062980 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.033+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f25d001b460 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.033+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f25c80a2c90 0x7f25c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25de59c640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f25c80a2c90 0x7f25c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f25d00cf050 con 0x7f25e01082a0 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25cf7fe640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] conn(0x7f25c80ac740 0x7f25c80aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 --> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25c80af2b0 con 0x7f25c80ac740 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f25d00cf530 con 0x7f25e01082a0 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25ddd9b640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] conn(0x7f25c80ac740 0x7f25c80aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25de59c640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f25c80a2c90 0x7f25c80a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009900 tx=0x7f25d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.034+0000 7f25ddd9b640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] conn(0x7f25c80ac740 0x7f25c80aebe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.035+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== osd.10 v2:172.21.15.103:6824/2351516633 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25c80af2b0 con 0x7f25c80ac740 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.049+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 --> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25e0062d80 con 0x7f25c80ac740 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25cf7fe640 1 -- 172.21.15.81:0/1521536420 <== osd.10 v2:172.21.15.103:6824/2351516633 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25e0062d80 con 0x7f25c80ac740 2024-09-12T12:15:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] conn(0x7f25c80ac740 msgr2=0x7f25c80aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] conn(0x7f25c80ac740 0x7f25c80aebe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f25c80a2c90 msgr2=0x7f25c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f25c80a2c90 0x7f25c80a5150 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009900 tx=0x7f25d80058d0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e01082a0 msgr2=0x7f25e019cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 --2- 172.21.15.81:0/1521536420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e01082a0 0x7f25e019cf90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009fd0 tx=0x7f25d000b8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25ded9d640 1 -- 172.21.15.81:0/1521536420 reap_dead start 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 shutdown_connections 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 >> 172.21.15.81:0/1521536420 conn(0x7f25e00fc7d0 msgr2=0x7f25e0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 shutdown_connections 2024-09-12T12:15:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:21.050+0000 7f25e4f41640 1 -- 172.21.15.81:0/1521536420 wait complete. 2024-09-12T12:15:21.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:21 smithi081 ceph-mon[30948]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:21.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:21 smithi173 ceph-mon[35326]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:21.928 INFO:teuthology.orchestra.run.smithi081.stdout:274877906971 2024-09-12T12:15:21.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T12:15:21.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:21 smithi103 ceph-mon[35094]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 -- 172.21.15.81:0/2150452504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4102ef0 msgr2=0x7f5fa410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/2150452504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4102ef0 0x7f5fa410da40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009ca0 tx=0x7f5f9c02a950 comp rx=0 tx=0).stop 2024-09-12T12:15:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 -- 172.21.15.81:0/2150452504 shutdown_connections 2024-09-12T12:15:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/2150452504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4102ef0 0x7f5fa410da40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/2150452504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa4102570 0x7f5fa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/2150452504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa4100e20 0x7f5fa4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 -- 172.21.15.81:0/2150452504 >> 172.21.15.81:0/2150452504 conn(0x7f5fa40fc7d0 msgr2=0x7f5fa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 -- 172.21.15.81:0/2150452504 shutdown_connections 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.126+0000 7f5fa9e16640 1 -- 172.21.15.81:0/2150452504 wait complete. 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.127+0000 7f5fa9e16640 1 Processor -- start 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.127+0000 7f5fa9e16640 1 -- start start 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.127+0000 7f5fa9e16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4100e20 0x7f5fa4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.127+0000 7f5fa9e16640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa4102570 0x7f5fa4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.127+0000 7f5fa9e16640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa4102ef0 0x7f5fa419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa9e16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa41122b0 con 0x7f5fa4100e20 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa9e16640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4112130 con 0x7f5fa4102ef0 2024-09-12T12:15:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa9e16640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa4112430 con 0x7f5fa4102570 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4100e20 0x7f5fa4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4100e20 0x7f5fa4198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45770/0 (socket says 172.21.15.81:45770) 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 -- 172.21.15.81:0/1848551186 learned_addr learned my addr 172.21.15.81:0/1848551186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa3fff640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa4102ef0 0x7f5fa419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5f9bfff640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa4102570 0x7f5fa4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 -- 172.21.15.81:0/1848551186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa4102570 msgr2=0x7f5fa4198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa4102570 0x7f5fa4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 -- 172.21.15.81:0/1848551186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa4102ef0 msgr2=0x7f5fa419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fa4102ef0 0x7f5fa419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 -- 172.21.15.81:0/1848551186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa419d5c0 con 0x7f5fa4100e20 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa37fe640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4100e20 0x7f5fa4198610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400b4a0 tx=0x7f5f9400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94014070 con 0x7f5fa4100e20 2024-09-12T12:15:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f94010b10 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94017d60 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa419d8b0 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.128+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa41a5190 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.129+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5fa41071f0 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5f94017070 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa17fa640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5f900a2c10 0x7f5f900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f5f940ce870 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5f9bfff640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5f900a2c10 0x7f5f900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa17fa640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] conn(0x7f5f900ac6c0 0x7f5f900aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 --> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f9401ae50 con 0x7f5f900ac6c0 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f5f940cecd0 con 0x7f5fa4100e20 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.131+0000 7f5fa3fff640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] conn(0x7f5f900ac6c0 0x7f5f900aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.132+0000 7f5f9bfff640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5f900a2c10 0x7f5f900a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40feca0 tx=0x7f5f8c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.132+0000 7f5fa3fff640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] conn(0x7f5f900ac6c0 0x7f5f900aeb60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.132+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== osd.6 v2:172.21.15.81:6818/3383572766 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f9401ae50 con 0x7f5f900ac6c0 2024-09-12T12:15:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.146+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 --> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5fa41021b0 con 0x7f5f900ac6c0 2024-09-12T12:15:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.146+0000 7f5fa17fa640 1 -- 172.21.15.81:0/1848551186 <== osd.6 v2:172.21.15.81:6818/3383572766 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5fa41021b0 con 0x7f5f900ac6c0 2024-09-12T12:15:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.146+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] conn(0x7f5f900ac6c0 msgr2=0x7f5f900aeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.146+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] conn(0x7f5f900ac6c0 0x7f5f900aeb60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5f900a2c10 msgr2=0x7f5f900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5f900a2c10 0x7f5f900a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40feca0 tx=0x7f5f8c008040 comp rx=0 tx=0).stop 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4100e20 msgr2=0x7f5fa4198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 --2- 172.21.15.81:0/1848551186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fa4100e20 0x7f5fa4198610 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400b4a0 tx=0x7f5f9400b960 comp rx=0 tx=0).stop 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa3fff640 1 -- 172.21.15.81:0/1848551186 reap_dead start 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 shutdown_connections 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 >> 172.21.15.81:0/1848551186 conn(0x7f5fa40fc7d0 msgr2=0x7f5fa4105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 shutdown_connections 2024-09-12T12:15:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.147+0000 7f5fa9e16640 1 -- 172.21.15.81:0/1848551186 wait complete. 2024-09-12T12:15:22.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 -- 172.21.15.81:0/4182111655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4100e20 msgr2=0x7fc4f4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/4182111655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4100e20 0x7fc4f4101200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009900 tx=0x7fc4e402a480 comp rx=0 tx=0).stop 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 -- 172.21.15.81:0/4182111655 shutdown_connections 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/4182111655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f4102ef0 0x7fc4f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/4182111655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4f4102570 0x7fc4f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/4182111655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4100e20 0x7fc4f4101200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 -- 172.21.15.81:0/4182111655 >> 172.21.15.81:0/4182111655 conn(0x7fc4f40fc7d0 msgr2=0x7fc4f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 -- 172.21.15.81:0/4182111655 shutdown_connections 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.365+0000 7fc4f99b1640 1 -- 172.21.15.81:0/4182111655 wait complete. 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 Processor -- start 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 -- start start 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f4100e20 0x7fc4f41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4f4102570 0x7fc4f41999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4102ef0 0x7fc4f41a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4111100 con 0x7fc4f4102ef0 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4110f80 con 0x7fc4f4102570 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f99b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f4111280 con 0x7fc4f4100e20 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4102ef0 0x7fc4f41a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4102ef0 0x7fc4f41a4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35060/0 (socket says 172.21.15.81:35060) 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 -- 172.21.15.81:0/3145236292 learned_addr learned my addr 172.21.15.81:0/3145236292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f2ffd640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f4100e20 0x7fc4f41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f27fc640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4f4102570 0x7fc4f41999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 -- 172.21.15.81:0/3145236292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f4100e20 msgr2=0x7fc4f41994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc4f4100e20 0x7fc4f41994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 -- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4f4102570 msgr2=0x7fc4f41999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4f4102570 0x7fc4f41999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.366+0000 7fc4f37fe640 1 -- 172.21.15.81:0/3145236292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f41a4a70 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.367+0000 7fc4f37fe640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4102ef0 0x7fc4f41a4530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00eaa0 tx=0x7fc4ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.367+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec00cdb0 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.367+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4ec004b20 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.367+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f41a4c40 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.367+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec011760 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.367+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41a5180 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.368+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4f4062940 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.369+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc4ec004cd0 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.369+0000 7fc4f89af640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc4dc0a2c90 0x7fc4dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f2ffd640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc4dc0a2c90 0x7fc4dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc4ec0cf720 con 0x7fc4f4102ef0 2024-09-12T12:15:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f89af640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] conn(0x7fc4dc0ac740 0x7fc4dc0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 --> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4ec014ec0 con 0x7fc4dc0ac740 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fc4ec0cfc00 con 0x7fc4f4102ef0 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f2ffd640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc4dc0a2c90 0x7fc4dc0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005ab0 tx=0x7fc4e4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.370+0000 7fc4f27fc640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] conn(0x7fc4dc0ac740 0x7fc4dc0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.371+0000 7fc4f27fc640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] conn(0x7fc4dc0ac740 0x7fc4dc0aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.371+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== osd.1 v2:172.21.15.103:6800/2968403799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4ec014ec0 con 0x7fc4dc0ac740 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.385+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 --> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4f4062dc0 con 0x7fc4dc0ac740 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.385+0000 7fc4f89af640 1 -- 172.21.15.81:0/3145236292 <== osd.1 v2:172.21.15.103:6800/2968403799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc4f4062dc0 con 0x7fc4dc0ac740 2024-09-12T12:15:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] conn(0x7fc4dc0ac740 msgr2=0x7fc4dc0aebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] conn(0x7fc4dc0ac740 0x7fc4dc0aebe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc4dc0a2c90 msgr2=0x7fc4dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc4dc0a2c90 0x7fc4dc0a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4005ab0 tx=0x7fc4e4005a20 comp rx=0 tx=0).stop 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4102ef0 msgr2=0x7fc4f41a4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 --2- 172.21.15.81:0/3145236292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4f4102ef0 0x7fc4f41a4530 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00eaa0 tx=0x7fc4ec00ef60 comp rx=0 tx=0).stop 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f37fe640 1 -- 172.21.15.81:0/3145236292 reap_dead start 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 shutdown_connections 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 >> 172.21.15.81:0/3145236292 conn(0x7fc4f40fc7d0 msgr2=0x7fc4f4105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 shutdown_connections 2024-09-12T12:15:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:22.386+0000 7fc4f99b1640 1 -- 172.21.15.81:0/3145236292 wait complete. 2024-09-12T12:15:23.343 INFO:teuthology.orchestra.run.smithi081.stdout:176093659183 2024-09-12T12:15:23.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T12:15:23.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:23 smithi081 ceph-mon[30948]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-12T12:15:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 -- 172.21.15.81:0/2620019147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430102ef0 msgr2=0x7fc43010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 --2- 172.21.15.81:0/2620019147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430102ef0 0x7fc43010da40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc428009ca0 tx=0x7fc42802a950 comp rx=0 tx=0).stop 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 -- 172.21.15.81:0/2620019147 shutdown_connections 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 --2- 172.21.15.81:0/2620019147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430102ef0 0x7fc43010da40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 --2- 172.21.15.81:0/2620019147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102570 0x7fc4301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 --2- 172.21.15.81:0/2620019147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430100e20 0x7fc430101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 -- 172.21.15.81:0/2620019147 >> 172.21.15.81:0/2620019147 conn(0x7fc4300fc7d0 msgr2=0x7fc4300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 -- 172.21.15.81:0/2620019147 shutdown_connections 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.559+0000 7fc435f71640 1 -- 172.21.15.81:0/2620019147 wait complete. 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 Processor -- start 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 -- start start 2024-09-12T12:15:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 0x7fc4301970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430102570 0x7fc4301975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102ef0 0x7fc430197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4301110a0 con 0x7fc430100e20 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc430110f20 con 0x7fc430102ef0 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc435f71640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc430111220 con 0x7fc430102570 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 0x7fc4301970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 0x7fc4301970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35088/0 (socket says 172.21.15.81:35088) 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc42f7fe640 1 -- 172.21.15.81:0/3406995082 learned_addr learned my addr 172.21.15.81:0/3406995082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc42ffff640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102ef0 0x7fc430197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.560+0000 7fc42effd640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430102570 0x7fc4301975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42f7fe640 1 -- 172.21.15.81:0/3406995082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430102570 msgr2=0x7fc4301975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42f7fe640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430102570 0x7fc4301975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42f7fe640 1 -- 172.21.15.81:0/3406995082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102ef0 msgr2=0x7fc430197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42f7fe640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102ef0 0x7fc430197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42f7fe640 1 -- 172.21.15.81:0/3406995082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4301a6910 con 0x7fc430100e20 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42ffff640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102ef0 0x7fc430197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42f7fe640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 0x7fc4301970a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c920 tx=0x7fc42000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420007c70 con 0x7fc430100e20 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc420007e10 con 0x7fc430100e20 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4301a6c00 con 0x7fc430100e20 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420018940 con 0x7fc430100e20 2024-09-12T12:15:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.561+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301a7140 con 0x7fc430100e20 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.562+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc430101200 con 0x7fc430100e20 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.563+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc420018b00 con 0x7fc430100e20 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.564+0000 7fc42cff9640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc41c0a2c10 0x7fc41c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.564+0000 7fc42effd640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc41c0a2c10 0x7fc41c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.564+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc4200cf550 con 0x7fc430100e20 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.564+0000 7fc42effd640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc41c0a2c10 0x7fc41c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc430199200 tx=0x7fc41800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.567+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc420014030 con 0x7fc430100e20 2024-09-12T12:15:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.752+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc43006a5a0 con 0x7fc430100e20 2024-09-12T12:15:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.752+0000 7fc42cff9640 1 -- 172.21.15.81:0/3406995082 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc43006a5a0 con 0x7fc430100e20 2024-09-12T12:15:23.753 INFO:teuthology.orchestra.run.smithi081.stdout:146028888116 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc41c0a2c10 msgr2=0x7fc41c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc41c0a2c10 0x7fc41c0a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc430199200 tx=0x7fc41800a4c0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 msgr2=0x7fc4301970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 0x7fc4301970a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c920 tx=0x7fc42000cde0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 shutdown_connections 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc41c0a2c10 0x7fc41c0a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc430102ef0 0x7fc430197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430102570 0x7fc4301975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 --2- 172.21.15.81:0/3406995082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc430100e20 0x7fc4301970a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.754+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 >> 172.21.15.81:0/3406995082 conn(0x7fc4300fc7d0 msgr2=0x7fc4300fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.755+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 shutdown_connections 2024-09-12T12:15:23.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:23.755+0000 7fc435f71640 1 -- 172.21.15.81:0/3406995082 wait complete. 2024-09-12T12:15:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:23 smithi173 ceph-mon[35326]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-12T12:15:23.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:23 smithi103 ceph-mon[35094]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-12T12:15:24.132 INFO:teuthology.orchestra.run.smithi081.stdout:128849018935 2024-09-12T12:15:24.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T12:15:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:51539607624 2024-09-12T12:15:24.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T12:15:24.658 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:24.784 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:24 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3406995082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:15:24.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:24 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3406995082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:15:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:24.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:24 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3406995082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T12:15:25.335 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:25.338 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:25.370 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888114 got 146028888116 for osd.5 2024-09-12T12:15:25.370 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:25.454 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:25.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:25 smithi081 ceph-mon[30948]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T12:15:25.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:25 smithi173 ceph-mon[35326]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T12:15:25.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:25 smithi103 ceph-mon[35094]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-12T12:15:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 -- 172.21.15.81:0/2315805649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c100e20 msgr2=0x7efc5c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 --2- 172.21.15.81:0/2315805649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c100e20 0x7efc5c101200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009900 tx=0x7efc4c02a480 comp rx=0 tx=0).stop 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 -- 172.21.15.81:0/2315805649 shutdown_connections 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 --2- 172.21.15.81:0/2315805649 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102ef0 0x7efc5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 --2- 172.21.15.81:0/2315805649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc5c102570 0x7efc5c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 --2- 172.21.15.81:0/2315805649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c100e20 0x7efc5c101200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 -- 172.21.15.81:0/2315805649 >> 172.21.15.81:0/2315805649 conn(0x7efc5c0fc7d0 msgr2=0x7efc5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 -- 172.21.15.81:0/2315805649 shutdown_connections 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.350+0000 7efc61202640 1 -- 172.21.15.81:0/2315805649 wait complete. 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 Processor -- start 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 -- start start 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc5c100e20 0x7efc5c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102570 0x7efc5c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 0x7efc5c1a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1110e0 con 0x7efc5c102ef0 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c110f60 con 0x7efc5c100e20 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc61202640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c111260 con 0x7efc5c102570 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc5b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 0x7efc5c1a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc5b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 0x7efc5c1a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35104/0 (socket says 172.21.15.81:35104) 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.351+0000 7efc5b59e640 1 -- 172.21.15.81:0/2238778300 learned_addr learned my addr 172.21.15.81:0/2238778300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5ad9d640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc5c100e20 0x7efc5c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5a59c640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102570 0x7efc5c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5b59e640 1 -- 172.21.15.81:0/2238778300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102570 msgr2=0x7efc5c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5b59e640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102570 0x7efc5c199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5b59e640 1 -- 172.21.15.81:0/2238778300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc5c100e20 msgr2=0x7efc5c199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5b59e640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc5c100e20 0x7efc5c199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5b59e640 1 -- 172.21.15.81:0/2238778300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c1a4a10 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5a59c640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102570 0x7efc5c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc5b59e640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 0x7efc5c1a44d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efc5400b970 tx=0x7efc5400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54019070 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5c1a4be0 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc5400cb40 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54007700 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.352+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5c1a50f0 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.353+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5c101200 con 0x7efc5c102ef0 2024-09-12T12:15:26.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.354+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efc5401c070 con 0x7efc5c102ef0 2024-09-12T12:15:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.355+0000 7efc43fff640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efc440a2c10 0x7efc440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.355+0000 7efc5ad9d640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efc440a2c10 0x7efc440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.355+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7efc540ce9b0 con 0x7efc5c102ef0 2024-09-12T12:15:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.355+0000 7efc5ad9d640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efc440a2c10 0x7efc440a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009230 tx=0x7efc4c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.358+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc5409b370 con 0x7efc5c102ef0 2024-09-12T12:15:26.385 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:26.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.532+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7efc5c1a5380 con 0x7efc5c102ef0 2024-09-12T12:15:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.532+0000 7efc43fff640 1 -- 172.21.15.81:0/2238778300 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efc5409f670 con 0x7efc5c102ef0 2024-09-12T12:15:26.533 INFO:teuthology.orchestra.run.smithi081.stdout:253403070497 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.534+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efc440a2c10 msgr2=0x7efc440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.534+0000 7efc61202640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efc440a2c10 0x7efc440a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009230 tx=0x7efc4c0058d0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.534+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 msgr2=0x7efc5c1a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.534+0000 7efc61202640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 0x7efc5c1a44d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efc5400b970 tx=0x7efc5400be30 comp rx=0 tx=0).stop 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 shutdown_connections 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7efc440a2c10 0x7efc440a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc5c102ef0 0x7efc5c1a44d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc5c102570 0x7efc5c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 --2- 172.21.15.81:0/2238778300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc5c100e20 0x7efc5c199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 >> 172.21.15.81:0/2238778300 conn(0x7efc5c0fc7d0 msgr2=0x7efc5c1057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 shutdown_connections 2024-09-12T12:15:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.535+0000 7efc61202640 1 -- 172.21.15.81:0/2238778300 wait complete. 2024-09-12T12:15:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 -- 172.21.15.81:0/57214107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 msgr2=0x7f6100106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 --2- 172.21.15.81:0/57214107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f6100106e40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009930 tx=0x7f60f002a420 comp rx=0 tx=0).stop 2024-09-12T12:15:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 -- 172.21.15.81:0/57214107 shutdown_connections 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 --2- 172.21.15.81:0/57214107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6100101400 0x7f610010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 --2- 172.21.15.81:0/57214107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100100a60 0x7f6100100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 --2- 172.21.15.81:0/57214107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f6100106e40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 -- 172.21.15.81:0/57214107 >> 172.21.15.81:0/57214107 conn(0x7f61000fc780 msgr2=0x7f61000feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 -- 172.21.15.81:0/57214107 shutdown_connections 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.588+0000 7f6105b95640 1 -- 172.21.15.81:0/57214107 wait complete. 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 Processor -- start 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 -- start start 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6100100a60 0x7f6100197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100101400 0x7f61001979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f610019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6100110fc0 con 0x7f6100106a60 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6100110e40 con 0x7f6100101400 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.589+0000 7f6105b95640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6100111140 con 0x7f6100100a60 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f610019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f610019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35132/0 (socket says 172.21.15.81:35132) 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 -- 172.21.15.81:0/2095534948 learned_addr learned my addr 172.21.15.81:0/2095534948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60ff7fe640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6100100a60 0x7f6100197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60feffd640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100101400 0x7f61001979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 -- 172.21.15.81:0/2095534948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6100100a60 msgr2=0x7f6100197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6100100a60 0x7f6100197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 -- 172.21.15.81:0/2095534948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100101400 msgr2=0x7f61001979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100101400 0x7f61001979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 -- 172.21.15.81:0/2095534948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610019c410 con 0x7f6100106a60 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60feffd640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100101400 0x7f61001979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fffff640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f610019bd30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f60f800db90 tx=0x7f60f800dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f800e980 con 0x7f6100106a60 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f60f800eb20 con 0x7f6100106a60 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610019c6a0 con 0x7f6100106a60 2024-09-12T12:15:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8016760 con 0x7f6100106a60 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.590+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610006a790 con 0x7f6100106a60 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.591+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61001021a0 con 0x7f6100106a60 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.593+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f60f8016920 con 0x7f6100106a60 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.593+0000 7f60fcff9640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60e80a2c90 0x7f60e80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.594+0000 7f60ff7fe640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60e80a2c90 0x7f60e80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.594+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f60f80d09f0 con 0x7f6100106a60 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.594+0000 7f60ff7fe640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60e80a2c90 0x7f60e80a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000c00 tx=0x7f60f00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:26.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.597+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60f809da00 con 0x7f6100106a60 2024-09-12T12:15:26.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.767+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f610006b1b0 con 0x7f6100106a60 2024-09-12T12:15:26.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.767+0000 7f60fcff9640 1 -- 172.21.15.81:0/2095534948 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f60f809d300 con 0x7f6100106a60 2024-09-12T12:15:26.768 INFO:teuthology.orchestra.run.smithi081.stdout:34359738446 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60e80a2c90 msgr2=0x7f60e80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60e80a2c90 0x7f60e80a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000c00 tx=0x7f60f00095f0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 msgr2=0x7f610019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f610019bd30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f60f800db90 tx=0x7f60f800dc80 comp rx=0 tx=0).stop 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 shutdown_connections 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f60e80a2c90 0x7f60e80a5150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100106a60 0x7f610019bd30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6100101400 0x7f61001979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 --2- 172.21.15.81:0/2095534948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6100100a60 0x7f6100197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:26.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.769+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 >> 172.21.15.81:0/2095534948 conn(0x7f61000fc780 msgr2=0x7f61000fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:26.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.770+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 shutdown_connections 2024-09-12T12:15:26.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:26.770+0000 7f6105b95640 1 -- 172.21.15.81:0/2095534948 wait complete. 2024-09-12T12:15:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 -- 172.21.15.81:0/2248507306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 msgr2=0x7f7d8c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 --2- 172.21.15.81:0/2248507306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c10ea90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009ca0 tx=0x7f7d8402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 -- 172.21.15.81:0/2248507306 shutdown_connections 2024-09-12T12:15:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 --2- 172.21.15.81:0/2248507306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c10ea90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 --2- 172.21.15.81:0/2248507306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c102790 0x7f7d8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 --2- 172.21.15.81:0/2248507306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c101de0 0x7f7d8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 -- 172.21.15.81:0/2248507306 >> 172.21.15.81:0/2248507306 conn(0x7f7d8c0fd8c0 msgr2=0x7f7d8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 -- 172.21.15.81:0/2248507306 shutdown_connections 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.005+0000 7f7d937df640 1 -- 172.21.15.81:0/2248507306 wait complete. 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 Processor -- start 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 -- start start 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c101de0 0x7f7d8c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c102790 0x7f7d8c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c1120d0 con 0x7f7d8c106f10 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c111f50 con 0x7f7d8c102790 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d937df640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c112250 con 0x7f7d8c101de0 2024-09-12T12:15:27.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35148/0 (socket says 172.21.15.81:35148) 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 -- 172.21.15.81:0/3977060150 learned_addr learned my addr 172.21.15.81:0/3977060150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d9157b640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c101de0 0x7f7d8c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d90d7a640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c102790 0x7f7d8c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 -- 172.21.15.81:0/3977060150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c101de0 msgr2=0x7f7d8c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c101de0 0x7f7d8c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 -- 172.21.15.81:0/3977060150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c102790 msgr2=0x7f7d8c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c102790 0x7f7d8c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d91d7c640 1 -- 172.21.15.81:0/3977060150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c19d440 con 0x7f7d8c106f10 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.006+0000 7f7d9157b640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c101de0 0x7f7d8c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.007+0000 7f7d91d7c640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c19cd60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009dc0 tx=0x7f7d84031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.007+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8402fba0 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.007+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d8402fd40 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.007+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c19d6d0 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.007+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84046a70 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.007+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c1a5010 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.008+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c1021c0 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.009+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7d840305c0 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.009+0000 7f7d827fc640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7d780a2c10 0x7f7d780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.010+0000 7f7d9157b640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7d780a2c10 0x7f7d780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.010+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f7d840f0760 con 0x7f7d8c106f10 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.010+0000 7f7d9157b640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7d780a2c10 0x7f7d780a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009930 tx=0x7f7d88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.013+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d840bd6f0 con 0x7f7d8c106f10 2024-09-12T12:15:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.187+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7d8c1a5240 con 0x7f7d8c106f10 2024-09-12T12:15:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.187+0000 7f7d827fc640 1 -- 172.21.15.81:0/3977060150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7d840bcff0 con 0x7f7d8c106f10 2024-09-12T12:15:27.188 INFO:teuthology.orchestra.run.smithi081.stdout:176093659184 2024-09-12T12:15:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7d780a2c10 msgr2=0x7f7d780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7d780a2c10 0x7f7d780a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009930 tx=0x7f7d88008040 comp rx=0 tx=0).stop 2024-09-12T12:15:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 msgr2=0x7f7d8c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c19cd60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009dc0 tx=0x7f7d84031b10 comp rx=0 tx=0).stop 2024-09-12T12:15:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 shutdown_connections 2024-09-12T12:15:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7d780a2c10 0x7f7d780a50d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d8c106f10 0x7f7d8c19cd60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d8c102790 0x7f7d8c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 --2- 172.21.15.81:0/3977060150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d8c101de0 0x7f7d8c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 >> 172.21.15.81:0/3977060150 conn(0x7f7d8c0fd8c0 msgr2=0x7f7d8c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:27.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 shutdown_connections 2024-09-12T12:15:27.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:27.190+0000 7f7d937df640 1 -- 172.21.15.81:0/3977060150 wait complete. 2024-09-12T12:15:27.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:27 smithi081 ceph-mon[30948]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:27 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2238778300' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:15:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:27 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2095534948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:15:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:27 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3977060150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:15:27.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:27 smithi173 ceph-mon[35326]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:27.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:27 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2238778300' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:15:27.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:27 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2095534948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:15:27.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:27 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3977060150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:15:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:27 smithi103 ceph-mon[35094]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:27 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2238778300' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T12:15:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:27 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2095534948' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T12:15:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:27 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3977060150' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T12:15:28.036 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659183 got 176093659184 for osd.6 2024-09-12T12:15:28.036 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:28.206 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:28.627 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738446 for osd.0 2024-09-12T12:15:28.627 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.223+0000 7f2654b03640 1 -- 172.21.15.81:0/1356975181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650106a80 msgr2=0x7f2650106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.223+0000 7f2654b03640 1 --2- 172.21.15.81:0/1356975181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650106a80 0x7f2650106e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2640009930 tx=0x7f264002a420 comp rx=0 tx=0).stop 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.223+0000 7f2654b03640 1 -- 172.21.15.81:0/1356975181 shutdown_connections 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.223+0000 7f2654b03640 1 --2- 172.21.15.81:0/1356975181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2650101420 0x7f265010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.223+0000 7f2654b03640 1 --2- 172.21.15.81:0/1356975181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2650100a80 0x7f2650100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.223+0000 7f2654b03640 1 --2- 172.21.15.81:0/1356975181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650106a80 0x7f2650106e60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.224+0000 7f2654b03640 1 -- 172.21.15.81:0/1356975181 >> 172.21.15.81:0/1356975181 conn(0x7f26500fc7a0 msgr2=0x7f26500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.224+0000 7f2654b03640 1 -- 172.21.15.81:0/1356975181 shutdown_connections 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.224+0000 7f2654b03640 1 -- 172.21.15.81:0/1356975181 wait complete. 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.224+0000 7f2654b03640 1 Processor -- start 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 -- start start 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2650100a80 0x7f2650198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 0x7f2650198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2650106a80 0x7f265019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2650110f60 con 0x7f2650101420 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2650110de0 con 0x7f2650100a80 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2654b03640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f26501110e0 con 0x7f2650106a80 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 0x7f2650198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 0x7f2650198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35160/0 (socket says 172.21.15.81:35160) 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 -- 172.21.15.81:0/679757173 learned_addr learned my addr 172.21.15.81:0/679757173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f264e59c640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2650100a80 0x7f2650198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 -- 172.21.15.81:0/679757173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2650106a80 msgr2=0x7f265019cde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2650106a80 0x7f265019cde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 -- 172.21.15.81:0/679757173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2650100a80 msgr2=0x7f2650198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2650100a80 0x7f2650198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 -- 172.21.15.81:0/679757173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265019d4c0 con 0x7f2650101420 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.225+0000 7f2645d9b640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 0x7f2650198a50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f263800c920 tx=0x7f263800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.226+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638007c70 con 0x7f2650101420 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.226+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2638007e10 con 0x7f2650101420 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.226+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265019d7b0 con 0x7f2650101420 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.226+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638018940 con 0x7f2650101420 2024-09-12T12:15:29.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.226+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501a5090 con 0x7f2650101420 2024-09-12T12:15:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.227+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2650100ee0 con 0x7f2650101420 2024-09-12T12:15:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.228+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2638018b20 con 0x7f2650101420 2024-09-12T12:15:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.229+0000 7f2647fff640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f263c0a2c10 0x7f263c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.229+0000 7f264e59c640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f263c0a2c10 0x7f263c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.229+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f26380cf250 con 0x7f2650101420 2024-09-12T12:15:29.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.229+0000 7f264e59c640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f263c0a2c10 0x7f263c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2640009900 tx=0x7f26400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.233+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2638014030 con 0x7f2650101420 2024-09-12T12:15:29.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.410+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f265010a000 con 0x7f2650101420 2024-09-12T12:15:29.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.410+0000 7f2647fff640 1 -- 172.21.15.81:0/679757173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f263809c150 con 0x7f2650101420 2024-09-12T12:15:29.411 INFO:teuthology.orchestra.run.smithi081.stdout:193273528363 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f263c0a2c10 msgr2=0x7f263c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f263c0a2c10 0x7f263c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2640009900 tx=0x7f26400058d0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 msgr2=0x7f2650198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 0x7f2650198a50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f263800c920 tx=0x7f263800cde0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 shutdown_connections 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f263c0a2c10 0x7f263c0a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2650106a80 0x7f265019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2650101420 0x7f2650198a50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 --2- 172.21.15.81:0/679757173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2650100a80 0x7f2650198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 >> 172.21.15.81:0/679757173 conn(0x7f26500fc7a0 msgr2=0x7f265006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.412+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 shutdown_connections 2024-09-12T12:15:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.413+0000 7f2654b03640 1 -- 172.21.15.81:0/679757173 wait complete. 2024-09-12T12:15:29.474 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:29 smithi081 ceph-mon[30948]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:29.474 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:29 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/679757173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:15:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 -- 172.21.15.81:0/2999630638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 msgr2=0x7ff06010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 --2- 172.21.15.81:0/2999630638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff06010da40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff058009ca0 tx=0x7ff05802a950 comp rx=0 tx=0).stop 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 -- 172.21.15.81:0/2999630638 shutdown_connections 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 --2- 172.21.15.81:0/2999630638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff06010da40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 --2- 172.21.15.81:0/2999630638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff060102570 0x7ff0601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 --2- 172.21.15.81:0/2999630638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff060100e20 0x7ff060101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 -- 172.21.15.81:0/2999630638 >> 172.21.15.81:0/2999630638 conn(0x7ff0600fc7d0 msgr2=0x7ff0600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 -- 172.21.15.81:0/2999630638 shutdown_connections 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.470+0000 7ff064ecc640 1 -- 172.21.15.81:0/2999630638 wait complete. 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 Processor -- start 2024-09-12T12:15:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 -- start start 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff060100e20 0x7ff0600fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff060102570 0x7ff0600fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff0600fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0601110a0 con 0x7ff060102ef0 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff060110f20 con 0x7ff060100e20 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff064ecc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff060111220 con 0x7ff060102570 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff0600fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff0600fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35172/0 (socket says 172.21.15.81:35172) 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 -- 172.21.15.81:0/1358140361 learned_addr learned my addr 172.21.15.81:0/1358140361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff055d9b640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff060102570 0x7ff0600fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05e59c640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff060100e20 0x7ff0600fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 -- 172.21.15.81:0/1358140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff060102570 msgr2=0x7ff0600fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff060102570 0x7ff0600fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 -- 172.21.15.81:0/1358140361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff060100e20 msgr2=0x7ff0600fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff060100e20 0x7ff0600fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.471+0000 7ff05ed9d640 1 -- 172.21.15.81:0/1358140361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0601a6a20 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.472+0000 7ff05ed9d640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff0600fd700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff058005cc0 tx=0x7ff05802f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.472+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058034040 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.472+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff058030940 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.472+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0601a6cb0 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.472+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058045480 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.472+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0601a7190 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.473+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff060101200 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.474+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff058037020 con 0x7ff060102ef0 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.475+0000 7ff057fff640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff04c0a2c10 0x7ff04c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.475+0000 7ff05e59c640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff04c0a2c10 0x7ff04c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:29.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.475+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7ff0580f0020 con 0x7ff060102ef0 2024-09-12T12:15:29.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.476+0000 7ff05e59c640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff04c0a2c10 0x7ff04c0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff050009b60 tx=0x7ff050005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:29.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.479+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff0580bd030 con 0x7ff060102ef0 2024-09-12T12:15:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.650+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff06010a0a0 con 0x7ff060102ef0 2024-09-12T12:15:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.651+0000 7ff057fff640 1 -- 172.21.15.81:0/1358140361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0580bc930 con 0x7ff060102ef0 2024-09-12T12:15:29.651 INFO:teuthology.orchestra.run.smithi081.stdout:73014444100 2024-09-12T12:15:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff04c0a2c10 msgr2=0x7ff04c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff04c0a2c10 0x7ff04c0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff050009b60 tx=0x7ff050005f90 comp rx=0 tx=0).stop 2024-09-12T12:15:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 msgr2=0x7ff0600fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff0600fd700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff058005cc0 tx=0x7ff05802f720 comp rx=0 tx=0).stop 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 shutdown_connections 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff04c0a2c10 0x7ff04c0a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff060102ef0 0x7ff0600fd700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff060102570 0x7ff0600fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 --2- 172.21.15.81:0/1358140361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff060100e20 0x7ff0600fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 >> 172.21.15.81:0/1358140361 conn(0x7ff0600fc7d0 msgr2=0x7ff06006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 shutdown_connections 2024-09-12T12:15:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:29.653+0000 7ff064ecc640 1 -- 172.21.15.81:0/1358140361 wait complete. 2024-09-12T12:15:29.737 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:29 smithi103 ceph-mon[35094]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:29.738 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:29 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/679757173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:15:29.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:29 smithi173 ceph-mon[35326]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:29.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:29 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/679757173' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T12:15:30.270 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444097 got 73014444100 for osd.2 2024-09-12T12:15:30.270 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:30.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:30 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1358140361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:15:30.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528360 got 193273528363 for osd.7 2024-09-12T12:15:30.884 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:30.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:30 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1358140361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:15:30.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:30 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1358140361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T12:15:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.093+0000 7f47e7a65640 1 -- 172.21.15.81:0/3603907695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e0101df0 msgr2=0x7f47e01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.093+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3603907695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e0101df0 0x7f47e01021d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009900 tx=0x7f47dc02a410 comp rx=0 tx=0).stop 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.093+0000 7f47e7a65640 1 -- 172.21.15.81:0/3603907695 shutdown_connections 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.093+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3603907695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47e0106f20 0x7f47e010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.093+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3603907695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e01027a0 0x7f47e01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.093+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3603907695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e0101df0 0x7f47e01021d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 -- 172.21.15.81:0/3603907695 >> 172.21.15.81:0/3603907695 conn(0x7f47e00fd8f0 msgr2=0x7f47e00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 -- 172.21.15.81:0/3603907695 shutdown_connections 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 -- 172.21.15.81:0/3603907695 wait complete. 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 Processor -- start 2024-09-12T12:15:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 -- start start 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47e0101df0 0x7f47e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 0x7f47e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.094+0000 7f47e7a65640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e0106f20 0x7f47e0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e7a65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47e01120a0 con 0x7f47e01027a0 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e7a65640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f47e0111f20 con 0x7f47e0101df0 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e7a65640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f47e0112220 con 0x7f47e0106f20 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 0x7f47e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 0x7f47e0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35194/0 (socket says 172.21.15.81:35194) 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 -- 172.21.15.81:0/3354584168 learned_addr learned my addr 172.21.15.81:0/3354584168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5801640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47e0101df0 0x7f47e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e6002640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e0106f20 0x7f47e0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 -- 172.21.15.81:0/3354584168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e0106f20 msgr2=0x7f47e0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e0106f20 0x7f47e0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 -- 172.21.15.81:0/3354584168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47e0101df0 msgr2=0x7f47e00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47e0101df0 0x7f47e00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 -- 172.21.15.81:0/3354584168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e01a6a80 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e5000640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 0x7f47e0074a30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47d000e9f0 tx=0x7f47d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d000cd80 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e01a6d70 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47d0005520 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0010690 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.095+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e01a7200 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.096+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e01021d0 con 0x7f47e01027a0 2024-09-12T12:15:31.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.097+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f47d00046c0 con 0x7f47e01027a0 2024-09-12T12:15:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.098+0000 7f47d67fc640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f47cc0a2c10 0x7f47cc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.098+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f47d00cf4e0 con 0x7f47e01027a0 2024-09-12T12:15:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.098+0000 7f47e5801640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f47cc0a2c10 0x7f47cc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.099+0000 7f47e5801640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f47cc0a2c10 0x7f47cc0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009230 tx=0x7f47dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.102+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47d009c3e0 con 0x7f47e01027a0 2024-09-12T12:15:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:31.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.291+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f47e0109b70 con 0x7f47e01027a0 2024-09-12T12:15:31.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.291+0000 7f47d67fc640 1 -- 172.21.15.81:0/3354584168 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47d009bce0 con 0x7f47e01027a0 2024-09-12T12:15:31.291 INFO:teuthology.orchestra.run.smithi081.stdout:98784247871 2024-09-12T12:15:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f47cc0a2c10 msgr2=0x7f47cc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f47cc0a2c10 0x7f47cc0a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009230 tx=0x7f47dc0058d0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 msgr2=0x7f47e0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 0x7f47e0074a30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47d000e9f0 tx=0x7f47d000edf0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 shutdown_connections 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f47cc0a2c10 0x7f47cc0a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47e0106f20 0x7f47e0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47e01027a0 0x7f47e0074a30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 --2- 172.21.15.81:0/3354584168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47e0101df0 0x7f47e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 >> 172.21.15.81:0/3354584168 conn(0x7f47e00fd8f0 msgr2=0x7f47e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 shutdown_connections 2024-09-12T12:15:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:31.293+0000 7f47e7a65640 1 -- 172.21.15.81:0/3354584168 wait complete. 2024-09-12T12:15:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:31 smithi081 ceph-mon[30948]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:31 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:31 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3354584168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:15:31.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:31 smithi173 ceph-mon[35326]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:31.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:31 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:31.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:31 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3354584168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:15:31.747 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:31 smithi103 ceph-mon[35094]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:31.747 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:31 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:15:31.747 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:31 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3354584168' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T12:15:31.945 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247871 for osd.3 2024-09-12T12:15:31.945 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 -- 172.21.15.81:0/338712364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 msgr2=0x7f53101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 --2- 172.21.15.81:0/338712364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f53101029b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5304009900 tx=0x7f530402a480 comp rx=0 tx=0).stop 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 -- 172.21.15.81:0/338712364 shutdown_connections 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 --2- 172.21.15.81:0/338712364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5310102ef0 0x7f531010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 --2- 172.21.15.81:0/338712364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f53101029b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 --2- 172.21.15.81:0/338712364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5310100e20 0x7f5310101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 -- 172.21.15.81:0/338712364 >> 172.21.15.81:0/338712364 conn(0x7f53100fc7d0 msgr2=0x7f53100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 -- 172.21.15.81:0/338712364 shutdown_connections 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.470+0000 7f531525d640 1 -- 172.21.15.81:0/338712364 wait complete. 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 Processor -- start 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 -- start start 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5310100e20 0x7f5310198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f5310198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5310102ef0 0x7f531019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53101110a0 con 0x7f5310102570 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5310110f20 con 0x7f5310100e20 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f531525d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5310111220 con 0x7f5310102ef0 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f530e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f5310198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f530e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f5310198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47490/0 (socket says 172.21.15.81:47490) 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f530e59c640 1 -- 172.21.15.81:0/1331445938 learned_addr learned my addr 172.21.15.81:0/1331445938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.471+0000 7f530f59e640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5310102ef0 0x7f531019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530ed9d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5310100e20 0x7f5310198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530e59c640 1 -- 172.21.15.81:0/1331445938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5310102ef0 msgr2=0x7f531019cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530e59c640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5310102ef0 0x7f531019cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530e59c640 1 -- 172.21.15.81:0/1331445938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5310100e20 msgr2=0x7f5310198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530e59c640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5310100e20 0x7f5310198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530e59c640 1 -- 172.21.15.81:0/1331445938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531019d5e0 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f530e59c640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f5310198b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5304006010 tx=0x7f5304004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530403f030 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5304005500 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304035070 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531019d870 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.472+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101a51b0 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.473+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53101021b0 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.475+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5304042030 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.475+0000 7f52f7fff640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f52f80a2c10 0x7f52f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.475+0000 7f530ed9d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f52f80a2c10 0x7f52f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.475+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f5304004740 con 0x7f5310102570 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.476+0000 7f530ed9d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f52f80a2c10 0x7f52f80a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f530000bbe0 tx=0x7f530000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.480+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53040bc3d0 con 0x7f5310102570 2024-09-12T12:15:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.654+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f531010a0a0 con 0x7f5310102570 2024-09-12T12:15:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.654+0000 7f52f7fff640 1 -- 172.21.15.81:0/1331445938 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f53040c06d0 con 0x7f5310102570 2024-09-12T12:15:32.655 INFO:teuthology.orchestra.run.smithi081.stdout:274877906974 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.656+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f52f80a2c10 msgr2=0x7f52f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.656+0000 7f531525d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f52f80a2c10 0x7f52f80a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f530000bbe0 tx=0x7f530000b390 comp rx=0 tx=0).stop 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.656+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 msgr2=0x7f5310198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.656+0000 7f531525d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f5310198b70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5304006010 tx=0x7f5304004c00 comp rx=0 tx=0).stop 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 shutdown_connections 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f52f80a2c10 0x7f52f80a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5310102ef0 0x7f531019cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5310102570 0x7f5310198b70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 --2- 172.21.15.81:0/1331445938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5310100e20 0x7f5310198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 >> 172.21.15.81:0/1331445938 conn(0x7f53100fc7d0 msgr2=0x7f531006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 shutdown_connections 2024-09-12T12:15:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:32.657+0000 7f531525d640 1 -- 172.21.15.81:0/1331445938 wait complete. 2024-09-12T12:15:33.372 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906971 got 274877906974 for osd.10 2024-09-12T12:15:33.373 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 -- 172.21.15.81:0/3544719201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 msgr2=0x7f6848101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3544719201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f6848101200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6838009900 tx=0x7f683802a480 comp rx=0 tx=0).stop 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 -- 172.21.15.81:0/3544719201 shutdown_connections 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3544719201 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 0x7f684810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3544719201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6848102570 0x7f68481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3544719201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f6848101200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 -- 172.21.15.81:0/3544719201 >> 172.21.15.81:0/3544719201 conn(0x7f68480fc7d0 msgr2=0x7f68480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 -- 172.21.15.81:0/3544719201 shutdown_connections 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 -- 172.21.15.81:0/3544719201 wait complete. 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 Processor -- start 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.544+0000 7f684e7c4640 1 -- start start 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f68481985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6848102570 0x7f6848198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 0x7f684819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68481121e0 con 0x7f6848100e20 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6848112060 con 0x7f6848102570 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6848112360 con 0x7f6848102ef0 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f68481985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f68481985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47518/0 (socket says 172.21.15.81:47518) 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 -- 172.21.15.81:0/3545210334 learned_addr learned my addr 172.21.15.81:0/3545210334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684cd61640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 0x7f684819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 -- 172.21.15.81:0/3545210334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 msgr2=0x7f684819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 0x7f684819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 -- 172.21.15.81:0/3545210334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6848102570 msgr2=0x7f6848198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6848102570 0x7f6848198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 -- 172.21.15.81:0/3545210334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684819d590 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684cd61640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 0x7f684819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f6847fff640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f68481985e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6838006010 tx=0x7f6838004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683803f030 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684819d820 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6838005500 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838035070 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.545+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68481a5160 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.547+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6848101200 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.548+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6838042030 con 0x7f6848100e20 2024-09-12T12:15:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.548+0000 7f68457fa640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f68300a2c10 0x7f68300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:33.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.548+0000 7f68477fe640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f68300a2c10 0x7f68300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:33.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.548+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f68380ef7b0 con 0x7f6848100e20 2024-09-12T12:15:33.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.549+0000 7f68477fe640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f68300a2c10 0x7f68300a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68480fed30 tx=0x7f683c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:33.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.552+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68380bc6b0 con 0x7f6848100e20 2024-09-12T12:15:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:33 smithi081 ceph-mon[30948]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:33.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:33 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:33 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1331445938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:15:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:33 smithi103 ceph-mon[35094]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:33 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:33 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1331445938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:15:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.723+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f68481a5330 con 0x7f6848100e20 2024-09-12T12:15:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.723+0000 7f68457fa640 1 -- 172.21.15.81:0/3545210334 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f68380bbfb0 con 0x7f6848100e20 2024-09-12T12:15:33.723 INFO:teuthology.orchestra.run.smithi081.stdout:223338299431 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.725+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f68300a2c10 msgr2=0x7f68300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.725+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f68300a2c10 0x7f68300a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68480fed30 tx=0x7f683c005c70 comp rx=0 tx=0).stop 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.725+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 msgr2=0x7f68481985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.725+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f68481985e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6838006010 tx=0x7f6838004c00 comp rx=0 tx=0).stop 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 shutdown_connections 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f68300a2c10 0x7f68300a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6848102ef0 0x7f684819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6848102570 0x7f6848198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 --2- 172.21.15.81:0/3545210334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6848100e20 0x7f68481985e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 >> 172.21.15.81:0/3545210334 conn(0x7f68480fc7d0 msgr2=0x7f68481057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 shutdown_connections 2024-09-12T12:15:33.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:33.726+0000 7f684e7c4640 1 -- 172.21.15.81:0/3545210334 wait complete. 2024-09-12T12:15:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:33 smithi173 ceph-mon[35326]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:33 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:33.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:33 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1331445938' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T12:15:34.028 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070495 got 253403070497 for osd.9 2024-09-12T12:15:34.028 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:34.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 -- 172.21.15.81:0/3054382907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 msgr2=0x7f771c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 --2- 172.21.15.81:0/3054382907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c1029b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7704009900 tx=0x7f770402a480 comp rx=0 tx=0).stop 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 -- 172.21.15.81:0/3054382907 shutdown_connections 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 --2- 172.21.15.81:0/3054382907 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f771c102ef0 0x7f771c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 --2- 172.21.15.81:0/3054382907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c1029b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 --2- 172.21.15.81:0/3054382907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c100e20 0x7f771c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 -- 172.21.15.81:0/3054382907 >> 172.21.15.81:0/3054382907 conn(0x7f771c0fc7d0 msgr2=0x7f771c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 -- 172.21.15.81:0/3054382907 shutdown_connections 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.198+0000 7f7721c18640 1 -- 172.21.15.81:0/3054382907 wait complete. 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 Processor -- start 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 -- start start 2024-09-12T12:15:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f771c100e20 0x7f771c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c102ef0 0x7f771c1a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1110f0 con 0x7f771c102570 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f771c110f70 con 0x7f771c100e20 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7721c18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f771c111270 con 0x7f771c102ef0 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47540/0 (socket says 172.21.15.81:47540) 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 -- 172.21.15.81:0/2232366314 learned_addr learned my addr 172.21.15.81:0/2232366314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f771b7fe640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f771c100e20 0x7f771c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f771bfff640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c102ef0 0x7f771c1a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 -- 172.21.15.81:0/2232366314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c102ef0 msgr2=0x7f771c1a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c102ef0 0x7f771c1a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 -- 172.21.15.81:0/2232366314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f771c100e20 msgr2=0x7f771c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f771c100e20 0x7f771c199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f7713fff640 1 -- 172.21.15.81:0/2232366314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c1a49c0 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.199+0000 7f771bfff640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c102ef0 0x7f771c1a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.200+0000 7f7713fff640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c199940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7704004770 tx=0x7f7704031470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.200+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770403f070 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.200+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c1a4b90 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.200+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7704005510 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.200+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704035030 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.200+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a5040 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.201+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c101200 con 0x7f771c102570 2024-09-12T12:15:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.202+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7704042070 con 0x7f771c102570 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.202+0000 7f77197fa640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f77080a2c10 0x7f77080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.203+0000 7f771b7fe640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f77080a2c10 0x7f77080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.203+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f77040efc20 con 0x7f771c102570 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.203+0000 7f771b7fe640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f77080a2c10 0x7f77080a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.207+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f77040bcb20 con 0x7f771c102570 2024-09-12T12:15:34.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.379+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f771c1a5210 con 0x7f771c102570 2024-09-12T12:15:34.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.380+0000 7f77197fa640 1 -- 172.21.15.81:0/2232366314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77040bc420 con 0x7f771c102570 2024-09-12T12:15:34.380 INFO:teuthology.orchestra.run.smithi081.stdout:128849018938 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f77080a2c10 msgr2=0x7f77080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f77080a2c10 0x7f77080a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c00b390 comp rx=0 tx=0).stop 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 msgr2=0x7f771c199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c199940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7704004770 tx=0x7f7704031470 comp rx=0 tx=0).stop 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 shutdown_connections 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f77080a2c10 0x7f77080a50d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f771c102ef0 0x7f771c1a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f771c102570 0x7f771c199940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 --2- 172.21.15.81:0/2232366314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f771c100e20 0x7f771c199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 >> 172.21.15.81:0/2232366314 conn(0x7f771c0fc7d0 msgr2=0x7f771c106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 shutdown_connections 2024-09-12T12:15:34.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.382+0000 7f7721c18640 1 -- 172.21.15.81:0/2232366314 wait complete. 2024-09-12T12:15:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 -- 172.21.15.81:0/1971635828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4358102d30 msgr2=0x7f4358103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 --2- 172.21.15.81:0/1971635828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4358102d30 0x7f4358103110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4348009900 tx=0x7f434802a480 comp rx=0 tx=0).stop 2024-09-12T12:15:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 -- 172.21.15.81:0/1971635828 shutdown_connections 2024-09-12T12:15:34.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 --2- 172.21.15.81:0/1971635828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f435810c160 0x7f435810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 --2- 172.21.15.81:0/1971635828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 0x7f435810bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 --2- 172.21.15.81:0/1971635828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4358102d30 0x7f4358103110 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 -- 172.21.15.81:0/1971635828 >> 172.21.15.81:0/1971635828 conn(0x7f43580fc790 msgr2=0x7f43580febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 -- 172.21.15.81:0/1971635828 shutdown_connections 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.421+0000 7f435d139640 1 -- 172.21.15.81:0/1971635828 wait complete. 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.422+0000 7f435d139640 1 Processor -- start 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.422+0000 7f435d139640 1 -- start start 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.422+0000 7f435d139640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4358102d30 0x7f4358198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 0x7f4358198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 0x7f435819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4358112080 con 0x7f435810c160 2024-09-12T12:15:34.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4358111f00 con 0x7f4358102d30 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4358112200 con 0x7f4358103650 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 0x7f435819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 0x7f435819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47550/0 (socket says 172.21.15.81:47550) 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 -- 172.21.15.81:0/3721871089 learned_addr learned my addr 172.21.15.81:0/3721871089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f4356d9d640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4358102d30 0x7f4358198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f434e59c640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 0x7f4358198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 -- 172.21.15.81:0/3721871089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 msgr2=0x7f4358198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 0x7f4358198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 -- 172.21.15.81:0/3721871089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4358102d30 msgr2=0x7f4358198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4358102d30 0x7f4358198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 -- 172.21.15.81:0/3721871089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435819d530 con 0x7f435810c160 2024-09-12T12:15:34.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f434e59c640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 0x7f4358198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435759e640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 0x7f435819ce50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f435000eaa0 tx=0x7f435000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435000cdb0 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4350004b20 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435819d820 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4350011760 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.423+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43581a5100 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.424+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4358103110 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.426+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4350011900 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.426+0000 7f4354d99640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f43440a2c10 0x7f43440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.427+0000 7f4356d9d640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f43440a2c10 0x7f43440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.427+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f43500cf6f0 con 0x7f435810c160 2024-09-12T12:15:34.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.427+0000 7f4356d9d640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f43440a2c10 0x7f43440a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4348009230 tx=0x7f43480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:34.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.430+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4350016030 con 0x7f435810c160 2024-09-12T12:15:34.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.603+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f43581998e0 con 0x7f435810c160 2024-09-12T12:15:34.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:34 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3545210334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:15:34.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:34 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2232366314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:15:34.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.603+0000 7f4354d99640 1 -- 172.21.15.81:0/3721871089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f43581998e0 con 0x7f435810c160 2024-09-12T12:15:34.604 INFO:teuthology.orchestra.run.smithi081.stdout:304942678041 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f43440a2c10 msgr2=0x7f43440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f43440a2c10 0x7f43440a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4348009230 tx=0x7f43480058d0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 msgr2=0x7f435819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 0x7f435819ce50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f435000eaa0 tx=0x7f435000ef60 comp rx=0 tx=0).stop 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 shutdown_connections 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f43440a2c10 0x7f43440a50d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f435810c160 0x7f435819ce50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4358103650 0x7f4358198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 --2- 172.21.15.81:0/3721871089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4358102d30 0x7f4358198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.605+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 >> 172.21.15.81:0/3721871089 conn(0x7f43580fc790 msgr2=0x7f43580fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:34.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.606+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 shutdown_connections 2024-09-12T12:15:34.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:34.606+0000 7f435d139640 1 -- 172.21.15.81:0/3721871089 wait complete. 2024-09-12T12:15:34.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:34 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3545210334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:15:34.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:34 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2232366314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:15:34.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:34 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3545210334' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T12:15:34.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:34 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2232366314' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T12:15:35.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299428 got 223338299431 for osd.8 2024-09-12T12:15:35.320 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:35.560 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:35.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:35 smithi081 ceph-mon[30948]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-12T12:15:35.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:35 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3721871089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:15:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:35 smithi173 ceph-mon[35326]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-12T12:15:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:35 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3721871089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:15:35.928 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678037 got 304942678041 for osd.11 2024-09-12T12:15:35.928 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:35 smithi103 ceph-mon[35094]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-09-12T12:15:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:35 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3721871089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T12:15:36.686 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018935 got 128849018938 for osd.4 2024-09-12T12:15:36.686 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:36.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 -- 172.21.15.81:0/2288696784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 msgr2=0x7fca5410df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 --2- 172.21.15.81:0/2288696784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca5410df10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009900 tx=0x7fca3c02a480 comp rx=0 tx=0).stop 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 -- 172.21.15.81:0/2288696784 shutdown_connections 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 --2- 172.21.15.81:0/2288696784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 0x7fca54110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 --2- 172.21.15.81:0/2288696784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca5410df10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 --2- 172.21.15.81:0/2288696784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54074510 0x7fca540748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 -- 172.21.15.81:0/2288696784 >> 172.21.15.81:0/2288696784 conn(0x7fca540fd8f0 msgr2=0x7fca540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 -- 172.21.15.81:0/2288696784 shutdown_connections 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.360+0000 7fca5981e640 1 -- 172.21.15.81:0/2288696784 wait complete. 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 Processor -- start 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 -- start start 2024-09-12T12:15:36.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54074510 0x7fca541a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca541a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 0x7fca5419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca541142a0 con 0x7fca54074e30 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca54114120 con 0x7fca5410e450 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca5981e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca54114420 con 0x7fca54074510 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca527fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca541a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca527fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca541a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47562/0 (socket says 172.21.15.81:47562) 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.361+0000 7fca527fc640 1 -- 172.21.15.81:0/1174623177 learned_addr learned my addr 172.21.15.81:0/1174623177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca537fe640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 0x7fca5419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca527fc640 1 -- 172.21.15.81:0/1174623177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54074510 msgr2=0x7fca541a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca527fc640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54074510 0x7fca541a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stdout:51539607627 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca527fc640 1 -- 172.21.15.81:0/1174623177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 msgr2=0x7fca5419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca527fc640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 0x7fca5419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca527fc640 1 -- 172.21.15.81:0/1174623177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5419acc0 con 0x7fca54074e30 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca537fe640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 0x7fca5419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca527fc640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca541a0910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca3c006010 tx=0x7fca3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c03f030 con 0x7fca54074e30 2024-09-12T12:15:36.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5419af50 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca3c003d00 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c035070 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.362+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541a72a0 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.363+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca540748f0 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.364+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fca3c042030 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.365+0000 7fca5881c640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca400a2c10 0x7fca400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.365+0000 7fca52ffd640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca400a2c10 0x7fca400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.365+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fca3c0efa20 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.365+0000 7fca52ffd640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca400a2c10 0x7fca400a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a8f0 tx=0x7fca44005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.368+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca3c0bc9e0 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.540+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fca541095d0 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.541+0000 7fca5881c640 1 -- 172.21.15.81:0/1174623177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca3c0bc2e0 con 0x7fca54074e30 2024-09-12T12:15:36.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.542+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca400a2c10 msgr2=0x7fca400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.542+0000 7fca5981e640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca400a2c10 0x7fca400a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a8f0 tx=0x7fca44005bf0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 msgr2=0x7fca541a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca541a0910 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fca3c006010 tx=0x7fca3c0042f0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 shutdown_connections 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca400a2c10 0x7fca400a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca5410e450 0x7fca5419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca54074e30 0x7fca541a0910 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 --2- 172.21.15.81:0/1174623177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca54074510 0x7fca541a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 >> 172.21.15.81:0/1174623177 conn(0x7fca540fd8f0 msgr2=0x7fca540fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 shutdown_connections 2024-09-12T12:15:36.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:36.543+0000 7fca5981e640 1 -- 172.21.15.81:0/1174623177 wait complete. 2024-09-12T12:15:37.456 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607624 got 51539607627 for osd.1 2024-09-12T12:15:37.456 DEBUG:teuthology.parallel:result is None 2024-09-12T12:15:37.456 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:15:37.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:15:37.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:37 smithi081 ceph-mon[30948]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-12T12:15:37.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:37 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1174623177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:15:37.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:37 smithi173 ceph-mon[35326]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-12T12:15:37.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:37 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1174623177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:15:37.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:37 smithi103 ceph-mon[35094]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-12T12:15:37.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:37 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1174623177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T12:15:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 -- 172.21.15.81:0/4027271743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 msgr2=0x7f3bd81067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/4027271743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81067d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009900 tx=0x7f3bc002a410 comp rx=0 tx=0).stop 2024-09-12T12:15:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 -- 172.21.15.81:0/4027271743 shutdown_connections 2024-09-12T12:15:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/4027271743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8106f00 0x7f3bd810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/4027271743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81067d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/4027271743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 0x7f3bd81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 -- 172.21.15.81:0/4027271743 >> 172.21.15.81:0/4027271743 conn(0x7f3bd80fd8b0 msgr2=0x7f3bd80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 -- 172.21.15.81:0/4027271743 shutdown_connections 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.663+0000 7f3bdd90d640 1 -- 172.21.15.81:0/4027271743 wait complete. 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 Processor -- start 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 -- start start 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 0x7f3bd8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8106f00 0x7f3bd819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8112080 con 0x7f3bd8102780 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8111f00 con 0x7f3bd8101dd0 2024-09-12T12:15:38.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bdd90d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8112200 con 0x7f3bd8106f00 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bce7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bce7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47590/0 (socket says 172.21.15.81:47590) 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bce7fc640 1 -- 172.21.15.81:0/2073957969 learned_addr learned my addr 172.21.15.81:0/2073957969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bd6ffd640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 0x7f3bd8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.664+0000 7f3bd77fe640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8106f00 0x7f3bd819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bce7fc640 1 -- 172.21.15.81:0/2073957969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8106f00 msgr2=0x7f3bd819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bce7fc640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8106f00 0x7f3bd819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bce7fc640 1 -- 172.21.15.81:0/2073957969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 msgr2=0x7f3bd8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bce7fc640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 0x7f3bd8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bce7fc640 1 -- 172.21.15.81:0/2073957969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd819d430 con 0x7f3bd8102780 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bd6ffd640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 0x7f3bd8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:38.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bce7fc640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81989c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0006010 tx=0x7f3bc00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc003f030 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3bc0003d00 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0035070 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd819d6c0 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.665+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd819db50 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.666+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd81021b0 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.667+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3bc0042030 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.668+0000 7f3bdc90b640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3bc40a2c10 0x7f3bc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.668+0000 7f3bd6ffd640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3bc40a2c10 0x7f3bc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.668+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f3bc00ef6b0 con 0x7f3bd8102780 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.668+0000 7f3bd6ffd640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3bc40a2c10 0x7f3bc40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800abe0 tx=0x7f3bc800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:38.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.672+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3bc00bc670 con 0x7f3bd8102780 2024-09-12T12:15:38.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.868+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bd8062630 con 0x7f3bc40a2c10 2024-09-12T12:15:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.875+0000 7f3bdc90b640 1 -- 172.21.15.81:0/2073957969 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258757 (secure 0 0 0) 0x7f3bd8062630 con 0x7f3bc40a2c10 2024-09-12T12:15:38.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:15:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3bc40a2c10 msgr2=0x7f3bc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3bc40a2c10 0x7f3bc40a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800abe0 tx=0x7f3bc800a5c0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 msgr2=0x7f3bd81989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81989c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0006010 tx=0x7f3bc00042f0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 shutdown_connections 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3bc40a2c10 0x7f3bc40a50d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8106f00 0x7f3bd819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bd8102780 0x7f3bd81989c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 --2- 172.21.15.81:0/2073957969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bd8101dd0 0x7f3bd8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 >> 172.21.15.81:0/2073957969 conn(0x7f3bd80fd8b0 msgr2=0x7f3bd80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 shutdown_connections 2024-09-12T12:15:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:38.879+0000 7f3bdd90d640 1 -- 172.21.15.81:0/2073957969 wait complete. 2024-09-12T12:15:39.573 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:39 smithi081 ceph-mon[30948]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:39.573 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:39.574 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:39 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:39.602 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-12T12:15:38.348701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657574,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":666,"num_read_kb":460,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365780,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576044,"statfs":{"total":1151940427776,"available":1151565869056,"internally_reserved":0,"allocated":12644352,"data_stored":7036926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002600"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224002+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:14:50.224002+0000","last_peered":"2024-09-12T12:14:50.224002+0000","last_clean":"2024-09-12T12:14:50.224002+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:14:50.224002+0000","last_undegraded":"2024-09-12T12:14:50.224002+0000","last_fullsized":"2024-09-12T12:14:50.224002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223690+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:14:50.223690+0000","last_peered":"2024-09-12T12:14:50.223690+0000","last_clean":"2024-09-12T12:14:50.223690+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:14:50.223690+0000","last_undegraded":"2024-09-12T12:14:50.223690+0000","last_fullsized":"2024-09-12T12:14:50.223690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223645+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:14:50.223645+0000","last_peered":"2024-09-12T12:14:50.223645+0000","last_clean":"2024-09-12T12:14:50.223645+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:14:50.223645+0000","last_undegraded":"2024-09-12T12:14:50.223645+0000","last_fullsized":"2024-09-12T12:14:50.223645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.229646+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:14:50.229646+0000","last_peered":"2024-09-12T12:14:50.229646+0000","last_clean":"2024-09-12T12:14:50.229646+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:14:50.229646+0000","last_undegraded":"2024-09-12T12:14:50.229646+0000","last_fullsized":"2024-09-12T12:14:50.229646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226394+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:14:50.226394+0000","last_peered":"2024-09-12T12:14:50.226394+0000","last_clean":"2024-09-12T12:14:50.226394+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:14:50.226394+0000","last_undegraded":"2024-09-12T12:14:50.226394+0000","last_fullsized":"2024-09-12T12:14:50.226394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231616+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:14:50.231616+0000","last_peered":"2024-09-12T12:14:50.231616+0000","last_clean":"2024-09-12T12:14:50.231616+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:14:50.231616+0000","last_undegraded":"2024-09-12T12:14:50.231616+0000","last_fullsized":"2024-09-12T12:14:50.231616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225581+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:14:50.225581+0000","last_peered":"2024-09-12T12:14:50.225581+0000","last_clean":"2024-09-12T12:14:50.225581+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:14:50.225581+0000","last_undegraded":"2024-09-12T12:14:50.225581+0000","last_fullsized":"2024-09-12T12:14:50.225581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280008+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:14:50.280008+0000","last_peered":"2024-09-12T12:14:50.280008+0000","last_clean":"2024-09-12T12:14:50.280008+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:14:50.280008+0000","last_undegraded":"2024-09-12T12:14:50.280008+0000","last_fullsized":"2024-09-12T12:14:50.280008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219580+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:14:50.219580+0000","last_peered":"2024-09-12T12:14:50.219580+0000","last_clean":"2024-09-12T12:14:50.219580+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:14:50.219580+0000","last_undegraded":"2024-09-12T12:14:50.219580+0000","last_fullsized":"2024-09-12T12:14:50.219580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232075+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:14:50.232075+0000","last_peered":"2024-09-12T12:14:50.232075+0000","last_clean":"2024-09-12T12:14:50.232075+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:14:50.232075+0000","last_undegraded":"2024-09-12T12:14:50.232075+0000","last_fullsized":"2024-09-12T12:14:50.232075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225959+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:14:50.225959+0000","last_peered":"2024-09-12T12:14:50.225959+0000","last_clean":"2024-09-12T12:14:50.225959+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:14:50.225959+0000","last_undegraded":"2024-09-12T12:14:50.225959+0000","last_fullsized":"2024-09-12T12:14:50.225959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231338+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:14:50.231338+0000","last_peered":"2024-09-12T12:14:50.231338+0000","last_clean":"2024-09-12T12:14:50.231338+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:14:50.231338+0000","last_undegraded":"2024-09-12T12:14:50.231338+0000","last_fullsized":"2024-09-12T12:14:50.231338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219034+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:14:50.219034+0000","last_peered":"2024-09-12T12:14:50.219034+0000","last_clean":"2024-09-12T12:14:50.219034+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:14:50.219034+0000","last_undegraded":"2024-09-12T12:14:50.219034+0000","last_fullsized":"2024-09-12T12:14:50.219034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223267+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:14:50.223267+0000","last_peered":"2024-09-12T12:14:50.223267+0000","last_clean":"2024-09-12T12:14:50.223267+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:14:50.223267+0000","last_undegraded":"2024-09-12T12:14:50.223267+0000","last_fullsized":"2024-09-12T12:14:50.223267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223261+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:14:50.223261+0000","last_peered":"2024-09-12T12:14:50.223261+0000","last_clean":"2024-09-12T12:14:50.223261+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:14:50.223261+0000","last_undegraded":"2024-09-12T12:14:50.223261+0000","last_fullsized":"2024-09-12T12:14:50.223261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218950+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:14:50.218950+0000","last_peered":"2024-09-12T12:14:50.218950+0000","last_clean":"2024-09-12T12:14:50.218950+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:14:50.218950+0000","last_undegraded":"2024-09-12T12:14:50.218950+0000","last_fullsized":"2024-09-12T12:14:50.218950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224014+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:14:50.224014+0000","last_peered":"2024-09-12T12:14:50.224014+0000","last_clean":"2024-09-12T12:14:50.224014+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:14:50.224014+0000","last_undegraded":"2024-09-12T12:14:50.224014+0000","last_fullsized":"2024-09-12T12:14:50.224014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221508+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:14:50.221508+0000","last_peered":"2024-09-12T12:14:50.221508+0000","last_clean":"2024-09-12T12:14:50.221508+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:14:50.221508+0000","last_undegraded":"2024-09-12T12:14:50.221508+0000","last_fullsized":"2024-09-12T12:14:50.221508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228040+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:14:50.228040+0000","last_peered":"2024-09-12T12:14:50.228040+0000","last_clean":"2024-09-12T12:14:50.228040+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:14:50.228040+0000","last_undegraded":"2024-09-12T12:14:50.228040+0000","last_fullsized":"2024-09-12T12:14:50.228040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223932+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:14:50.223932+0000","last_peered":"2024-09-12T12:14:50.223932+0000","last_clean":"2024-09-12T12:14:50.223932+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:14:50.223932+0000","last_undegraded":"2024-09-12T12:14:50.223932+0000","last_fullsized":"2024-09-12T12:14:50.223932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219135+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:14:50.219135+0000","last_peered":"2024-09-12T12:14:50.219135+0000","last_clean":"2024-09-12T12:14:50.219135+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:14:50.219135+0000","last_undegraded":"2024-09-12T12:14:50.219135+0000","last_fullsized":"2024-09-12T12:14:50.219135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219137+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:14:50.219137+0000","last_peered":"2024-09-12T12:14:50.219137+0000","last_clean":"2024-09-12T12:14:50.219137+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:14:50.219137+0000","last_undegraded":"2024-09-12T12:14:50.219137+0000","last_fullsized":"2024-09-12T12:14:50.219137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280034+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:14:50.280034+0000","last_peered":"2024-09-12T12:14:50.280034+0000","last_clean":"2024-09-12T12:14:50.280034+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:14:50.280034+0000","last_undegraded":"2024-09-12T12:14:50.280034+0000","last_fullsized":"2024-09-12T12:14:50.280034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219819+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:14:50.219819+0000","last_peered":"2024-09-12T12:14:50.219819+0000","last_clean":"2024-09-12T12:14:50.219819+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:14:50.219819+0000","last_undegraded":"2024-09-12T12:14:50.219819+0000","last_fullsized":"2024-09-12T12:14:50.219819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280337+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:14:50.280337+0000","last_peered":"2024-09-12T12:14:50.280337+0000","last_clean":"2024-09-12T12:14:50.280337+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:14:50.280337+0000","last_undegraded":"2024-09-12T12:14:50.280337+0000","last_fullsized":"2024-09-12T12:14:50.280337+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227056+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:14:50.227056+0000","last_peered":"2024-09-12T12:14:50.227056+0000","last_clean":"2024-09-12T12:14:50.227056+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:14:50.227056+0000","last_undegraded":"2024-09-12T12:14:50.227056+0000","last_fullsized":"2024-09-12T12:14:50.227056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223841+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:14:50.223841+0000","last_peered":"2024-09-12T12:14:50.223841+0000","last_clean":"2024-09-12T12:14:50.223841+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:14:50.223841+0000","last_undegraded":"2024-09-12T12:14:50.223841+0000","last_fullsized":"2024-09-12T12:14:50.223841+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219032+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:14:50.219032+0000","last_peered":"2024-09-12T12:14:50.219032+0000","last_clean":"2024-09-12T12:14:50.219032+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:14:50.219032+0000","last_undegraded":"2024-09-12T12:14:50.219032+0000","last_fullsized":"2024-09-12T12:14:50.219032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223581+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:14:50.223581+0000","last_peered":"2024-09-12T12:14:50.223581+0000","last_clean":"2024-09-12T12:14:50.223581+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:14:50.223581+0000","last_undegraded":"2024-09-12T12:14:50.223581+0000","last_fullsized":"2024-09-12T12:14:50.223581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226653+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:14:50.226653+0000","last_peered":"2024-09-12T12:14:50.226653+0000","last_clean":"2024-09-12T12:14:50.226653+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:14:50.226653+0000","last_undegraded":"2024-09-12T12:14:50.226653+0000","last_fullsized":"2024-09-12T12:14:50.226653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226504+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:14:50.226504+0000","last_peered":"2024-09-12T12:14:50.226504+0000","last_clean":"2024-09-12T12:14:50.226504+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:14:50.226504+0000","last_undegraded":"2024-09-12T12:14:50.226504+0000","last_fullsized":"2024-09-12T12:14:50.226504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223567+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:14:50.223567+0000","last_peered":"2024-09-12T12:14:50.223567+0000","last_clean":"2024-09-12T12:14:50.223567+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:14:50.223567+0000","last_undegraded":"2024-09-12T12:14:50.223567+0000","last_fullsized":"2024-09-12T12:14:50.223567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226671+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:14:50.226671+0000","last_peered":"2024-09-12T12:14:50.226671+0000","last_clean":"2024-09-12T12:14:50.226671+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:14:50.226671+0000","last_undegraded":"2024-09-12T12:14:50.226671+0000","last_fullsized":"2024-09-12T12:14:50.226671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":78,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:32.286951+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:15:32.286951+0000","last_peered":"2024-09-12T12:15:32.286951+0000","last_clean":"2024-09-12T12:15:32.286951+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:15:32.286951+0000","last_undegraded":"2024-09-12T12:15:32.286951+0000","last_fullsized":"2024-09-12T12:15:32.286951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220157+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:14:50.220157+0000","last_peered":"2024-09-12T12:14:50.220157+0000","last_clean":"2024-09-12T12:14:50.220157+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:14:50.220157+0000","last_undegraded":"2024-09-12T12:14:50.220157+0000","last_fullsized":"2024-09-12T12:14:50.220157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231906+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:14:50.231906+0000","last_peered":"2024-09-12T12:14:50.231906+0000","last_clean":"2024-09-12T12:14:50.231906+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:14:50.231906+0000","last_undegraded":"2024-09-12T12:14:50.231906+0000","last_fullsized":"2024-09-12T12:14:50.231906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218706+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:14:50.218706+0000","last_peered":"2024-09-12T12:14:50.218706+0000","last_clean":"2024-09-12T12:14:50.218706+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:14:50.218706+0000","last_undegraded":"2024-09-12T12:14:50.218706+0000","last_fullsized":"2024-09-12T12:14:50.218706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280070+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:14:50.280070+0000","last_peered":"2024-09-12T12:14:50.280070+0000","last_clean":"2024-09-12T12:14:50.280070+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:14:50.280070+0000","last_undegraded":"2024-09-12T12:14:50.280070+0000","last_fullsized":"2024-09-12T12:14:50.280070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220009+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:14:50.220009+0000","last_peered":"2024-09-12T12:14:50.220009+0000","last_clean":"2024-09-12T12:14:50.220009+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:14:50.220009+0000","last_undegraded":"2024-09-12T12:14:50.220009+0000","last_fullsized":"2024-09-12T12:14:50.220009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221222+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:14:50.221222+0000","last_peered":"2024-09-12T12:14:50.221222+0000","last_clean":"2024-09-12T12:14:50.221222+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:14:50.221222+0000","last_undegraded":"2024-09-12T12:14:50.221222+0000","last_fullsized":"2024-09-12T12:14:50.221222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:36.293150+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:15:36.293150+0000","last_peered":"2024-09-12T12:15:36.293150+0000","last_clean":"2024-09-12T12:15:36.293150+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:15:36.293150+0000","last_undegraded":"2024-09-12T12:15:36.293150+0000","last_fullsized":"2024-09-12T12:15:36.293150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219468+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:14:50.219468+0000","last_peered":"2024-09-12T12:14:50.219468+0000","last_clean":"2024-09-12T12:14:50.219468+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:14:50.219468+0000","last_undegraded":"2024-09-12T12:14:50.219468+0000","last_fullsized":"2024-09-12T12:14:50.219468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225933+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:14:50.225933+0000","last_peered":"2024-09-12T12:14:50.225933+0000","last_clean":"2024-09-12T12:14:50.225933+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:14:50.225933+0000","last_undegraded":"2024-09-12T12:14:50.225933+0000","last_fullsized":"2024-09-12T12:14:50.225933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223934+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:14:50.223934+0000","last_peered":"2024-09-12T12:14:50.223934+0000","last_clean":"2024-09-12T12:14:50.223934+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:14:50.223934+0000","last_undegraded":"2024-09-12T12:14:50.223934+0000","last_fullsized":"2024-09-12T12:14:50.223934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220510+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:14:50.220510+0000","last_peered":"2024-09-12T12:14:50.220510+0000","last_clean":"2024-09-12T12:14:50.220510+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:14:50.220510+0000","last_undegraded":"2024-09-12T12:14:50.220510+0000","last_fullsized":"2024-09-12T12:14:50.220510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228850+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:14:50.228850+0000","last_peered":"2024-09-12T12:14:50.228850+0000","last_clean":"2024-09-12T12:14:50.228850+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:14:50.228850+0000","last_undegraded":"2024-09-12T12:14:50.228850+0000","last_fullsized":"2024-09-12T12:14:50.228850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'30","reported_seq":160,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:36.297101+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:15:36.297101+0000","last_peered":"2024-09-12T12:15:36.297101+0000","last_clean":"2024-09-12T12:15:36.297101+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:15:36.297101+0000","last_undegraded":"2024-09-12T12:15:36.297101+0000","last_fullsized":"2024-09-12T12:15:36.297101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227196+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:14:50.227196+0000","last_peered":"2024-09-12T12:14:50.227196+0000","last_clean":"2024-09-12T12:14:50.227196+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:14:50.227196+0000","last_undegraded":"2024-09-12T12:14:50.227196+0000","last_fullsized":"2024-09-12T12:14:50.227196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226197+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:14:50.226197+0000","last_peered":"2024-09-12T12:14:50.226197+0000","last_clean":"2024-09-12T12:14:50.226197+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:14:50.226197+0000","last_undegraded":"2024-09-12T12:14:50.226197+0000","last_fullsized":"2024-09-12T12:14:50.226197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218755+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:14:50.218755+0000","last_peered":"2024-09-12T12:14:50.218755+0000","last_clean":"2024-09-12T12:14:50.218755+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:14:50.218755+0000","last_undegraded":"2024-09-12T12:14:50.218755+0000","last_fullsized":"2024-09-12T12:14:50.218755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220324+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:14:50.220324+0000","last_peered":"2024-09-12T12:14:50.220324+0000","last_clean":"2024-09-12T12:14:50.220324+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:14:50.220324+0000","last_undegraded":"2024-09-12T12:14:50.220324+0000","last_fullsized":"2024-09-12T12:14:50.220324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225952+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:14:50.225952+0000","last_peered":"2024-09-12T12:14:50.225952+0000","last_clean":"2024-09-12T12:14:50.225952+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:14:50.225952+0000","last_undegraded":"2024-09-12T12:14:50.225952+0000","last_fullsized":"2024-09-12T12:14:50.225952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:33.288665+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:15:33.288665+0000","last_peered":"2024-09-12T12:15:33.288665+0000","last_clean":"2024-09-12T12:15:33.288665+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:15:33.288665+0000","last_undegraded":"2024-09-12T12:15:33.288665+0000","last_fullsized":"2024-09-12T12:15:33.288665+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225510+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:14:50.225510+0000","last_peered":"2024-09-12T12:14:50.225510+0000","last_clean":"2024-09-12T12:14:50.225510+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:14:50.225510+0000","last_undegraded":"2024-09-12T12:14:50.225510+0000","last_fullsized":"2024-09-12T12:14:50.225510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226487+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:14:50.226487+0000","last_peered":"2024-09-12T12:14:50.226487+0000","last_clean":"2024-09-12T12:14:50.226487+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:14:50.226487+0000","last_undegraded":"2024-09-12T12:14:50.226487+0000","last_fullsized":"2024-09-12T12:14:50.226487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220083+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:14:50.220083+0000","last_peered":"2024-09-12T12:14:50.220083+0000","last_clean":"2024-09-12T12:14:50.220083+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:14:50.220083+0000","last_undegraded":"2024-09-12T12:14:50.220083+0000","last_fullsized":"2024-09-12T12:14:50.220083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227405+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:14:50.227405+0000","last_peered":"2024-09-12T12:14:50.227405+0000","last_clean":"2024-09-12T12:14:50.227405+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:14:50.227405+0000","last_undegraded":"2024-09-12T12:14:50.227405+0000","last_fullsized":"2024-09-12T12:14:50.227405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223688+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:14:50.223688+0000","last_peered":"2024-09-12T12:14:50.223688+0000","last_clean":"2024-09-12T12:14:50.223688+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:14:50.223688+0000","last_undegraded":"2024-09-12T12:14:50.223688+0000","last_fullsized":"2024-09-12T12:14:50.223688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219270+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:14:50.219270+0000","last_peered":"2024-09-12T12:14:50.219270+0000","last_clean":"2024-09-12T12:14:50.219270+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:14:50.219270+0000","last_undegraded":"2024-09-12T12:14:50.219270+0000","last_fullsized":"2024-09-12T12:14:50.219270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225832+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:14:50.225832+0000","last_peered":"2024-09-12T12:14:50.225832+0000","last_clean":"2024-09-12T12:14:50.225832+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:14:50.225832+0000","last_undegraded":"2024-09-12T12:14:50.225832+0000","last_fullsized":"2024-09-12T12:14:50.225832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220411+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:14:50.220411+0000","last_peered":"2024-09-12T12:14:50.220411+0000","last_clean":"2024-09-12T12:14:50.220411+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:14:50.220411+0000","last_undegraded":"2024-09-12T12:14:50.220411+0000","last_fullsized":"2024-09-12T12:14:50.220411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225950+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:14:50.225950+0000","last_peered":"2024-09-12T12:14:50.225950+0000","last_clean":"2024-09-12T12:14:50.225950+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:14:50.225950+0000","last_undegraded":"2024-09-12T12:14:50.225950+0000","last_fullsized":"2024-09-12T12:14:50.225950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'5","reported_seq":77,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:33.315259+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:15:33.315259+0000","last_peered":"2024-09-12T12:15:33.315259+0000","last_clean":"2024-09-12T12:15:33.315259+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:15:33.315259+0000","last_undegraded":"2024-09-12T12:15:33.315259+0000","last_fullsized":"2024-09-12T12:15:33.315259+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226039+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:14:50.226039+0000","last_peered":"2024-09-12T12:14:50.226039+0000","last_clean":"2024-09-12T12:14:50.226039+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:14:50.226039+0000","last_undegraded":"2024-09-12T12:14:50.226039+0000","last_fullsized":"2024-09-12T12:14:50.226039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225717+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:14:50.225717+0000","last_peered":"2024-09-12T12:14:50.225717+0000","last_clean":"2024-09-12T12:14:50.225717+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:14:50.225717+0000","last_undegraded":"2024-09-12T12:14:50.225717+0000","last_fullsized":"2024-09-12T12:14:50.225717+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.230997+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:14:50.230997+0000","last_peered":"2024-09-12T12:14:50.230997+0000","last_clean":"2024-09-12T12:14:50.230997+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:14:50.230997+0000","last_undegraded":"2024-09-12T12:14:50.230997+0000","last_fullsized":"2024-09-12T12:14:50.230997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.222469+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:14:50.222469+0000","last_peered":"2024-09-12T12:14:50.222469+0000","last_clean":"2024-09-12T12:14:50.222469+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:14:50.222469+0000","last_undegraded":"2024-09-12T12:14:50.222469+0000","last_fullsized":"2024-09-12T12:14:50.222469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225688+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:14:50.225688+0000","last_peered":"2024-09-12T12:14:50.225688+0000","last_clean":"2024-09-12T12:14:50.225688+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:14:50.225688+0000","last_undegraded":"2024-09-12T12:14:50.225688+0000","last_fullsized":"2024-09-12T12:14:50.225688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218701+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:14:50.218701+0000","last_peered":"2024-09-12T12:14:50.218701+0000","last_clean":"2024-09-12T12:14:50.218701+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:14:50.218701+0000","last_undegraded":"2024-09-12T12:14:50.218701+0000","last_fullsized":"2024-09-12T12:14:50.218701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":76,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:33.288043+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:15:33.288043+0000","last_peered":"2024-09-12T12:15:33.288043+0000","last_clean":"2024-09-12T12:15:33.288043+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:15:33.288043+0000","last_undegraded":"2024-09-12T12:15:33.288043+0000","last_fullsized":"2024-09-12T12:15:33.288043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219869+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:14:50.219869+0000","last_peered":"2024-09-12T12:14:50.219869+0000","last_clean":"2024-09-12T12:14:50.219869+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:14:50.219869+0000","last_undegraded":"2024-09-12T12:14:50.219869+0000","last_fullsized":"2024-09-12T12:14:50.219869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:35.305825+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:15:35.305825+0000","last_peered":"2024-09-12T12:15:35.305825+0000","last_clean":"2024-09-12T12:15:35.305825+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:15:35.305825+0000","last_undegraded":"2024-09-12T12:15:35.305825+0000","last_fullsized":"2024-09-12T12:15:35.305825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231612+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:14:50.231612+0000","last_peered":"2024-09-12T12:14:50.231612+0000","last_clean":"2024-09-12T12:14:50.231612+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:14:50.231612+0000","last_undegraded":"2024-09-12T12:14:50.231612+0000","last_fullsized":"2024-09-12T12:14:50.231612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225099+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:14:50.225099+0000","last_peered":"2024-09-12T12:14:50.225099+0000","last_clean":"2024-09-12T12:14:50.225099+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:14:50.225099+0000","last_undegraded":"2024-09-12T12:14:50.225099+0000","last_fullsized":"2024-09-12T12:14:50.225099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231738+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:14:50.231738+0000","last_peered":"2024-09-12T12:14:50.231738+0000","last_clean":"2024-09-12T12:14:50.231738+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:14:50.231738+0000","last_undegraded":"2024-09-12T12:14:50.231738+0000","last_fullsized":"2024-09-12T12:14:50.231738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227316+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:14:50.227316+0000","last_peered":"2024-09-12T12:14:50.227316+0000","last_clean":"2024-09-12T12:14:50.227316+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:14:50.227316+0000","last_undegraded":"2024-09-12T12:14:50.227316+0000","last_fullsized":"2024-09-12T12:14:50.227316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219126+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:14:50.219126+0000","last_peered":"2024-09-12T12:14:50.219126+0000","last_clean":"2024-09-12T12:14:50.219126+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:14:50.219126+0000","last_undegraded":"2024-09-12T12:14:50.219126+0000","last_fullsized":"2024-09-12T12:14:50.219126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'14","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:59.389979+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:14:59.389979+0000","last_peered":"2024-09-12T12:14:59.389979+0000","last_clean":"2024-09-12T12:14:59.389979+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:14:59.389979+0000","last_undegraded":"2024-09-12T12:14:59.389979+0000","last_fullsized":"2024-09-12T12:14:59.389979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280423+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:14:50.280423+0000","last_peered":"2024-09-12T12:14:50.280423+0000","last_clean":"2024-09-12T12:14:50.280423+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:14:50.280423+0000","last_undegraded":"2024-09-12T12:14:50.280423+0000","last_fullsized":"2024-09-12T12:14:50.280423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231076+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:14:50.231076+0000","last_peered":"2024-09-12T12:14:50.231076+0000","last_clean":"2024-09-12T12:14:50.231076+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:14:50.231076+0000","last_undegraded":"2024-09-12T12:14:50.231076+0000","last_fullsized":"2024-09-12T12:14:50.231076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223746+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:14:50.223746+0000","last_peered":"2024-09-12T12:14:50.223746+0000","last_clean":"2024-09-12T12:14:50.223746+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:14:50.223746+0000","last_undegraded":"2024-09-12T12:14:50.223746+0000","last_fullsized":"2024-09-12T12:14:50.223746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219067+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:14:50.219067+0000","last_peered":"2024-09-12T12:14:50.219067+0000","last_clean":"2024-09-12T12:14:50.219067+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:14:50.219067+0000","last_undegraded":"2024-09-12T12:14:50.219067+0000","last_fullsized":"2024-09-12T12:14:50.219067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226116+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:14:50.226116+0000","last_peered":"2024-09-12T12:14:50.226116+0000","last_clean":"2024-09-12T12:14:50.226116+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:14:50.226116+0000","last_undegraded":"2024-09-12T12:14:50.226116+0000","last_fullsized":"2024-09-12T12:14:50.226116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280169+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:14:50.280169+0000","last_peered":"2024-09-12T12:14:50.280169+0000","last_clean":"2024-09-12T12:14:50.280169+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:14:50.280169+0000","last_undegraded":"2024-09-12T12:14:50.280169+0000","last_fullsized":"2024-09-12T12:14:50.280169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223582+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:14:50.223582+0000","last_peered":"2024-09-12T12:14:50.223582+0000","last_clean":"2024-09-12T12:14:50.223582+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:14:50.223582+0000","last_undegraded":"2024-09-12T12:14:50.223582+0000","last_fullsized":"2024-09-12T12:14:50.223582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226774+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:14:50.226774+0000","last_peered":"2024-09-12T12:14:50.226774+0000","last_clean":"2024-09-12T12:14:50.226774+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:14:50.226774+0000","last_undegraded":"2024-09-12T12:14:50.226774+0000","last_fullsized":"2024-09-12T12:14:50.226774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280155+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:14:50.280155+0000","last_peered":"2024-09-12T12:14:50.280155+0000","last_clean":"2024-09-12T12:14:50.280155+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:14:50.280155+0000","last_undegraded":"2024-09-12T12:14:50.280155+0000","last_fullsized":"2024-09-12T12:14:50.280155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226514+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:14:50.226514+0000","last_peered":"2024-09-12T12:14:50.226514+0000","last_clean":"2024-09-12T12:14:50.226514+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:14:50.226514+0000","last_undegraded":"2024-09-12T12:14:50.226514+0000","last_fullsized":"2024-09-12T12:14:50.226514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225702+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:14:50.225702+0000","last_peered":"2024-09-12T12:14:50.225702+0000","last_clean":"2024-09-12T12:14:50.225702+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:14:50.225702+0000","last_undegraded":"2024-09-12T12:14:50.225702+0000","last_fullsized":"2024-09-12T12:14:50.225702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232265+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:14:50.232265+0000","last_peered":"2024-09-12T12:14:50.232265+0000","last_clean":"2024-09-12T12:14:50.232265+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:14:50.232265+0000","last_undegraded":"2024-09-12T12:14:50.232265+0000","last_fullsized":"2024-09-12T12:14:50.232265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226949+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:14:50.226949+0000","last_peered":"2024-09-12T12:14:50.226949+0000","last_clean":"2024-09-12T12:14:50.226949+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:14:50.226949+0000","last_undegraded":"2024-09-12T12:14:50.226949+0000","last_fullsized":"2024-09-12T12:14:50.226949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219147+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:14:50.219147+0000","last_peered":"2024-09-12T12:14:50.219147+0000","last_clean":"2024-09-12T12:14:50.219147+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:14:50.219147+0000","last_undegraded":"2024-09-12T12:14:50.219147+0000","last_fullsized":"2024-09-12T12:14:50.219147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'12","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.241528+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:14:50.241528+0000","last_peered":"2024-09-12T12:14:50.241528+0000","last_clean":"2024-09-12T12:14:50.241528+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:14:50.241528+0000","last_undegraded":"2024-09-12T12:14:50.241528+0000","last_fullsized":"2024-09-12T12:14:50.241528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223893+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:14:50.223893+0000","last_peered":"2024-09-12T12:14:50.223893+0000","last_clean":"2024-09-12T12:14:50.223893+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:14:50.223893+0000","last_undegraded":"2024-09-12T12:14:50.223893+0000","last_fullsized":"2024-09-12T12:14:50.223893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280619+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:14:50.280619+0000","last_peered":"2024-09-12T12:14:50.280619+0000","last_clean":"2024-09-12T12:14:50.280619+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:14:50.280619+0000","last_undegraded":"2024-09-12T12:14:50.280619+0000","last_fullsized":"2024-09-12T12:14:50.280619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280520+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:14:50.280520+0000","last_peered":"2024-09-12T12:14:50.280520+0000","last_clean":"2024-09-12T12:14:50.280520+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:14:50.280520+0000","last_undegraded":"2024-09-12T12:14:50.280520+0000","last_fullsized":"2024-09-12T12:14:50.280520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'13","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:36.306615+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:15:36.306615+0000","last_peered":"2024-09-12T12:15:36.306615+0000","last_clean":"2024-09-12T12:15:36.306615+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:15:36.306615+0000","last_undegraded":"2024-09-12T12:15:36.306615+0000","last_fullsized":"2024-09-12T12:15:36.306615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66972,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":530,"num_read_kb":341,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":423209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1074002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":423139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":423517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528365,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32636,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712516,"statfs":{"total":95995035648,"available":95961616384,"internally_reserved":0,"allocated":1486848,"data_stored":1016430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":423249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1015715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":422681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":484146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":483926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":897024,"data_stored":424195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:39.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:15:39.880 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:39.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:39 smithi173 ceph-mon[35326]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:39.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:39.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:39 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:39.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:39 smithi103 ceph-mon[35094]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:39.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:39.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:39 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 -- 172.21.15.81:0/2326462398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0101420 msgr2=0x7f65e010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 --2- 172.21.15.81:0/2326462398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0101420 0x7f65e010d950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009cd0 tx=0x7f65d802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 -- 172.21.15.81:0/2326462398 shutdown_connections 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 --2- 172.21.15.81:0/2326462398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0101420 0x7f65e010d950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 --2- 172.21.15.81:0/2326462398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0100a80 0x7f65e0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 --2- 172.21.15.81:0/2326462398 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0106a80 0x7f65e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 -- 172.21.15.81:0/2326462398 >> 172.21.15.81:0/2326462398 conn(0x7f65e00fc7a0 msgr2=0x7f65e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 -- 172.21.15.81:0/2326462398 shutdown_connections 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.350+0000 7f65e686b640 1 -- 172.21.15.81:0/2326462398 wait complete. 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 Processor -- start 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 -- start start 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0100a80 0x7f65e0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0101420 0x7f65e01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 0x7f65e01a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0111060 con 0x7f65e0106a80 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f65e0110ee0 con 0x7f65e0101420 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e686b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f65e01111e0 con 0x7f65e0100a80 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e4e08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 0x7f65e01a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e4e08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 0x7f65e01a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47614/0 (socket says 172.21.15.81:47614) 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65e4e08640 1 -- 172.21.15.81:0/3002349964 learned_addr learned my addr 172.21.15.81:0/3002349964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.351+0000 7f65df7fe640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0101420 0x7f65e01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65dffff640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0100a80 0x7f65e0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e4e08640 1 -- 172.21.15.81:0/3002349964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0100a80 msgr2=0x7f65e0199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e4e08640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0100a80 0x7f65e0199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e4e08640 1 -- 172.21.15.81:0/3002349964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0101420 msgr2=0x7f65e01999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e4e08640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0101420 0x7f65e01999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e4e08640 1 -- 172.21.15.81:0/3002349964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e01a4a30 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65df7fe640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0101420 0x7f65e01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65dffff640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0100a80 0x7f65e0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e4e08640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 0x7f65e01a44f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009df0 tx=0x7f65d8032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8004240 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e01a4c00 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65d80305a0 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80466c0 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.352+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e01a5130 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.353+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e0100f60 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.354+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f65d8030750 con 0x7f65e0106a80 2024-09-12T12:15:40.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.355+0000 7f65dd7fa640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f65c80a2c10 0x7f65c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.355+0000 7f65dffff640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f65c80a2c10 0x7f65c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.355+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f65d802e030 con 0x7f65e0106a80 2024-09-12T12:15:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.355+0000 7f65dffff640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f65c80a2c10 0x7f65c80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f65d0006fd0 tx=0x7f65d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.359+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65d804b060 con 0x7f65e0106a80 2024-09-12T12:15:40.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.523+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65e0062630 con 0x7f65c80a2c10 2024-09-12T12:15:40.524 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:40 smithi081 ceph-mon[30948]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:40.524 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:15:40.524 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:15:40.525 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:40 smithi081 ceph-mon[30948]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:40.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.530+0000 7f65dd7fa640 1 -- 172.21.15.81:0/3002349964 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258757 (secure 0 0 0) 0x7f65e0062630 con 0x7f65c80a2c10 2024-09-12T12:15:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:40.534 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f65c80a2c10 msgr2=0x7f65c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f65c80a2c10 0x7f65c80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f65d0006fd0 tx=0x7f65d0008040 comp rx=0 tx=0).stop 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 msgr2=0x7f65e01a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 0x7f65e01a44f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009df0 tx=0x7f65d8032c00 comp rx=0 tx=0).stop 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 shutdown_connections 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f65c80a2c10 0x7f65c80a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65e0106a80 0x7f65e01a44f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f65e0101420 0x7f65e01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 --2- 172.21.15.81:0/3002349964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65e0100a80 0x7f65e0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 >> 172.21.15.81:0/3002349964 conn(0x7f65e00fc7a0 msgr2=0x7f65e00fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 shutdown_connections 2024-09-12T12:15:40.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:40.533+0000 7f65e686b640 1 -- 172.21.15.81:0/3002349964 wait complete. 2024-09-12T12:15:40.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:40 smithi173 ceph-mon[35326]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:40.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:15:40.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:15:40.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:40 smithi173 ceph-mon[35326]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:40.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:40 smithi103 ceph-mon[35094]: from='client.14919 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:40.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:15:40.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:15:40.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:40 smithi103 ceph-mon[35094]: from='mgr.14150 172.21.15.81:0/3225915323' entity='mgr.x' 2024-09-12T12:15:41.193 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-12T12:15:40.349194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657574,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":686,"num_read_kb":465,"num_write":425,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365780,"kb_used_data":12348,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576044,"statfs":{"total":1151940427776,"available":1151565869056,"internally_reserved":0,"allocated":12644352,"data_stored":7036926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002654"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224002+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:14:50.224002+0000","last_peered":"2024-09-12T12:14:50.224002+0000","last_clean":"2024-09-12T12:14:50.224002+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:14:50.224002+0000","last_undegraded":"2024-09-12T12:14:50.224002+0000","last_fullsized":"2024-09-12T12:14:50.224002+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223690+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:14:50.223690+0000","last_peered":"2024-09-12T12:14:50.223690+0000","last_clean":"2024-09-12T12:14:50.223690+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:14:50.223690+0000","last_undegraded":"2024-09-12T12:14:50.223690+0000","last_fullsized":"2024-09-12T12:14:50.223690+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223645+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:14:50.223645+0000","last_peered":"2024-09-12T12:14:50.223645+0000","last_clean":"2024-09-12T12:14:50.223645+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:14:50.223645+0000","last_undegraded":"2024-09-12T12:14:50.223645+0000","last_fullsized":"2024-09-12T12:14:50.223645+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.229646+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:14:50.229646+0000","last_peered":"2024-09-12T12:14:50.229646+0000","last_clean":"2024-09-12T12:14:50.229646+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:14:50.229646+0000","last_undegraded":"2024-09-12T12:14:50.229646+0000","last_fullsized":"2024-09-12T12:14:50.229646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226394+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:14:50.226394+0000","last_peered":"2024-09-12T12:14:50.226394+0000","last_clean":"2024-09-12T12:14:50.226394+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:14:50.226394+0000","last_undegraded":"2024-09-12T12:14:50.226394+0000","last_fullsized":"2024-09-12T12:14:50.226394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231616+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:14:50.231616+0000","last_peered":"2024-09-12T12:14:50.231616+0000","last_clean":"2024-09-12T12:14:50.231616+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:14:50.231616+0000","last_undegraded":"2024-09-12T12:14:50.231616+0000","last_fullsized":"2024-09-12T12:14:50.231616+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225581+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:14:50.225581+0000","last_peered":"2024-09-12T12:14:50.225581+0000","last_clean":"2024-09-12T12:14:50.225581+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:14:50.225581+0000","last_undegraded":"2024-09-12T12:14:50.225581+0000","last_fullsized":"2024-09-12T12:14:50.225581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280008+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:14:50.280008+0000","last_peered":"2024-09-12T12:14:50.280008+0000","last_clean":"2024-09-12T12:14:50.280008+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:14:50.280008+0000","last_undegraded":"2024-09-12T12:14:50.280008+0000","last_fullsized":"2024-09-12T12:14:50.280008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219580+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:14:50.219580+0000","last_peered":"2024-09-12T12:14:50.219580+0000","last_clean":"2024-09-12T12:14:50.219580+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:14:50.219580+0000","last_undegraded":"2024-09-12T12:14:50.219580+0000","last_fullsized":"2024-09-12T12:14:50.219580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232075+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:14:50.232075+0000","last_peered":"2024-09-12T12:14:50.232075+0000","last_clean":"2024-09-12T12:14:50.232075+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:14:50.232075+0000","last_undegraded":"2024-09-12T12:14:50.232075+0000","last_fullsized":"2024-09-12T12:14:50.232075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225959+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:14:50.225959+0000","last_peered":"2024-09-12T12:14:50.225959+0000","last_clean":"2024-09-12T12:14:50.225959+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:14:50.225959+0000","last_undegraded":"2024-09-12T12:14:50.225959+0000","last_fullsized":"2024-09-12T12:14:50.225959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231338+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:14:50.231338+0000","last_peered":"2024-09-12T12:14:50.231338+0000","last_clean":"2024-09-12T12:14:50.231338+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:14:50.231338+0000","last_undegraded":"2024-09-12T12:14:50.231338+0000","last_fullsized":"2024-09-12T12:14:50.231338+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219034+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:14:50.219034+0000","last_peered":"2024-09-12T12:14:50.219034+0000","last_clean":"2024-09-12T12:14:50.219034+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:14:50.219034+0000","last_undegraded":"2024-09-12T12:14:50.219034+0000","last_fullsized":"2024-09-12T12:14:50.219034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223267+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:14:50.223267+0000","last_peered":"2024-09-12T12:14:50.223267+0000","last_clean":"2024-09-12T12:14:50.223267+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:14:50.223267+0000","last_undegraded":"2024-09-12T12:14:50.223267+0000","last_fullsized":"2024-09-12T12:14:50.223267+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223261+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:14:50.223261+0000","last_peered":"2024-09-12T12:14:50.223261+0000","last_clean":"2024-09-12T12:14:50.223261+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:14:50.223261+0000","last_undegraded":"2024-09-12T12:14:50.223261+0000","last_fullsized":"2024-09-12T12:14:50.223261+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218950+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:14:50.218950+0000","last_peered":"2024-09-12T12:14:50.218950+0000","last_clean":"2024-09-12T12:14:50.218950+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:14:50.218950+0000","last_undegraded":"2024-09-12T12:14:50.218950+0000","last_fullsized":"2024-09-12T12:14:50.218950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.224014+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:14:50.224014+0000","last_peered":"2024-09-12T12:14:50.224014+0000","last_clean":"2024-09-12T12:14:50.224014+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:14:50.224014+0000","last_undegraded":"2024-09-12T12:14:50.224014+0000","last_fullsized":"2024-09-12T12:14:50.224014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221508+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:14:50.221508+0000","last_peered":"2024-09-12T12:14:50.221508+0000","last_clean":"2024-09-12T12:14:50.221508+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:14:50.221508+0000","last_undegraded":"2024-09-12T12:14:50.221508+0000","last_fullsized":"2024-09-12T12:14:50.221508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228040+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:14:50.228040+0000","last_peered":"2024-09-12T12:14:50.228040+0000","last_clean":"2024-09-12T12:14:50.228040+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:14:50.228040+0000","last_undegraded":"2024-09-12T12:14:50.228040+0000","last_fullsized":"2024-09-12T12:14:50.228040+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223932+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:14:50.223932+0000","last_peered":"2024-09-12T12:14:50.223932+0000","last_clean":"2024-09-12T12:14:50.223932+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:14:50.223932+0000","last_undegraded":"2024-09-12T12:14:50.223932+0000","last_fullsized":"2024-09-12T12:14:50.223932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219135+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:14:50.219135+0000","last_peered":"2024-09-12T12:14:50.219135+0000","last_clean":"2024-09-12T12:14:50.219135+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:14:50.219135+0000","last_undegraded":"2024-09-12T12:14:50.219135+0000","last_fullsized":"2024-09-12T12:14:50.219135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219137+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:14:50.219137+0000","last_peered":"2024-09-12T12:14:50.219137+0000","last_clean":"2024-09-12T12:14:50.219137+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:14:50.219137+0000","last_undegraded":"2024-09-12T12:14:50.219137+0000","last_fullsized":"2024-09-12T12:14:50.219137+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280034+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:14:50.280034+0000","last_peered":"2024-09-12T12:14:50.280034+0000","last_clean":"2024-09-12T12:14:50.280034+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:14:50.280034+0000","last_undegraded":"2024-09-12T12:14:50.280034+0000","last_fullsized":"2024-09-12T12:14:50.280034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219819+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:14:50.219819+0000","last_peered":"2024-09-12T12:14:50.219819+0000","last_clean":"2024-09-12T12:14:50.219819+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:14:50.219819+0000","last_undegraded":"2024-09-12T12:14:50.219819+0000","last_fullsized":"2024-09-12T12:14:50.219819+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280337+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:14:50.280337+0000","last_peered":"2024-09-12T12:14:50.280337+0000","last_clean":"2024-09-12T12:14:50.280337+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:14:50.280337+0000","last_undegraded":"2024-09-12T12:14:50.280337+0000","last_fullsized":"2024-09-12T12:14:50.280337+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227056+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:14:50.227056+0000","last_peered":"2024-09-12T12:14:50.227056+0000","last_clean":"2024-09-12T12:14:50.227056+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:14:50.227056+0000","last_undegraded":"2024-09-12T12:14:50.227056+0000","last_fullsized":"2024-09-12T12:14:50.227056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223841+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:14:50.223841+0000","last_peered":"2024-09-12T12:14:50.223841+0000","last_clean":"2024-09-12T12:14:50.223841+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:14:50.223841+0000","last_undegraded":"2024-09-12T12:14:50.223841+0000","last_fullsized":"2024-09-12T12:14:50.223841+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219032+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:14:50.219032+0000","last_peered":"2024-09-12T12:14:50.219032+0000","last_clean":"2024-09-12T12:14:50.219032+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:14:50.219032+0000","last_undegraded":"2024-09-12T12:14:50.219032+0000","last_fullsized":"2024-09-12T12:14:50.219032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223581+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:14:50.223581+0000","last_peered":"2024-09-12T12:14:50.223581+0000","last_clean":"2024-09-12T12:14:50.223581+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:14:50.223581+0000","last_undegraded":"2024-09-12T12:14:50.223581+0000","last_fullsized":"2024-09-12T12:14:50.223581+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226653+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:14:50.226653+0000","last_peered":"2024-09-12T12:14:50.226653+0000","last_clean":"2024-09-12T12:14:50.226653+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:14:50.226653+0000","last_undegraded":"2024-09-12T12:14:50.226653+0000","last_fullsized":"2024-09-12T12:14:50.226653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226504+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:14:50.226504+0000","last_peered":"2024-09-12T12:14:50.226504+0000","last_clean":"2024-09-12T12:14:50.226504+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:14:50.226504+0000","last_undegraded":"2024-09-12T12:14:50.226504+0000","last_fullsized":"2024-09-12T12:14:50.226504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223567+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:14:50.223567+0000","last_peered":"2024-09-12T12:14:50.223567+0000","last_clean":"2024-09-12T12:14:50.223567+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:14:50.223567+0000","last_undegraded":"2024-09-12T12:14:50.223567+0000","last_fullsized":"2024-09-12T12:14:50.223567+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226671+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:14:50.226671+0000","last_peered":"2024-09-12T12:14:50.226671+0000","last_clean":"2024-09-12T12:14:50.226671+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:14:50.226671+0000","last_undegraded":"2024-09-12T12:14:50.226671+0000","last_fullsized":"2024-09-12T12:14:50.226671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":83,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:37.295424+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:15:37.295424+0000","last_peered":"2024-09-12T12:15:37.295424+0000","last_clean":"2024-09-12T12:15:37.295424+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:15:37.295424+0000","last_undegraded":"2024-09-12T12:15:37.295424+0000","last_fullsized":"2024-09-12T12:15:37.295424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220157+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:14:50.220157+0000","last_peered":"2024-09-12T12:14:50.220157+0000","last_clean":"2024-09-12T12:14:50.220157+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:14:50.220157+0000","last_undegraded":"2024-09-12T12:14:50.220157+0000","last_fullsized":"2024-09-12T12:14:50.220157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231906+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:14:50.231906+0000","last_peered":"2024-09-12T12:14:50.231906+0000","last_clean":"2024-09-12T12:14:50.231906+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:14:50.231906+0000","last_undegraded":"2024-09-12T12:14:50.231906+0000","last_fullsized":"2024-09-12T12:14:50.231906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218706+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:14:50.218706+0000","last_peered":"2024-09-12T12:14:50.218706+0000","last_clean":"2024-09-12T12:14:50.218706+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:14:50.218706+0000","last_undegraded":"2024-09-12T12:14:50.218706+0000","last_fullsized":"2024-09-12T12:14:50.218706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280070+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:14:50.280070+0000","last_peered":"2024-09-12T12:14:50.280070+0000","last_clean":"2024-09-12T12:14:50.280070+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:14:50.280070+0000","last_undegraded":"2024-09-12T12:14:50.280070+0000","last_fullsized":"2024-09-12T12:14:50.280070+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220009+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:14:50.220009+0000","last_peered":"2024-09-12T12:14:50.220009+0000","last_clean":"2024-09-12T12:14:50.220009+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:14:50.220009+0000","last_undegraded":"2024-09-12T12:14:50.220009+0000","last_fullsized":"2024-09-12T12:14:50.220009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.221222+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:14:50.221222+0000","last_peered":"2024-09-12T12:14:50.221222+0000","last_clean":"2024-09-12T12:14:50.221222+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:14:50.221222+0000","last_undegraded":"2024-09-12T12:14:50.221222+0000","last_fullsized":"2024-09-12T12:14:50.221222+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":126,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:36.293150+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:15:36.293150+0000","last_peered":"2024-09-12T12:15:36.293150+0000","last_clean":"2024-09-12T12:15:36.293150+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:15:36.293150+0000","last_undegraded":"2024-09-12T12:15:36.293150+0000","last_fullsized":"2024-09-12T12:15:36.293150+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219468+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:14:50.219468+0000","last_peered":"2024-09-12T12:14:50.219468+0000","last_clean":"2024-09-12T12:14:50.219468+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:14:50.219468+0000","last_undegraded":"2024-09-12T12:14:50.219468+0000","last_fullsized":"2024-09-12T12:14:50.219468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225933+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:14:50.225933+0000","last_peered":"2024-09-12T12:14:50.225933+0000","last_clean":"2024-09-12T12:14:50.225933+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:14:50.225933+0000","last_undegraded":"2024-09-12T12:14:50.225933+0000","last_fullsized":"2024-09-12T12:14:50.225933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223934+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:14:50.223934+0000","last_peered":"2024-09-12T12:14:50.223934+0000","last_clean":"2024-09-12T12:14:50.223934+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:14:50.223934+0000","last_undegraded":"2024-09-12T12:14:50.223934+0000","last_fullsized":"2024-09-12T12:14:50.223934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220510+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:14:50.220510+0000","last_peered":"2024-09-12T12:14:50.220510+0000","last_clean":"2024-09-12T12:14:50.220510+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:14:50.220510+0000","last_undegraded":"2024-09-12T12:14:50.220510+0000","last_fullsized":"2024-09-12T12:14:50.220510+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.228850+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:14:50.228850+0000","last_peered":"2024-09-12T12:14:50.228850+0000","last_clean":"2024-09-12T12:14:50.228850+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:14:50.228850+0000","last_undegraded":"2024-09-12T12:14:50.228850+0000","last_fullsized":"2024-09-12T12:14:50.228850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'30","reported_seq":160,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:36.297101+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:15:36.297101+0000","last_peered":"2024-09-12T12:15:36.297101+0000","last_clean":"2024-09-12T12:15:36.297101+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:15:36.297101+0000","last_undegraded":"2024-09-12T12:15:36.297101+0000","last_fullsized":"2024-09-12T12:15:36.297101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227196+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:14:50.227196+0000","last_peered":"2024-09-12T12:14:50.227196+0000","last_clean":"2024-09-12T12:14:50.227196+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:14:50.227196+0000","last_undegraded":"2024-09-12T12:14:50.227196+0000","last_fullsized":"2024-09-12T12:14:50.227196+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226197+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:14:50.226197+0000","last_peered":"2024-09-12T12:14:50.226197+0000","last_clean":"2024-09-12T12:14:50.226197+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:14:50.226197+0000","last_undegraded":"2024-09-12T12:14:50.226197+0000","last_fullsized":"2024-09-12T12:14:50.226197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218755+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:14:50.218755+0000","last_peered":"2024-09-12T12:14:50.218755+0000","last_clean":"2024-09-12T12:14:50.218755+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:14:50.218755+0000","last_undegraded":"2024-09-12T12:14:50.218755+0000","last_fullsized":"2024-09-12T12:14:50.218755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220324+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:14:50.220324+0000","last_peered":"2024-09-12T12:14:50.220324+0000","last_clean":"2024-09-12T12:14:50.220324+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:14:50.220324+0000","last_undegraded":"2024-09-12T12:14:50.220324+0000","last_fullsized":"2024-09-12T12:14:50.220324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225952+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:14:50.225952+0000","last_peered":"2024-09-12T12:14:50.225952+0000","last_clean":"2024-09-12T12:14:50.225952+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:14:50.225952+0000","last_undegraded":"2024-09-12T12:14:50.225952+0000","last_fullsized":"2024-09-12T12:14:50.225952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'5","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:38.298235+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:15:38.298235+0000","last_peered":"2024-09-12T12:15:38.298235+0000","last_clean":"2024-09-12T12:15:38.298235+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:15:38.298235+0000","last_undegraded":"2024-09-12T12:15:38.298235+0000","last_fullsized":"2024-09-12T12:15:38.298235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225510+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:14:50.225510+0000","last_peered":"2024-09-12T12:14:50.225510+0000","last_clean":"2024-09-12T12:14:50.225510+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:14:50.225510+0000","last_undegraded":"2024-09-12T12:14:50.225510+0000","last_fullsized":"2024-09-12T12:14:50.225510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226487+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:14:50.226487+0000","last_peered":"2024-09-12T12:14:50.226487+0000","last_clean":"2024-09-12T12:14:50.226487+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:14:50.226487+0000","last_undegraded":"2024-09-12T12:14:50.226487+0000","last_fullsized":"2024-09-12T12:14:50.226487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220083+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:14:50.220083+0000","last_peered":"2024-09-12T12:14:50.220083+0000","last_clean":"2024-09-12T12:14:50.220083+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:14:50.220083+0000","last_undegraded":"2024-09-12T12:14:50.220083+0000","last_fullsized":"2024-09-12T12:14:50.220083+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227405+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:14:50.227405+0000","last_peered":"2024-09-12T12:14:50.227405+0000","last_clean":"2024-09-12T12:14:50.227405+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:14:50.227405+0000","last_undegraded":"2024-09-12T12:14:50.227405+0000","last_fullsized":"2024-09-12T12:14:50.227405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223688+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:14:50.223688+0000","last_peered":"2024-09-12T12:14:50.223688+0000","last_clean":"2024-09-12T12:14:50.223688+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:14:50.223688+0000","last_undegraded":"2024-09-12T12:14:50.223688+0000","last_fullsized":"2024-09-12T12:14:50.223688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219270+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:14:50.219270+0000","last_peered":"2024-09-12T12:14:50.219270+0000","last_clean":"2024-09-12T12:14:50.219270+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:14:50.219270+0000","last_undegraded":"2024-09-12T12:14:50.219270+0000","last_fullsized":"2024-09-12T12:14:50.219270+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225832+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:14:50.225832+0000","last_peered":"2024-09-12T12:14:50.225832+0000","last_clean":"2024-09-12T12:14:50.225832+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:14:50.225832+0000","last_undegraded":"2024-09-12T12:14:50.225832+0000","last_fullsized":"2024-09-12T12:14:50.225832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.220411+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:14:50.220411+0000","last_peered":"2024-09-12T12:14:50.220411+0000","last_clean":"2024-09-12T12:14:50.220411+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:14:50.220411+0000","last_undegraded":"2024-09-12T12:14:50.220411+0000","last_fullsized":"2024-09-12T12:14:50.220411+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225950+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:14:50.225950+0000","last_peered":"2024-09-12T12:14:50.225950+0000","last_clean":"2024-09-12T12:14:50.225950+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:14:50.225950+0000","last_undegraded":"2024-09-12T12:14:50.225950+0000","last_fullsized":"2024-09-12T12:14:50.225950+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'5","reported_seq":82,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:38.322927+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:15:38.322927+0000","last_peered":"2024-09-12T12:15:38.322927+0000","last_clean":"2024-09-12T12:15:38.322927+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:15:38.322927+0000","last_undegraded":"2024-09-12T12:15:38.322927+0000","last_fullsized":"2024-09-12T12:15:38.322927+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226039+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:14:50.226039+0000","last_peered":"2024-09-12T12:14:50.226039+0000","last_clean":"2024-09-12T12:14:50.226039+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:14:50.226039+0000","last_undegraded":"2024-09-12T12:14:50.226039+0000","last_fullsized":"2024-09-12T12:14:50.226039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225717+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:14:50.225717+0000","last_peered":"2024-09-12T12:14:50.225717+0000","last_clean":"2024-09-12T12:14:50.225717+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:14:50.225717+0000","last_undegraded":"2024-09-12T12:14:50.225717+0000","last_fullsized":"2024-09-12T12:14:50.225717+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.230997+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:14:50.230997+0000","last_peered":"2024-09-12T12:14:50.230997+0000","last_clean":"2024-09-12T12:14:50.230997+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:14:50.230997+0000","last_undegraded":"2024-09-12T12:14:50.230997+0000","last_fullsized":"2024-09-12T12:14:50.230997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.222469+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:14:50.222469+0000","last_peered":"2024-09-12T12:14:50.222469+0000","last_clean":"2024-09-12T12:14:50.222469+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:14:50.222469+0000","last_undegraded":"2024-09-12T12:14:50.222469+0000","last_fullsized":"2024-09-12T12:14:50.222469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225688+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:14:50.225688+0000","last_peered":"2024-09-12T12:14:50.225688+0000","last_clean":"2024-09-12T12:14:50.225688+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:14:50.225688+0000","last_undegraded":"2024-09-12T12:14:50.225688+0000","last_fullsized":"2024-09-12T12:14:50.225688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.218701+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:14:50.218701+0000","last_peered":"2024-09-12T12:14:50.218701+0000","last_clean":"2024-09-12T12:14:50.218701+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:14:50.218701+0000","last_undegraded":"2024-09-12T12:14:50.218701+0000","last_fullsized":"2024-09-12T12:14:50.218701+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":81,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:38.297170+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:15:38.297170+0000","last_peered":"2024-09-12T12:15:38.297170+0000","last_clean":"2024-09-12T12:15:38.297170+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:15:38.297170+0000","last_undegraded":"2024-09-12T12:15:38.297170+0000","last_fullsized":"2024-09-12T12:15:38.297170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219869+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:14:50.219869+0000","last_peered":"2024-09-12T12:14:50.219869+0000","last_clean":"2024-09-12T12:14:50.219869+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:14:50.219869+0000","last_undegraded":"2024-09-12T12:14:50.219869+0000","last_fullsized":"2024-09-12T12:14:50.219869+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'6","reported_seq":80,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:35.305825+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:15:35.305825+0000","last_peered":"2024-09-12T12:15:35.305825+0000","last_clean":"2024-09-12T12:15:35.305825+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:15:35.305825+0000","last_undegraded":"2024-09-12T12:15:35.305825+0000","last_fullsized":"2024-09-12T12:15:35.305825+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231612+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:14:50.231612+0000","last_peered":"2024-09-12T12:14:50.231612+0000","last_clean":"2024-09-12T12:14:50.231612+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:14:50.231612+0000","last_undegraded":"2024-09-12T12:14:50.231612+0000","last_fullsized":"2024-09-12T12:14:50.231612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225099+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:14:50.225099+0000","last_peered":"2024-09-12T12:14:50.225099+0000","last_clean":"2024-09-12T12:14:50.225099+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:14:50.225099+0000","last_undegraded":"2024-09-12T12:14:50.225099+0000","last_fullsized":"2024-09-12T12:14:50.225099+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231738+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:14:50.231738+0000","last_peered":"2024-09-12T12:14:50.231738+0000","last_clean":"2024-09-12T12:14:50.231738+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:14:50.231738+0000","last_undegraded":"2024-09-12T12:14:50.231738+0000","last_fullsized":"2024-09-12T12:14:50.231738+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.227316+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:14:50.227316+0000","last_peered":"2024-09-12T12:14:50.227316+0000","last_clean":"2024-09-12T12:14:50.227316+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:14:50.227316+0000","last_undegraded":"2024-09-12T12:14:50.227316+0000","last_fullsized":"2024-09-12T12:14:50.227316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219126+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:14:50.219126+0000","last_peered":"2024-09-12T12:14:50.219126+0000","last_clean":"2024-09-12T12:14:50.219126+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:14:50.219126+0000","last_undegraded":"2024-09-12T12:14:50.219126+0000","last_fullsized":"2024-09-12T12:14:50.219126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'14","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:59.389979+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:14:59.389979+0000","last_peered":"2024-09-12T12:14:59.389979+0000","last_clean":"2024-09-12T12:14:59.389979+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:14:59.389979+0000","last_undegraded":"2024-09-12T12:14:59.389979+0000","last_fullsized":"2024-09-12T12:14:59.389979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280423+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:14:50.280423+0000","last_peered":"2024-09-12T12:14:50.280423+0000","last_clean":"2024-09-12T12:14:50.280423+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:14:50.280423+0000","last_undegraded":"2024-09-12T12:14:50.280423+0000","last_fullsized":"2024-09-12T12:14:50.280423+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.231076+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:14:50.231076+0000","last_peered":"2024-09-12T12:14:50.231076+0000","last_clean":"2024-09-12T12:14:50.231076+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:14:50.231076+0000","last_undegraded":"2024-09-12T12:14:50.231076+0000","last_fullsized":"2024-09-12T12:14:50.231076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223746+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:14:50.223746+0000","last_peered":"2024-09-12T12:14:50.223746+0000","last_clean":"2024-09-12T12:14:50.223746+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:14:50.223746+0000","last_undegraded":"2024-09-12T12:14:50.223746+0000","last_fullsized":"2024-09-12T12:14:50.223746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219067+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:14:50.219067+0000","last_peered":"2024-09-12T12:14:50.219067+0000","last_clean":"2024-09-12T12:14:50.219067+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:14:50.219067+0000","last_undegraded":"2024-09-12T12:14:50.219067+0000","last_fullsized":"2024-09-12T12:14:50.219067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226116+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:14:50.226116+0000","last_peered":"2024-09-12T12:14:50.226116+0000","last_clean":"2024-09-12T12:14:50.226116+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:14:50.226116+0000","last_undegraded":"2024-09-12T12:14:50.226116+0000","last_fullsized":"2024-09-12T12:14:50.226116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":29,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280169+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:14:50.280169+0000","last_peered":"2024-09-12T12:14:50.280169+0000","last_clean":"2024-09-12T12:14:50.280169+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:14:50.280169+0000","last_undegraded":"2024-09-12T12:14:50.280169+0000","last_fullsized":"2024-09-12T12:14:50.280169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223582+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:14:50.223582+0000","last_peered":"2024-09-12T12:14:50.223582+0000","last_clean":"2024-09-12T12:14:50.223582+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:14:50.223582+0000","last_undegraded":"2024-09-12T12:14:50.223582+0000","last_fullsized":"2024-09-12T12:14:50.223582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226774+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:14:50.226774+0000","last_peered":"2024-09-12T12:14:50.226774+0000","last_clean":"2024-09-12T12:14:50.226774+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:14:50.226774+0000","last_undegraded":"2024-09-12T12:14:50.226774+0000","last_fullsized":"2024-09-12T12:14:50.226774+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280155+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:14:50.280155+0000","last_peered":"2024-09-12T12:14:50.280155+0000","last_clean":"2024-09-12T12:14:50.280155+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:14:50.280155+0000","last_undegraded":"2024-09-12T12:14:50.280155+0000","last_fullsized":"2024-09-12T12:14:50.280155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226514+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:14:50.226514+0000","last_peered":"2024-09-12T12:14:50.226514+0000","last_clean":"2024-09-12T12:14:50.226514+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:14:50.226514+0000","last_undegraded":"2024-09-12T12:14:50.226514+0000","last_fullsized":"2024-09-12T12:14:50.226514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.225702+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:14:50.225702+0000","last_peered":"2024-09-12T12:14:50.225702+0000","last_clean":"2024-09-12T12:14:50.225702+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:14:50.225702+0000","last_undegraded":"2024-09-12T12:14:50.225702+0000","last_fullsized":"2024-09-12T12:14:50.225702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.232265+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:14:50.232265+0000","last_peered":"2024-09-12T12:14:50.232265+0000","last_clean":"2024-09-12T12:14:50.232265+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:14:50.232265+0000","last_undegraded":"2024-09-12T12:14:50.232265+0000","last_fullsized":"2024-09-12T12:14:50.232265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.226949+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:14:50.226949+0000","last_peered":"2024-09-12T12:14:50.226949+0000","last_clean":"2024-09-12T12:14:50.226949+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:14:50.226949+0000","last_undegraded":"2024-09-12T12:14:50.226949+0000","last_fullsized":"2024-09-12T12:14:50.226949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.219147+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:14:50.219147+0000","last_peered":"2024-09-12T12:14:50.219147+0000","last_clean":"2024-09-12T12:14:50.219147+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:14:50.219147+0000","last_undegraded":"2024-09-12T12:14:50.219147+0000","last_fullsized":"2024-09-12T12:14:50.219147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'12","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.241528+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:14:50.241528+0000","last_peered":"2024-09-12T12:14:50.241528+0000","last_clean":"2024-09-12T12:14:50.241528+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:14:50.241528+0000","last_undegraded":"2024-09-12T12:14:50.241528+0000","last_fullsized":"2024-09-12T12:14:50.241528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.223893+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:14:50.223893+0000","last_peered":"2024-09-12T12:14:50.223893+0000","last_clean":"2024-09-12T12:14:50.223893+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:14:50.223893+0000","last_undegraded":"2024-09-12T12:14:50.223893+0000","last_fullsized":"2024-09-12T12:14:50.223893+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280619+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:14:50.280619+0000","last_peered":"2024-09-12T12:14:50.280619+0000","last_clean":"2024-09-12T12:14:50.280619+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:14:50.280619+0000","last_undegraded":"2024-09-12T12:14:50.280619+0000","last_fullsized":"2024-09-12T12:14:50.280619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:14:50.280520+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:14:50.280520+0000","last_peered":"2024-09-12T12:14:50.280520+0000","last_clean":"2024-09-12T12:14:50.280520+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:14:50.280520+0000","last_undegraded":"2024-09-12T12:14:50.280520+0000","last_fullsized":"2024-09-12T12:14:50.280520+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'13","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-12T12:15:36.306615+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:15:36.306615+0000","last_peered":"2024-09-12T12:15:36.306615+0000","last_clean":"2024-09-12T12:15:36.306615+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:15:36.306615+0000","last_undegraded":"2024-09-12T12:15:36.306615+0000","last_fullsized":"2024-09-12T12:15:36.306615+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66972,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":550,"num_read_kb":346,"num_write":242,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":423209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1074002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":423139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":423517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528365,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32636,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712516,"statfs":{"total":95995035648,"available":95961616384,"internally_reserved":0,"allocated":1486848,"data_stored":1016430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":423249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888120,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1015715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":422681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444103,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":484146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607628,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":483926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":897024,"data_stored":424195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:15:41.197 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:15:41.197 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T12:15:41.197 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T12:15:41.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T12:15:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:41.784 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:41 smithi081 ceph-mon[30948]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 -- 172.21.15.81:0/728119246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 msgr2=0x7f5a501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 --2- 172.21.15.81:0/728119246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a501067e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009900 tx=0x7f5a4002a410 comp rx=0 tx=0).stop 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 -- 172.21.15.81:0/728119246 shutdown_connections 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 --2- 172.21.15.81:0/728119246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a50106f10 0x7f5a5010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 --2- 172.21.15.81:0/728119246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a501067e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 --2- 172.21.15.81:0/728119246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a50101de0 0x7f5a501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 -- 172.21.15.81:0/728119246 >> 172.21.15.81:0/728119246 conn(0x7f5a500fd8c0 msgr2=0x7f5a500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 -- 172.21.15.81:0/728119246 shutdown_connections 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.862+0000 7f5a585a6640 1 -- 172.21.15.81:0/728119246 wait complete. 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 Processor -- start 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 -- start start 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a50101de0 0x7f5a50198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a50198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a50106f10 0x7f5a5019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501120d0 con 0x7f5a50102790 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50111f50 con 0x7f5a50101de0 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a585a6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50112250 con 0x7f5a50106f10 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a55b41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a50198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a55b41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a50198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47632/0 (socket says 172.21.15.81:47632) 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a55b41640 1 -- 172.21.15.81:0/3153968395 learned_addr learned my addr 172.21.15.81:0/3153968395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a56342640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a50101de0 0x7f5a50198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a56b43640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a50106f10 0x7f5a5019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.863+0000 7f5a55b41640 1 -- 172.21.15.81:0/3153968395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a50106f10 msgr2=0x7f5a5019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a55b41640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a50106f10 0x7f5a5019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a55b41640 1 -- 172.21.15.81:0/3153968395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a50101de0 msgr2=0x7f5a50198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:41.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a55b41640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a50101de0 0x7f5a50198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a55b41640 1 -- 172.21.15.81:0/3153968395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5019d620 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a55b41640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a50198bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a40006010 tx=0x7f5a400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4003f030 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5019d8b0 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5a40003d00 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40035070 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.864+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501a51f0 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.865+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a501021c0 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.866+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5a40042030 con 0x7f5a50102790 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.867+0000 7f5a477fe640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5a3c0a2c10 0x7f5a3c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.867+0000 7f5a56342640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5a3c0a2c10 0x7f5a3c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:41.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.867+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f5a400ef960 con 0x7f5a50102790 2024-09-12T12:15:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.867+0000 7f5a56342640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5a3c0a2c10 0x7f5a3c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009990 tx=0x7f5a4c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:41.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:41.870+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a400bc860 con 0x7f5a50102790 2024-09-12T12:15:41.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:41 smithi173 ceph-mon[35326]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:41.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:41 smithi103 ceph-mon[35094]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.069+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a5010a150 con 0x7f5a50102790 2024-09-12T12:15:42.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.069+0000 7f5a477fe640 1 -- 172.21.15.81:0/3153968395 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5a400bc160 con 0x7f5a50102790 2024-09-12T12:15:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:42.070 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T12:15:42.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5a3c0a2c10 msgr2=0x7f5a3c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:42.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5a3c0a2c10 0x7f5a3c0a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009990 tx=0x7f5a4c009110 comp rx=0 tx=0).stop 2024-09-12T12:15:42.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 msgr2=0x7f5a50198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:42.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a50198bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5a40006010 tx=0x7f5a400042f0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 shutdown_connections 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f5a3c0a2c10 0x7f5a3c0a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a50106f10 0x7f5a5019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a50102790 0x7f5a50198bb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 --2- 172.21.15.81:0/3153968395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a50101de0 0x7f5a50198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.071+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 >> 172.21.15.81:0/3153968395 conn(0x7f5a500fd8c0 msgr2=0x7f5a500fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.072+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 shutdown_connections 2024-09-12T12:15:42.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:42.072+0000 7f5a585a6640 1 -- 172.21.15.81:0/3153968395 wait complete. 2024-09-12T12:15:42.681 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:42 smithi081 ceph-mon[30948]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:42.720 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:42 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3153968395' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:15:42.721 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T12:15:42.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:15:42.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:42 smithi173 ceph-mon[35326]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:42.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:42 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3153968395' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:15:42.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:42 smithi103 ceph-mon[35094]: from='client.14925 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:15:42.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:42 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3153968395' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T12:15:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 -- 172.21.15.81:0/2286860355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0680102da0 msgr2=0x7f0680103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 --2- 172.21.15.81:0/2286860355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0680102da0 0x7f0680103180 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f067002a480 comp rx=0 tx=0).stop 2024-09-12T12:15:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 -- 172.21.15.81:0/2286860355 shutdown_connections 2024-09-12T12:15:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 --2- 172.21.15.81:0/2286860355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f068010c180 0x7f068010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 --2- 172.21.15.81:0/2286860355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06801036c0 0x7f068010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 --2- 172.21.15.81:0/2286860355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0680102da0 0x7f0680103180 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 -- 172.21.15.81:0/2286860355 >> 172.21.15.81:0/2286860355 conn(0x7f06800fc7a0 msgr2=0x7f06800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 -- 172.21.15.81:0/2286860355 shutdown_connections 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 -- 172.21.15.81:0/2286860355 wait complete. 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 Processor -- start 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.446+0000 7f0684914640 1 -- start start 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0680102da0 0x7f0680198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 0x7f0680198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f068010c180 0x7f068019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0680112080 con 0x7f06801036c0 2024-09-12T12:15:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0680111f00 con 0x7f0680102da0 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0680112200 con 0x7f068010c180 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 0x7f0680198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 0x7f0680198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43936/0 (socket says 172.21.15.81:43936) 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 -- 172.21.15.81:0/188993807 learned_addr learned my addr 172.21.15.81:0/188993807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067ed9d640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f068010c180 0x7f068019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 -- 172.21.15.81:0/188993807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f068010c180 msgr2=0x7f068019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f068010c180 0x7f068019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067e59c640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0680102da0 0x7f0680198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 -- 172.21.15.81:0/188993807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0680102da0 msgr2=0x7f0680198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0680102da0 0x7f0680198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 -- 172.21.15.81:0/188993807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068019d4b0 con 0x7f06801036c0 2024-09-12T12:15:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067ed9d640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f068010c180 0x7f068019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f067dd9b640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 0x7f0680198a40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f066800d950 tx=0x7f066800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668017070 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068019d7a0 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0668009c30 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066800f740 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.447+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06801a5080 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.449+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0680103180 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.450+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0668010a80 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.450+0000 7f06777fe640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f066c0a2c10 0x7f066c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.450+0000 7f067e59c640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f066c0a2c10 0x7f066c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.450+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f06680ced90 con 0x7f06801036c0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.451+0000 7f067e59c640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f066c0a2c10 0x7f066c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0670006010 tx=0x7f0670000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.454+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0668009de0 con 0x7f06801036c0 2024-09-12T12:15:43.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.656+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f068002d7c0 con 0x7f06801036c0 2024-09-12T12:15:43.657 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:43 smithi081 ceph-mon[30948]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:43.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.657+0000 7f06777fe640 1 -- 172.21.15.81:0/188993807 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11982 (secure 0 0 0) 0x7f066809bc90 con 0x7f06801036c0 2024-09-12T12:15:43.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:43.658 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-12T12:14:47:212167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:14:47.212145+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:15:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:15:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f066c0a2c10 msgr2=0x7f066c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f066c0a2c10 0x7f066c0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0670006010 tx=0x7f0670000bc0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 msgr2=0x7f0680198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 0x7f0680198a40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f066800d950 tx=0x7f066800de10 comp rx=0 tx=0).stop 2024-09-12T12:15:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 shutdown_connections 2024-09-12T12:15:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f066c0a2c10 0x7f066c0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f068010c180 0x7f068019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06801036c0 0x7f0680198a40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 --2- 172.21.15.81:0/188993807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0680102da0 0x7f0680198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.659+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 >> 172.21.15.81:0/188993807 conn(0x7f06800fc7a0 msgr2=0x7f06800fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.660+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 shutdown_connections 2024-09-12T12:15:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:43.660+0000 7f0684914640 1 -- 172.21.15.81:0/188993807 wait complete. 2024-09-12T12:15:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:43 smithi173 ceph-mon[35326]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:43.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:43 smithi103 ceph-mon[35094]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:44.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:15:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:44.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:44 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/188993807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:44.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:44 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/188993807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:44.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:44 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/188993807' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 -- 172.21.15.81:0/1951278124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c100e20 msgr2=0x7f1d7c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 --2- 172.21.15.81:0/1951278124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c100e20 0x7f1d7c101200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009900 tx=0x7f1d7402a480 comp rx=0 tx=0).stop 2024-09-12T12:15:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 -- 172.21.15.81:0/1951278124 shutdown_connections 2024-09-12T12:15:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 --2- 172.21.15.81:0/1951278124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 --2- 172.21.15.81:0/1951278124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d7c102570 0x7f1d7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 --2- 172.21.15.81:0/1951278124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c100e20 0x7f1d7c101200 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 -- 172.21.15.81:0/1951278124 >> 172.21.15.81:0/1951278124 conn(0x7f1d7c0fc7d0 msgr2=0x7f1d7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 -- 172.21.15.81:0/1951278124 shutdown_connections 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.241+0000 7f1d846ae640 1 -- 172.21.15.81:0/1951278124 wait complete. 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 Processor -- start 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 -- start start 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d7c100e20 0x7f1d7c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c102570 0x7f1d7c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111160 con 0x7f1d7c102ef0 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c110fe0 con 0x7f1d7c100e20 2024-09-12T12:15:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d846ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c1112e0 con 0x7f1d7c102570 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c1a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43962/0 (socket says 172.21.15.81:43962) 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 -- 172.21.15.81:0/666415793 learned_addr learned my addr 172.21.15.81:0/666415793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d8244a640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d7c100e20 0x7f1d7c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d81c49640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c102570 0x7f1d7c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 -- 172.21.15.81:0/666415793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c102570 msgr2=0x7f1d7c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c102570 0x7f1d7c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 -- 172.21.15.81:0/666415793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d7c100e20 msgr2=0x7f1d7c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d7c100e20 0x7f1d7c1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 -- 172.21.15.81:0/666415793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c1a4b70 con 0x7f1d7c102ef0 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.242+0000 7f1d82c4b640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c1a4630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009fd0 tx=0x7f1d6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.243+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c011830 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.243+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c1a4d40 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.243+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1d6c016070 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.243+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00f2e0 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.243+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c1a5280 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.244+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7c101200 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.245+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1d6c01b460 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.246+0000 7f1d7b7fe640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d640a2c10 0x7f1d640a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.246+0000 7f1d8244a640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d640a2c10 0x7f1d640a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.246+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f1d6c0ce6c0 con 0x7f1d7c102ef0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.246+0000 7f1d8244a640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d640a2c10 0x7f1d640a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d74005ab0 tx=0x7f1d74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.250+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d6c021250 con 0x7f1d7c102ef0 2024-09-12T12:15:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.460+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d7c109090 con 0x7f1d7c102ef0 2024-09-12T12:15:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.461+0000 7f1d7b7fe640 1 -- 172.21.15.81:0/666415793 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11982 (secure 0 0 0) 0x7f1d6c09b6d0 con 0x7f1d7c102ef0 2024-09-12T12:15:45.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:45.462 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-12T12:14:47:212167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:14:47.212145+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:15:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d640a2c10 msgr2=0x7f1d640a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d640a2c10 0x7f1d640a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1d74005ab0 tx=0x7f1d74005a20 comp rx=0 tx=0).stop 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 msgr2=0x7f1d7c1a4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c1a4630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009fd0 tx=0x7f1d6c00b8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 shutdown_connections 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f1d640a2c10 0x7f1d640a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c102ef0 0x7f1d7c1a4630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d7c102570 0x7f1d7c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 --2- 172.21.15.81:0/666415793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d7c100e20 0x7f1d7c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 >> 172.21.15.81:0/666415793 conn(0x7f1d7c0fc7d0 msgr2=0x7f1d7c105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 shutdown_connections 2024-09-12T12:15:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:45.463+0000 7f1d846ae640 1 -- 172.21.15.81:0/666415793 wait complete. 2024-09-12T12:15:45.780 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:45 smithi081 ceph-mon[30948]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:45.780 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:45 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/666415793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:45.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:45 smithi173 ceph-mon[35326]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:45.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:45 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/666415793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:45 smithi103 ceph-mon[35094]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:45 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/666415793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:46.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:15:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:46.766 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:46 smithi081 ceph-mon[30948]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 -- 172.21.15.81:0/489557948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480101420 msgr2=0x7ff48010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 --2- 172.21.15.81:0/489557948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480101420 0x7ff48010d950 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff470009930 tx=0x7ff47002a420 comp rx=0 tx=0).stop 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 -- 172.21.15.81:0/489557948 shutdown_connections 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 --2- 172.21.15.81:0/489557948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480101420 0x7ff48010d950 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 --2- 172.21.15.81:0/489557948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480100a80 0x7ff480100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 --2- 172.21.15.81:0/489557948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480106a80 0x7ff480106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 -- 172.21.15.81:0/489557948 >> 172.21.15.81:0/489557948 conn(0x7ff4800fc7a0 msgr2=0x7ff4800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 -- 172.21.15.81:0/489557948 shutdown_connections 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.846+0000 7ff484b91640 1 -- 172.21.15.81:0/489557948 wait complete. 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 Processor -- start 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 -- start start 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480100a80 0x7ff480198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480101420 0x7ff480198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 0x7ff48019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4801110b0 con 0x7ff480106a80 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff480110f30 con 0x7ff480100a80 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff484b91640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff480111230 con 0x7ff480101420 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 0x7ff48019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 0x7ff48019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43988/0 (socket says 172.21.15.81:43988) 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 -- 172.21.15.81:0/544715056 learned_addr learned my addr 172.21.15.81:0/544715056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47e59c640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480100a80 0x7ff480198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47dd9b640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480101420 0x7ff480198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 -- 172.21.15.81:0/544715056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480101420 msgr2=0x7ff480198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480101420 0x7ff480198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 -- 172.21.15.81:0/544715056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480100a80 msgr2=0x7ff480198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480100a80 0x7ff480198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47ed9d640 1 -- 172.21.15.81:0/544715056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48019d5e0 con 0x7ff480106a80 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47e59c640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480100a80 0x7ff480198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.847+0000 7ff47dd9b640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480101420 0x7ff480198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.848+0000 7ff47ed9d640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 0x7ff48019cf00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff47002aa10 tx=0x7ff470032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.848+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47003f030 con 0x7ff480106a80 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.848+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff470032e10 con 0x7ff480106a80 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.848+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48019d870 con 0x7ff480106a80 2024-09-12T12:15:46.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.848+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470035070 con 0x7ff480106a80 2024-09-12T12:15:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.848+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4801a51b0 con 0x7ff480106a80 2024-09-12T12:15:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.849+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4801021c0 con 0x7ff480106a80 2024-09-12T12:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.850+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff470042030 con 0x7ff480106a80 2024-09-12T12:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.850+0000 7ff46f7fe640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff4680a2c10 0x7ff4680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.851+0000 7ff47e59c640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff4680a2c10 0x7ff4680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.851+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7ff4700ef320 con 0x7ff480106a80 2024-09-12T12:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.851+0000 7ff47e59c640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff4680a2c10 0x7ff4680a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff478006fd0 tx=0x7ff478008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:46.855+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff4700bc220 con 0x7ff480106a80 2024-09-12T12:15:46.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:46 smithi173 ceph-mon[35326]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:46.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:46 smithi103 ceph-mon[35094]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.023+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff48010a020 con 0x7ff480106a80 2024-09-12T12:15:47.026 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.025+0000 7ff46f7fe640 1 -- 172.21.15.81:0/544715056 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22643 (secure 0 0 0) 0x7ff4700bbb20 con 0x7ff480106a80 2024-09-12T12:15:47.026 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:50.215414+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff4680a2c10 msgr2=0x7ff4680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff4680a2c10 0x7ff4680a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff478006fd0 tx=0x7ff478008040 comp rx=0 tx=0).stop 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 msgr2=0x7ff48019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 0x7ff48019cf00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff47002aa10 tx=0x7ff470032bf0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 shutdown_connections 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7ff4680a2c10 0x7ff4680a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff480106a80 0x7ff48019cf00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff480101420 0x7ff480198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 --2- 172.21.15.81:0/544715056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff480100a80 0x7ff480198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.027+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 >> 172.21.15.81:0/544715056 conn(0x7ff4800fc7a0 msgr2=0x7ff48006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.028+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 shutdown_connections 2024-09-12T12:15:47.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:47.028+0000 7ff484b91640 1 -- 172.21.15.81:0/544715056 wait complete. 2024-09-12T12:15:47.663 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:47 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/544715056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:47.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:15:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:47 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/544715056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:47 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/544715056' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 -- 172.21.15.81:0/176247645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73901027a0 msgr2=0x7f73901067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 --2- 172.21.15.81:0/176247645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73901027a0 0x7f73901067f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f738c009900 tx=0x7f738c02a410 comp rx=0 tx=0).stop 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 -- 172.21.15.81:0/176247645 shutdown_connections 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 --2- 172.21.15.81:0/176247645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 0x7f739010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 --2- 172.21.15.81:0/176247645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73901027a0 0x7f73901067f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 --2- 172.21.15.81:0/176247645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7390101df0 0x7f73901021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 -- 172.21.15.81:0/176247645 >> 172.21.15.81:0/176247645 conn(0x7f73900fd8b0 msgr2=0x7f73900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 -- 172.21.15.81:0/176247645 shutdown_connections 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 -- 172.21.15.81:0/176247645 wait complete. 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.370+0000 7f739805b640 1 Processor -- start 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 -- start start 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 0x7f73901985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73901027a0 0x7f7390198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 0x7f739019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73901120e0 con 0x7f7390101df0 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111f60 con 0x7f73901027a0 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7390112260 con 0x7f7390106f20 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 0x7f73901985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 0x7f73901985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44012/0 (socket says 172.21.15.81:44012) 2024-09-12T12:15:48.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 -- 172.21.15.81:0/3997575698 learned_addr learned my addr 172.21.15.81:0/3997575698 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f73965f8640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 0x7f739019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 -- 172.21.15.81:0/3997575698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 msgr2=0x7f739019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 0x7f739019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 -- 172.21.15.81:0/3997575698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73901027a0 msgr2=0x7f7390198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73901027a0 0x7f7390198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 -- 172.21.15.81:0/3997575698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739019d550 con 0x7f7390101df0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f73965f8640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 0x7f739019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7395df7640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 0x7f73901985a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f738400c890 tx=0x7f738400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384004220 con 0x7f7390101df0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f73840043c0 con 0x7f7390101df0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739019d840 con 0x7f7390101df0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.371+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384004b10 con 0x7f7390101df0 2024-09-12T12:15:48.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.372+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901a5120 con 0x7f7390101df0 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.373+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73901021d0 con 0x7f7390101df0 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.373+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f73840051b0 con 0x7f7390101df0 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.374+0000 7f7382ffd640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f737c0a2c90 0x7f737c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.374+0000 7f73955f6640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f737c0a2c90 0x7f737c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.374+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f73840cf1d0 con 0x7f7390101df0 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.375+0000 7f73955f6640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f737c0a2c90 0x7f737c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f738c0096c0 tx=0x7f738c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:48.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.378+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7384014030 con 0x7f7390101df0 2024-09-12T12:15:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.579+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f739010a160 con 0x7f7390101df0 2024-09-12T12:15:48.580 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:48 smithi081 ceph-mon[30948]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.580+0000 7f7382ffd640 1 -- 172.21.15.81:0/3997575698 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11982 (secure 0 0 0) 0x7f738409c0d0 con 0x7f7390101df0 2024-09-12T12:15:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:15:48.580 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-12T12:14:47:212167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:14:47.212145+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:15:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f737c0a2c90 msgr2=0x7f737c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f737c0a2c90 0x7f737c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f738c0096c0 tx=0x7f738c000bc0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 msgr2=0x7f73901985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 0x7f73901985a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f738400c890 tx=0x7f738400cd50 comp rx=0 tx=0).stop 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 shutdown_connections 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f737c0a2c90 0x7f737c0a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7390106f20 0x7f739019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73901027a0 0x7f7390198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 --2- 172.21.15.81:0/3997575698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7390101df0 0x7f73901985a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 >> 172.21.15.81:0/3997575698 conn(0x7f73900fd8b0 msgr2=0x7f73900feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 shutdown_connections 2024-09-12T12:15:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:48.582+0000 7f739805b640 1 -- 172.21.15.81:0/3997575698 wait complete. 2024-09-12T12:15:48.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:48 smithi173 ceph-mon[35326]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:48.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:48 smithi103 ceph-mon[35094]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:49.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:14:35.911015+0000', 'modified': '2024-09-12T12:14:47.212145+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24485, 'mds_1': 24461, 'mds_2': 24457, 'mds_3': 24437, 'mds_4': 24436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/3279635401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3279635401}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3279635401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/1006182135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 1006182135}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 1006182135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/372466772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 372466772}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 372466772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24407': {'gid': 24407, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.103:6833/3064461197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 3064461197}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 3064461197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6835/3014376257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 3014376257}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 3014376257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'c', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/359177011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 359177011}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 359177011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6835/4242406176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 4242406176}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 4242406176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.173:6839/2860435891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2860435891}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2860435891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.103:6837/4210602713', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6836', 'nonce': 4210602713}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 4210602713}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/3967449570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 3967449570}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 3967449570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485, 24461, 24457, 24437, 24436]} 2024-09-12T12:15:49.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T12:15:49.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:15:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:49.807 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:49 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3997575698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:49 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3997575698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:49.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 -- 172.21.15.81:0/3196533246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 msgr2=0x7f83f0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 --2- 172.21.15.81:0/3196533246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0101200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009ca0 tx=0x7f83e002a950 comp rx=0 tx=0).stop 2024-09-12T12:15:49.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 -- 172.21.15.81:0/3196533246 shutdown_connections 2024-09-12T12:15:49.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 --2- 172.21.15.81:0/3196533246 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102ef0 0x7f83f010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 --2- 172.21.15.81:0/3196533246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 0x7f83f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 --2- 172.21.15.81:0/3196533246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0101200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 -- 172.21.15.81:0/3196533246 >> 172.21.15.81:0/3196533246 conn(0x7f83f00fc7d0 msgr2=0x7f83f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 -- 172.21.15.81:0/3196533246 shutdown_connections 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 -- 172.21.15.81:0/3196533246 wait complete. 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.887+0000 7f83f4fac640 1 Processor -- start 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 -- start start 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 0x7f83f0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102ef0 0x7f83f019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83f01121e0 con 0x7f83f0100e20 2024-09-12T12:15:49.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0112060 con 0x7f83f0102570 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83f4fac640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0112360 con 0x7f83f0102ef0 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44026/0 (socket says 172.21.15.81:44026) 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 -- 172.21.15.81:0/663212949 learned_addr learned my addr 172.21.15.81:0/663212949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83eed9d640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102ef0 0x7f83f019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83edd9b640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 0x7f83f0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 -- 172.21.15.81:0/663212949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102ef0 msgr2=0x7f83f019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102ef0 0x7f83f019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 -- 172.21.15.81:0/663212949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 msgr2=0x7f83f0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 0x7f83f0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 -- 172.21.15.81:0/663212949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f019d530 con 0x7f83f0100e20 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83edd9b640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 0x7f83f0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.888+0000 7f83ee59c640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0198580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83e0000f80 tx=0x7f83e0030e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.889+0000 7f83df7fe640 1 -- 172.21.15.81:0/663212949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0034040 con 0x7f83f0100e20 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.889+0000 7f83df7fe640 1 -- 172.21.15.81:0/663212949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83e0030940 con 0x7f83f0100e20 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.889+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f019d7c0 con 0x7f83f0100e20 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.889+0000 7f83df7fe640 1 -- 172.21.15.81:0/663212949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00456e0 con 0x7f83f0100e20 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.889+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f01a5100 con 0x7f83f0100e20 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83df7fe640 1 -- 172.21.15.81:0/663212949 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f83e0037020 con 0x7f83f0100e20 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 Processor -- start 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 -- start start 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d6271c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d631a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d6343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a61d589090 con 0x55a61d631fc0 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a61d530a70 con 0x55a61d626de0 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.891+0000 7f83f7385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a61d585050 con 0x55a61d627700 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d6343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d6343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44034/0 (socket says 172.21.15.81:44034) 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 -- 172.21.15.81:0/3987728681 learned_addr learned my addr 172.21.15.81:0/3987728681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83df7fe640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f83d80a2c10 0x7f83d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d6271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83eed9d640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f83d80a2c10 0x7f83d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d631a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 -- 172.21.15.81:0/3987728681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 msgr2=0x55a61d631a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83df7fe640 1 -- 172.21.15.81:0/663212949 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f83e00f0250 con 0x7f83f0100e20 2024-09-12T12:15:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d631a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 -- 172.21.15.81:0/3987728681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 msgr2=0x55a61d6271c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d6271c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 -- 172.21.15.81:0/3987728681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61d53d130 con 0x55a61d631fc0 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d631a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83edd9b640 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d6343b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f83e4007800 tx=0x7f83e4007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7728624a1f3385 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83eed9d640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f83d80a2c10 0x7f83d80a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83e80058c0 tx=0x7f83e800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83dcff9640 1 -- 172.21.15.81:0/3987728681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e400d950 con 0x55a61d631fc0 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83dcff9640 1 -- 172.21.15.81:0/3987728681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83e4018070 con 0x55a61d631fc0 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.892+0000 7f83dcff9640 1 -- 172.21.15.81:0/3987728681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e40123e0 con 0x55a61d631fc0 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 -- 172.21.15.81:0/3987728681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 msgr2=0x55a61d6343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d6343b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f83e4007800 tx=0x7f83e4007cc0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 -- 172.21.15.81:0/3987728681 shutdown_connections 2024-09-12T12:15:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d6343b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d631a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 --2- 172.21.15.81:0/3987728681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d6271c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 -- 172.21.15.81:0/3987728681 >> 172.21.15.81:0/3987728681 conn(0x55a61d623370 msgr2=0x55a61d623750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 -- 172.21.15.81:0/3987728681 shutdown_connections 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.893+0000 7f83f7385740 1 -- 172.21.15.81:0/3987728681 wait complete. 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 -- start start 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 Processor -- start 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d626de0 0x55a61d6317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d627700 0x55a61d62eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a61d634b90 con 0x55a61d631fc0 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a61d543f20 con 0x55a61d627700 2024-09-12T12:15:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a61d634d10 con 0x55a61d626de0 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83f7385740 10 client.0 _ll_register_callbacks cb 0x55a61d50d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44038/0 (socket says 172.21.15.81:44038) 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 -- 172.21.15.81:0/3316021042 learned_addr learned my addr 172.21.15.81:0/3316021042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83edd9b640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d627700 0x55a61d62eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d626de0 0x55a61d6317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 -- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d626de0 msgr2=0x55a61d6317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d626de0 0x55a61d6317c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 -- 172.21.15.81:0/3316021042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d627700 msgr2=0x55a61d62eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d627700 0x55a61d62eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83eed9d640 1 -- 172.21.15.81:0/3316021042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61d2fa2b0 con 0x55a61d631fc0 2024-09-12T12:15:49.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.894+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d626de0 0x55a61d6317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62f050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83e800da70 tx=0x7f83e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcc5fcef21e754e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83d5ffb640 1 -- 172.21.15.81:0/3316021042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8024070 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83d5ffb640 1 -- 172.21.15.81:0/3316021042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f83e8003d80 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e4018070 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83d5ffb640 1 -- 172.21.15.81:0/3316021042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83e8011e70 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 10 client.14967 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a61d6403f0 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83d5ffb640 1 -- 172.21.15.81:0/3316021042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83e4018070 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83d5ffb640 1 -- 172.21.15.81:0/3316021042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f83e801d040 con 0x55a61d631fc0 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 10 client.14967 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 10 client.14967 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 20 client.14967 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d642a50 0x55a61d643ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 4 client.14967 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.895+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 --> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a61d596600 con 0x55a61d642a50 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.896+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d642a50 0x55a61d643ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.896+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d642a50 0x55a61d643ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5dfff12da467a851 server_cookie=21201b42013b4c5b in_seq=0 out_seq=0 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.896+0000 7f83d5ffb640 10 client.14967 ms_handle_connect on v2:172.21.15.173:6836/359177011 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83d5ffb640 1 -- 172.21.15.81:0/3316021042 <== mds.4 v2:172.21.15.173:6836/359177011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a61d596600 con 0x55a61d642a50 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83d5ffb640 10 client.14967 handle_command_reply: tid=0 2024-09-12T12:15:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 client.14967 shutdown 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 msgr2=0x55a61d62f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62f050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f83e800da70 tx=0x7f83e80046c0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 shutdown_connections 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62f050 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d642a50 0x55a61d643ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d627700 0x55a61d62eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83d5ffb640 0 client.14967 ms_handle_reset on v2:172.21.15.173:6836/359177011 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 --2- 172.21.15.81:0/3316021042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d626de0 0x55a61d6317c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 >> 172.21.15.81:0/3316021042 conn(0x55a61d623370 msgr2=0x55a61d629050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 shutdown_connections 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 1 -- 172.21.15.81:0/3316021042 wait complete. 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.897+0000 7f83f7385740 20 client.14967 trim_cache size 0 max 16384 2024-09-12T12:15:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 Processor -- start 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 -- start start 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d62ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d62f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a61d642200 con 0x55a61d631fc0 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a61d6428d0 con 0x55a61d626de0 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83f7385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a61d642fa0 con 0x55a61d627700 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44052/0 (socket says 172.21.15.81:44052) 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 -- 172.21.15.81:0/3771485203 learned_addr learned my addr 172.21.15.81:0/3771485203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83ee59c640 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d62ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 -- 172.21.15.81:0/3771485203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 msgr2=0x55a61d62f010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:15:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d62f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 -- 172.21.15.81:0/3771485203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 msgr2=0x55a61d62ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d62ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.915+0000 7f83eed9d640 1 -- 172.21.15.81:0/3771485203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a61d626c10 con 0x55a61d631fc0 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.916+0000 7f83eed9d640 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62d3e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83e8004690 tx=0x7f83e800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d31f5bb8132a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.916+0000 7f83d7fff640 1 -- 172.21.15.81:0/3771485203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e803a070 con 0x55a61d631fc0 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.916+0000 7f83d7fff640 1 -- 172.21.15.81:0/3771485203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83e800de70 con 0x55a61d631fc0 2024-09-12T12:15:49.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.916+0000 7f83d7fff640 1 -- 172.21.15.81:0/3771485203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8024040 con 0x55a61d631fc0 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.916+0000 7f83f7385740 1 -- 172.21.15.81:0/3771485203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 msgr2=0x55a61d62d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.916+0000 7f83f7385740 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62d3e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83e8004690 tx=0x7f83e800a780 comp rx=0 tx=0).stop 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- 172.21.15.81:0/3771485203 shutdown_connections 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d631fc0 0x55a61d62d3e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d62f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 --2- 172.21.15.81:0/3771485203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d626de0 0x55a61d62ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- 172.21.15.81:0/3771485203 >> 172.21.15.81:0/3771485203 conn(0x55a61d623370 msgr2=0x55a61d62e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- 172.21.15.81:0/3771485203 shutdown_connections 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- 172.21.15.81:0/3771485203 wait complete. 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- start start 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 Processor -- start 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 0x55a61d6475f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d647b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d631fc0 0x55a61d6ab150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a61d643d40 con 0x55a61d626de0 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a61d643670 con 0x55a61d631fc0 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a61d644410 con 0x55a61d627700 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83f7385740 10 client.0 _ll_register_callbacks cb 0x7f83e8004360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:49.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 0x55a61d6475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 0x55a61d6475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44056/0 (socket says 172.21.15.81:44056) 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.917+0000 7f83ee59c640 1 -- 172.21.15.81:0/1502807627 learned_addr learned my addr 172.21.15.81:0/1502807627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83eed9d640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d631fc0 0x55a61d6ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83ee59c640 1 -- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 msgr2=0x55a61d647b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83ee59c640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d647b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83ee59c640 1 -- 172.21.15.81:0/1502807627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d631fc0 msgr2=0x55a61d6ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83ee59c640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d631fc0 0x55a61d6ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83ee59c640 1 -- 172.21.15.81:0/1502807627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a61d6ab690 con 0x55a61d626de0 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83eed9d640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d631fc0 0x55a61d6ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83ee59c640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 0x55a61d6475f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83e00b8fc0 tx=0x7f83e0037fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0c52e9c7ff1dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83d5ffb640 1 -- 172.21.15.81:0/1502807627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00bc4c0 con 0x55a61d626de0 2024-09-12T12:15:49.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83d5ffb640 1 -- 172.21.15.81:0/1502807627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f83e0036d80 con 0x55a61d626de0 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e800de70 con 0x55a61d626de0 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83d5ffb640 1 -- 172.21.15.81:0/1502807627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f83e0030b40 con 0x55a61d626de0 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83f7385740 10 client.14973 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a61d6ac8c0 con 0x55a61d626de0 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83d5ffb640 1 -- 172.21.15.81:0/1502807627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83e800de70 con 0x55a61d626de0 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.918+0000 7f83d5ffb640 1 -- 172.21.15.81:0/1502807627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f83e004d030 con 0x55a61d626de0 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83f7385740 10 client.14973 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83f7385740 10 client.14973 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83f7385740 20 client.14973 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83f7385740 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d6b1440 0x55a61d6b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:49.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83f7385740 4 client.14973 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 --> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] -- command(tid 0: {"prefix": "status"}) -- 0x55a61d590b10 con 0x55a61d6b1440 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83edd9b640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d6b1440 0x55a61d6b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83edd9b640 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d6b1440 0x55a61d6b0150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=10763ca8c3385664 server_cookie=f2b61b3258927f32 in_seq=0 out_seq=0 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.919+0000 7f83d5ffb640 10 client.14973 ms_handle_connect on v2:172.21.15.173:6836/359177011 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83d5ffb640 1 -- 172.21.15.81:0/1502807627 <== mds.4 v2:172.21.15.173:6836/359177011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a61d590b10 con 0x55a61d6b1440 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83d5ffb640 10 client.14973 handle_command_reply: tid=0 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 client.14973 shutdown 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 msgr2=0x55a61d6475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 0x55a61d6475f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83e00b8fc0 tx=0x7f83e0037fb0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 shutdown_connections 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55a61d6b1440 0x55a61d6b0150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a61d631fc0 0x55a61d6ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a61d627700 0x55a61d647b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 --2- 172.21.15.81:0/1502807627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a61d626de0 0x55a61d6475f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 >> 172.21.15.81:0/1502807627 conn(0x55a61d623370 msgr2=0x55a61d62ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83d5ffb640 0 client.14973 ms_handle_reset on v2:172.21.15.173:6836/359177011 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 shutdown_connections 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 1 -- 172.21.15.81:0/1502807627 wait complete. 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f7385740 20 client.14973 trim_cache size 0 max 16384 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-09-12T12:15:49.937 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24436, 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 63.719409671000001, 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 98.716871898999997 2024-09-12T12:15:49.938 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f83d80a2c10 msgr2=0x7f83d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f83d80a2c10 0x7f83d80a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83e80058c0 tx=0x7f83e800a250 comp rx=0 tx=0).stop 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 msgr2=0x7f83f0198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0198580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83e0000f80 tx=0x7f83e0030e30 comp rx=0 tx=0).stop 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 shutdown_connections 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f83d80a2c10 0x7f83d80a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f83f0102ef0 0x7f83f019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83f0102570 0x7f83f0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 --2- 172.21.15.81:0/663212949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0100e20 0x7f83f0198580 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:49.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.920+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 >> 172.21.15.81:0/663212949 conn(0x7f83f00fc7d0 msgr2=0x7f83f00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:49.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.921+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 shutdown_connections 2024-09-12T12:15:49.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:49.921+0000 7f83f4fac640 1 -- 172.21.15.81:0/663212949 wait complete. 2024-09-12T12:15:49.940 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:49 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3997575698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:15:50.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-12T12:15:50.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:50 smithi081 ceph-mon[30948]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:50.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:50 smithi173 ceph-mon[35326]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:50.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:50 smithi103 ceph-mon[35094]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 -- 172.21.15.81:0/2425123463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 msgr2=0x7f060c100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 --2- 172.21.15.81:0/2425123463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c100ca0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009900 tx=0x7f05fc02a410 comp rx=0 tx=0).stop 2024-09-12T12:15:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 -- 172.21.15.81:0/2425123463 shutdown_connections 2024-09-12T12:15:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 --2- 172.21.15.81:0/2425123463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f060c105ec0 0x7f060c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 --2- 172.21.15.81:0/2425123463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060c1011e0 0x7f060c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 --2- 172.21.15.81:0/2425123463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c100ca0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 -- 172.21.15.81:0/2425123463 >> 172.21.15.81:0/2425123463 conn(0x7f060c0fc7d0 msgr2=0x7f060c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 -- 172.21.15.81:0/2425123463 shutdown_connections 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.395+0000 7f061142c640 1 -- 172.21.15.81:0/2425123463 wait complete. 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 Processor -- start 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 -- start start 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c1a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060c1011e0 0x7f060c1a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f060c105ec0 0x7f060c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1187d0 con 0x7f060c1008c0 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f060c118650 con 0x7f060c1011e0 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f061142c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f060c118950 con 0x7f060c105ec0 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c1a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c1a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44066/0 (socket says 172.21.15.81:44066) 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 -- 172.21.15.81:0/2387226789 learned_addr learned my addr 172.21.15.81:0/2387226789 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f0603fff640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060c1011e0 0x7f060c1a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 -- 172.21.15.81:0/2387226789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f060c105ec0 msgr2=0x7f060c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f060c105ec0 0x7f060c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 -- 172.21.15.81:0/2387226789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060c1011e0 msgr2=0x7f060c1a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060c1011e0 0x7f060c1a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.396+0000 7f060affd640 1 -- 172.21.15.81:0/2387226789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c19f210 con 0x7f060c1008c0 2024-09-12T12:15:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.397+0000 7f060affd640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c1a4920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f05fc006010 tx=0x7f05fc004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.397+0000 7f0608ff9640 1 -- 172.21.15.81:0/2387226789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc03f030 con 0x7f060c1008c0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.397+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c19f4a0 con 0x7f060c1008c0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.397+0000 7f0608ff9640 1 -- 172.21.15.81:0/2387226789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05fc005500 con 0x7f060c1008c0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.397+0000 7f0608ff9640 1 -- 172.21.15.81:0/2387226789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc035070 con 0x7f060c1008c0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.397+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c1ab7f0 con 0x7f060c1008c0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.399+0000 7f0608ff9640 1 -- 172.21.15.81:0/2387226789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f05fc042030 con 0x7f060c1008c0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.399+0000 7f0613805740 1 Processor -- start 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.399+0000 7f0613805740 1 -- start start 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.399+0000 7f0613805740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0613805740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0613805740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0613805740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c2b433090 con 0x559c2b4d7bb0 2024-09-12T12:15:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0613805740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c2b3daa70 con 0x559c2b4cc9d0 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0613805740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c2b42f050 con 0x559c2b4cd2f0 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0608ff9640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f05f80a2c90 0x7f05f80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44080/0 (socket says 172.21.15.81:44080) 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 -- 172.21.15.81:0/656440044 learned_addr learned my addr 172.21.15.81:0/656440044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f060b7fe640 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f060b7fe640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f05f80a2c90 0x7f05f80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0608ff9640 1 -- 172.21.15.81:0/2387226789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f05fc0ef760 con 0x7f060c1008c0 2024-09-12T12:15:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f060affd640 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 -- 172.21.15.81:0/656440044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cd2f0 msgr2=0x559c2b4d7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 -- 172.21.15.81:0/656440044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cc9d0 msgr2=0x559c2b4ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 -- 172.21.15.81:0/656440044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c2b3e7130 con 0x559c2b4d7bb0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f0603fff640 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d9fa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cc00 tx=0x7f05f400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e98a646d53b53e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f060b7fe640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f05f80a2c90 0x7f05f80a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0604008fd0 tx=0x7f0604006ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f06017fa640 1 -- 172.21.15.81:0/656440044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4005220 con 0x559c2b4d7bb0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f06017fa640 1 -- 172.21.15.81:0/656440044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05f4004ca0 con 0x559c2b4d7bb0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.400+0000 7f06017fa640 1 -- 172.21.15.81:0/656440044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f40109d0 con 0x559c2b4d7bb0 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 -- 172.21.15.81:0/656440044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 msgr2=0x559c2b4d9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d9fa0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cc00 tx=0x7f05f400e720 comp rx=0 tx=0).stop 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 -- 172.21.15.81:0/656440044 shutdown_connections 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d9fa0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 --2- 172.21.15.81:0/656440044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 -- 172.21.15.81:0/656440044 >> 172.21.15.81:0/656440044 conn(0x559c2b4c8f60 msgr2=0x559c2b4c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 -- 172.21.15.81:0/656440044 shutdown_connections 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.401+0000 7f0613805740 1 -- 172.21.15.81:0/656440044 wait complete. 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 -- start start 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 Processor -- start 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 0x559c2b4d73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4da780 con 0x559c2b4cc9d0 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c2b3edf20 con 0x559c2b4cd2f0 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4da900 con 0x559c2b4d7bb0 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 0x559c2b4d73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0613805740 10 client.0 _ll_register_callbacks cb 0x559c2b3b7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 0x559c2b4d73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44082/0 (socket says 172.21.15.81:44082) 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 -- 172.21.15.81:0/946890908 learned_addr learned my addr 172.21.15.81:0/946890908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 -- 172.21.15.81:0/946890908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4d7bb0 msgr2=0x559c2b4d4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 -- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 msgr2=0x559c2b4d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0603fff640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f060affd640 1 -- 172.21.15.81:0/946890908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c2b1a42b0 con 0x559c2b4cc9d0 2024-09-12T12:15:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.402+0000 7f0603fff640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f060affd640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 0x559c2b4d73b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0bbc60 tx=0x7f05fc0bbaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534ca94d4eccf4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f05f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f05f27fc640 1 -- 172.21.15.81:0/946890908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc049070 con 0x559c2b4cc9d0 2024-09-12T12:15:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f05f27fc640 1 -- 172.21.15.81:0/946890908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f05fc0bc1c0 con 0x559c2b4cc9d0 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f4004ca0 con 0x559c2b4cc9d0 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f05f27fc640 1 -- 172.21.15.81:0/946890908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f05fc0bc660 con 0x559c2b4cc9d0 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 10 client.14985 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559c2b4e6010 con 0x559c2b4cc9d0 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f05f27fc640 1 -- 172.21.15.81:0/946890908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05f4004ca0 con 0x559c2b4cc9d0 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f05f27fc640 1 -- 172.21.15.81:0/946890908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f05fc0c4740 con 0x559c2b4cc9d0 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 10 client.14985 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 10 client.14985 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 20 client.14985 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b4e8780 0x559c2b4e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 4 client.14985 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.403+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 --> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c2b440600 con 0x559c2b4e8780 2024-09-12T12:15:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.404+0000 7f0603fff640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b4e8780 0x559c2b4e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.404+0000 7f0603fff640 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b4e8780 0x559c2b4e9bf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=24db5fede980ec41 server_cookie=45c314ce7e0afd59 in_seq=0 out_seq=0 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.404+0000 7f05f27fc640 10 client.14985 ms_handle_connect on v2:172.21.15.103:6834/4242406176 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f05f27fc640 1 -- 172.21.15.81:0/946890908 <== mds.3 v2:172.21.15.103:6834/4242406176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c2b440600 con 0x559c2b4e8780 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f05f27fc640 10 client.14985 handle_command_reply: tid=0 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 client.14985 shutdown 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 msgr2=0x559c2b4d73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 0x559c2b4d73b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0bbc60 tx=0x7f05fc0bbaa0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 shutdown_connections 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b4e8780 0x559c2b4e9bf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f05f27fc640 0 client.14985 ms_handle_reset on v2:172.21.15.103:6834/4242406176 2024-09-12T12:15:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 --2- 172.21.15.81:0/946890908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cc9d0 0x559c2b4d73b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 >> 172.21.15.81:0/946890908 conn(0x559c2b4c8f60 msgr2=0x559c2b4cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 shutdown_connections 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 1 -- 172.21.15.81:0/946890908 wait complete. 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.405+0000 7f0613805740 20 client.14985 trim_cache size 0 max 16384 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.422+0000 7f0613805740 1 Processor -- start 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.422+0000 7f0613805740 1 -- start start 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0613805740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0613805740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 0x559c2b4e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0613805740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0613805740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4e7f30 con 0x559c2b4cd2f0 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0613805740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4e8600 con 0x559c2b4d7bb0 2024-09-12T12:15:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0613805740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4e8cd0 con 0x559c2b4cc9d0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 0x559c2b4e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 0x559c2b4e8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44084/0 (socket says 172.21.15.81:44084) 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 -- 172.21.15.81:0/1766175736 learned_addr learned my addr 172.21.15.81:0/1766175736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f060b7fe640 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 -- 172.21.15.81:0/1766175736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 msgr2=0x559c2b4e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 -- 172.21.15.81:0/1766175736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4d7bb0 msgr2=0x559c2b4d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 -- 172.21.15.81:0/1766175736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c2b4e4330 con 0x559c2b4cd2f0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0603fff640 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 0x559c2b4e8e50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cb20 tx=0x7f05f400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bd01941e733685 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0600ff9640 1 -- 172.21.15.81:0/1766175736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f40054e0 con 0x559c2b4cd2f0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0600ff9640 1 -- 172.21.15.81:0/1766175736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05f4003af0 con 0x559c2b4cd2f0 2024-09-12T12:15:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.423+0000 7f0600ff9640 1 -- 172.21.15.81:0/1766175736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4010b30 con 0x559c2b4cd2f0 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 -- 172.21.15.81:0/1766175736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 msgr2=0x559c2b4e8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 0x559c2b4e8e50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cb20 tx=0x7f05f400cf60 comp rx=0 tx=0).stop 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 -- 172.21.15.81:0/1766175736 shutdown_connections 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4d7bb0 0x559c2b4d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4cd2f0 0x559c2b4e8e50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 --2- 172.21.15.81:0/1766175736 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 -- 172.21.15.81:0/1766175736 >> 172.21.15.81:0/1766175736 conn(0x559c2b4c8f60 msgr2=0x559c2b4e7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 -- 172.21.15.81:0/1766175736 shutdown_connections 2024-09-12T12:15:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.424+0000 7f0613805740 1 -- 172.21.15.81:0/1766175736 wait complete. 2024-09-12T12:15:51.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 -- start start 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 Processor -- start 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4e9a70 con 0x559c2b4d7bb0 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4e93a0 con 0x559c2b4cd2f0 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559c2b4ea140 con 0x559c2b4cc9d0 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0613805740 10 client.0 _ll_register_callbacks cb 0x7f05fc005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44100/0 (socket says 172.21.15.81:44100) 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 -- 172.21.15.81:0/3836509566 learned_addr learned my addr 172.21.15.81:0/3836509566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:51.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f0603fff640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060affd640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 -- 172.21.15.81:0/3836509566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 msgr2=0x559c2b4ecc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 -- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 msgr2=0x559c2b4ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 -- 172.21.15.81:0/3836509566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c2b550f50 con 0x559c2b4d7bb0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.425+0000 7f060b7fe640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4ed6e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f06040042f0 tx=0x7f060400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdcfa57ebfed87a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f05f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f05f27fc640 1 -- 172.21.15.81:0/3836509566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060400de80 con 0x559c2b4d7bb0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f05f27fc640 1 -- 172.21.15.81:0/3836509566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f0604014810 con 0x559c2b4d7bb0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f4003af0 con 0x559c2b4d7bb0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f05f27fc640 1 -- 172.21.15.81:0/3836509566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0604014a10 con 0x559c2b4d7bb0 2024-09-12T12:15:51.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 10 client.14991 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559c2b552230 con 0x559c2b4d7bb0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f05f27fc640 1 -- 172.21.15.81:0/3836509566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05f4003af0 con 0x559c2b4d7bb0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f05f27fc640 1 -- 172.21.15.81:0/3836509566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f0604023070 con 0x559c2b4d7bb0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 10 client.14991 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 10 client.14991 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 20 client.14991 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b556ec0 0x559c2b555bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 4 client.14991 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.426+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 --> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] -- command(tid 0: {"prefix": "status"}) -- 0x559c2b43ab10 con 0x559c2b556ec0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f060affd640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b556ec0 0x559c2b555bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f05f27fc640 10 client.14991 ms_handle_connect on v2:172.21.15.103:6834/4242406176 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f060affd640 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b556ec0 0x559c2b555bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=748275726fd14a5a server_cookie=7a1aa571ee5eee72 in_seq=0 out_seq=0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f05f27fc640 1 -- 172.21.15.81:0/3836509566 <== mds.3 v2:172.21.15.103:6834/4242406176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559c2b43ab10 con 0x559c2b556ec0 2024-09-12T12:15:51.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f05f27fc640 10 client.14991 handle_command_reply: tid=0 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 client.14991 shutdown 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 msgr2=0x559c2b4ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4ed6e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f06040042f0 tx=0x7f060400b6f0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 shutdown_connections 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c2b4d7bb0 0x559c2b4ed6e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c2b4cd2f0 0x559c2b4ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x559c2b556ec0 0x559c2b555bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 --2- 172.21.15.81:0/3836509566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559c2b4cc9d0 0x559c2b4ecc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 >> 172.21.15.81:0/3836509566 conn(0x559c2b4c8f60 msgr2=0x559c2b4e7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.427+0000 7f05f27fc640 0 client.14991 ms_handle_reset on v2:172.21.15.103:6834/4242406176 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 shutdown_connections 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f0613805740 1 -- 172.21.15.81:0/3836509566 wait complete. 2024-09-12T12:15:51.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f0613805740 20 client.14991 trim_cache size 0 max 16384 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24437, 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 66.236650788999995, 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:15:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:15:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:15:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 105.26686760600001 2024-09-12T12:15:51.447 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:15:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f05f80a2c90 msgr2=0x7f05f80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f05f80a2c90 0x7f05f80a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0604008fd0 tx=0x7f0604006ce0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 msgr2=0x7f060c1a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c1a4920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f05fc006010 tx=0x7f05fc004c00 comp rx=0 tx=0).stop 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 shutdown_connections 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f05f80a2c90 0x7f05f80a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f060c105ec0 0x7f060c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f060c1011e0 0x7f060c1a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 --2- 172.21.15.81:0/2387226789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c1008c0 0x7f060c1a4920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 >> 172.21.15.81:0/2387226789 conn(0x7f060c0fc7d0 msgr2=0x7f060c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 shutdown_connections 2024-09-12T12:15:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:51.428+0000 7f061142c640 1 -- 172.21.15.81:0/2387226789 wait complete. 2024-09-12T12:15:52.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:15:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 -- 172.21.15.81:0/3592253107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304101420 msgr2=0x7f030410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 --2- 172.21.15.81:0/3592253107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304101420 0x7f030410d950 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009cd0 tx=0x7f02fc02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 -- 172.21.15.81:0/3592253107 shutdown_connections 2024-09-12T12:15:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 --2- 172.21.15.81:0/3592253107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304101420 0x7f030410d950 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 --2- 172.21.15.81:0/3592253107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0304100a80 0x7f0304100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 --2- 172.21.15.81:0/3592253107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0304106a80 0x7f0304106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 -- 172.21.15.81:0/3592253107 >> 172.21.15.81:0/3592253107 conn(0x7f03040fc7a0 msgr2=0x7f03040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.768+0000 7f030c603640 1 -- 172.21.15.81:0/3592253107 shutdown_connections 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 -- 172.21.15.81:0/3592253107 wait complete. 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 Processor -- start 2024-09-12T12:15:52.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 -- start start 2024-09-12T12:15:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 0x7f03041986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0304101420 0x7f0304198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0304106a80 0x7f030419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0304111060 con 0x7f0304100a80 2024-09-12T12:15:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0304110ee0 con 0x7f0304101420 2024-09-12T12:15:52.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030c603640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f03041111e0 con 0x7f0304106a80 2024-09-12T12:15:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030a39f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 0x7f03041986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030a39f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 0x7f03041986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57132/0 (socket says 172.21.15.81:57132) 2024-09-12T12:15:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.769+0000 7f030a39f640 1 -- 172.21.15.81:0/4266543936 learned_addr learned my addr 172.21.15.81:0/4266543936 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f0309b9e640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0304101420 0x7f0304198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030a39f640 1 -- 172.21.15.81:0/4266543936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0304106a80 msgr2=0x7f030419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030a39f640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0304106a80 0x7f030419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030a39f640 1 -- 172.21.15.81:0/4266543936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0304101420 msgr2=0x7f0304198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030a39f640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0304101420 0x7f0304198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030a39f640 1 -- 172.21.15.81:0/4266543936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030419d670 con 0x7f0304100a80 2024-09-12T12:15:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030a39f640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 0x7f03041986c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f030000b4a0 tx=0x7f030000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f02fb7fe640 1 -- 172.21.15.81:0/4266543936 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300014070 con 0x7f0304100a80 2024-09-12T12:15:52.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f02fb7fe640 1 -- 172.21.15.81:0/4266543936 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0300010b10 con 0x7f0304100a80 2024-09-12T12:15:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030419d960 con 0x7f0304100a80 2024-09-12T12:15:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f02fb7fe640 1 -- 172.21.15.81:0/4266543936 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300017d60 con 0x7f0304100a80 2024-09-12T12:15:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.770+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03041a5240 con 0x7f0304100a80 2024-09-12T12:15:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.772+0000 7f02fb7fe640 1 -- 172.21.15.81:0/4266543936 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0300017070 con 0x7f0304100a80 2024-09-12T12:15:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.773+0000 7f030e9dc740 1 Processor -- start 2024-09-12T12:15:52.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.773+0000 7f030e9dc740 1 -- start start 2024-09-12T12:15:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.773+0000 7f02fb7fe640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f02f00a2d10 0x7f02f00a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab011b70 0x5590ab011f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00c540 0x5590ab00c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab018970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030e9dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590aaf69090 con 0x5590ab00cf00 2024-09-12T12:15:52.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030e9dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5590aaf10a70 con 0x5590ab00c540 2024-09-12T12:15:52.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030e9dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590aaf65050 con 0x5590ab011b70 2024-09-12T12:15:52.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030aba0640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f02f00a2d10 0x7f02f00a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f02fb7fe640 1 -- 172.21.15.81:0/4266543936 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f03000ce4d0 con 0x7f0304100a80 2024-09-12T12:15:52.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030aba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab018970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030a39f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab011b70 0x5590ab011f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030aba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab018970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57146/0 (socket says 172.21.15.81:57146) 2024-09-12T12:15:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030aba0640 1 -- 172.21.15.81:0/3414789726 learned_addr learned my addr 172.21.15.81:0/3414789726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f0309b9e640 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00c540 0x5590ab00c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030aba0640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f02f00a2d10 0x7f02f00a51d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0316e0 tx=0x7f02fc005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030a39f640 1 -- 172.21.15.81:0/3414789726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00c540 msgr2=0x5590ab00c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030a39f640 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00c540 0x5590ab00c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030a39f640 1 -- 172.21.15.81:0/3414789726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 msgr2=0x5590ab018970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030a39f640 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab018970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030a39f640 1 -- 172.21.15.81:0/3414789726 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590aaf1d130 con 0x5590ab011b70 2024-09-12T12:15:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.774+0000 7f030aba0640 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab018970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:15:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.775+0000 7f030a39f640 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab011b70 0x5590ab011f50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03000cbf90 tx=0x7f030009abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b544d24aa00eca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:52.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.775+0000 7f02f8ff9640 1 -- 172.21.15.81:0/3414789726 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03000ce070 con 0x5590ab011b70 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.775+0000 7f02f8ff9640 1 -- 172.21.15.81:0/3414789726 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f030009ace0 con 0x5590ab011b70 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.775+0000 7f02f8ff9640 1 -- 172.21.15.81:0/3414789726 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300010cc0 con 0x5590ab011b70 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- 172.21.15.81:0/3414789726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab011b70 msgr2=0x5590ab011f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab011b70 0x5590ab011f50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03000cbf90 tx=0x7f030009abe0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- 172.21.15.81:0/3414789726 shutdown_connections 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab018970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00c540 0x5590ab00c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3414789726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab011b70 0x5590ab011f50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- 172.21.15.81:0/3414789726 >> 172.21.15.81:0/3414789726 conn(0x5590aaffea10 msgr2=0x5590aaffedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- 172.21.15.81:0/3414789726 shutdown_connections 2024-09-12T12:15:52.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- 172.21.15.81:0/3414789726 wait complete. 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- start start 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 Processor -- start 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab018760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab015ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab015ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.776+0000 7f030e9dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590ab018fd0 con 0x5590ab00cf00 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f030e9dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5590aaf23f20 con 0x5590ab011b70 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f030e9dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590ab019150 con 0x5590ab00c540 2024-09-12T12:15:52.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f030e9dc740 10 client.0 _ll_register_callbacks cb 0x5590aaeed030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab015ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab015ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57156/0 (socket says 172.21.15.81:57156) 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 -- 172.21.15.81:0/3931743391 learned_addr learned my addr 172.21.15.81:0/3931743391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f030a39f640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab018760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f030aba0640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab015ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 -- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 msgr2=0x5590ab018760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab018760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 -- 172.21.15.81:0/3931743391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 msgr2=0x5590ab015ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab015ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 -- 172.21.15.81:0/3931743391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590aacda2b0 con 0x5590ab00cf00 2024-09-12T12:15:52.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f0309b9e640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab015ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02f400f4f0 tx=0x7f02f400f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c9ef7b89ec2ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:52.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f02edffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:52.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f02edffb640 1 -- 172.21.15.81:0/3931743391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4013850 con 0x5590ab00cf00 2024-09-12T12:15:52.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f02edffb640 1 -- 172.21.15.81:0/3931743391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f02f40139f0 con 0x5590ab00cf00 2024-09-12T12:15:52.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.777+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f030009ace0 con 0x5590ab00cf00 2024-09-12T12:15:52.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f02edffb640 1 -- 172.21.15.81:0/3931743391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f02f4013bf0 con 0x5590ab00cf00 2024-09-12T12:15:52.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 10 client.15003 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:52.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5590ab024950 con 0x5590ab00cf00 2024-09-12T12:15:52.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f02edffb640 1 -- 172.21.15.81:0/3931743391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f030009ace0 con 0x5590ab00cf00 2024-09-12T12:15:52.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f02edffb640 1 -- 172.21.15.81:0/3931743391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f02f401b400 con 0x5590ab00cf00 2024-09-12T12:15:52.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 10 client.15003 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:52.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 10 client.15003 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:15:52.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 20 client.15003 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:52.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab026f80 0x5590ab0283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 4 client.15003 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 --> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590aaf76600 con 0x5590ab026f80 2024-09-12T12:15:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.778+0000 7f030a39f640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab026f80 0x5590ab0283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.779+0000 7f02edffb640 10 client.15003 ms_handle_connect on v2:172.21.15.173:6838/2860435891 2024-09-12T12:15:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.779+0000 7f030a39f640 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab026f80 0x5590ab0283f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30c61014737bd8c1 server_cookie=506dad6d5f748340 in_seq=0 out_seq=0 2024-09-12T12:15:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.779+0000 7f02edffb640 1 -- 172.21.15.81:0/3931743391 <== mds.2 v2:172.21.15.173:6838/2860435891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590aaf76600 con 0x5590ab026f80 2024-09-12T12:15:52.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.779+0000 7f02edffb640 10 client.15003 handle_command_reply: tid=0 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 client.15003 shutdown 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 msgr2=0x5590ab015ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab015ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02f400f4f0 tx=0x7f02f400f8f0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 shutdown_connections 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab026f80 0x5590ab0283f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab015ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab015ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 --2- 172.21.15.81:0/3931743391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab018760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 >> 172.21.15.81:0/3931743391 conn(0x5590aaffea10 msgr2=0x5590ab00bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f02edffb640 0 client.15003 ms_handle_reset on v2:172.21.15.173:6838/2860435891 2024-09-12T12:15:52.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 shutdown_connections 2024-09-12T12:15:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 1 -- 172.21.15.81:0/3931743391 wait complete. 2024-09-12T12:15:52.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.780+0000 7f030e9dc740 20 client.15003 trim_cache size 0 max 16384 2024-09-12T12:15:52.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 Processor -- start 2024-09-12T12:15:52.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 -- start start 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab027650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00cf00 0x5590ab00bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 0x5590ab017200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590ab026730 con 0x5590ab011b70 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5590ab026e00 con 0x5590ab00cf00 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.797+0000 7f030e9dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590ab0274d0 con 0x5590ab00c540 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 0x5590ab017200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 0x5590ab017200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57160/0 (socket says 172.21.15.81:57160) 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 -- 172.21.15.81:0/82297089 learned_addr learned my addr 172.21.15.81:0/82297089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030a39f640 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab027650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f0309b9e640 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00cf00 0x5590ab00bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 -- 172.21.15.81:0/82297089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 msgr2=0x5590ab027650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab027650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 -- 172.21.15.81:0/82297089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00cf00 msgr2=0x5590ab00bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00cf00 0x5590ab00bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 -- 172.21.15.81:0/82297089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590ab002880 con 0x5590ab011b70 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f0309b9e640 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00cf00 0x5590ab00bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f030aba0640 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 0x5590ab017200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02fc02ae00 tx=0x7f02fc047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb298c273cbe3ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f02effff640 1 -- 172.21.15.81:0/82297089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc031e00 con 0x5590ab011b70 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f02effff640 1 -- 172.21.15.81:0/82297089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f02fc036050 con 0x5590ab011b70 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.798+0000 7f02effff640 1 -- 172.21.15.81:0/82297089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc03c970 con 0x5590ab011b70 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 -- 172.21.15.81:0/82297089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 msgr2=0x5590ab017200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 0x5590ab017200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02fc02ae00 tx=0x7f02fc047000 comp rx=0 tx=0).stop 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 -- 172.21.15.81:0/82297089 shutdown_connections 2024-09-12T12:15:52.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab011b70 0x5590ab017200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab00cf00 0x5590ab00bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 --2- 172.21.15.81:0/82297089 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab027650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 -- 172.21.15.81:0/82297089 >> 172.21.15.81:0/82297089 conn(0x5590aaffea10 msgr2=0x5590ab011050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 -- 172.21.15.81:0/82297089 shutdown_connections 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 -- 172.21.15.81:0/82297089 wait complete. 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 -- start start 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.799+0000 7f030e9dc740 1 Processor -- start 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab030fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab021760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab021e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5590ab028270 con 0x5590ab00cf00 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5590ab027ba0 con 0x5590ab011b70 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5590ab028940 con 0x5590ab00c540 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 10 client.0 _ll_register_callbacks cb 0x7f02f400a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab021760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab021760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57164/0 (socket says 172.21.15.81:57164) 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 -- 172.21.15.81:0/4066271251 learned_addr learned my addr 172.21.15.81:0/4066271251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030a39f640 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab030fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 -- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 msgr2=0x5590ab030fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab030fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 -- 172.21.15.81:0/4066271251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 msgr2=0x5590ab021e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:52.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab021e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 -- 172.21.15.81:0/4066271251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590ab02ea50 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f0309b9e640 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab021760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02f4004700 tx=0x7f02f401bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46092b2eefeb68b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f02edffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f02edffb640 1 -- 172.21.15.81:0/4066271251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4034060 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f02edffb640 1 -- 172.21.15.81:0/4066271251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f02f40059c0 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02fc036050 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f02edffb640 1 -- 172.21.15.81:0/4066271251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f02f4005bc0 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 10 client.15009 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.800+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5590ab0917e0 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f02edffb640 1 -- 172.21.15.81:0/4066271251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f02fc036050 con 0x5590ab00cf00 2024-09-12T12:15:52.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f02edffb640 1 -- 172.21.15.81:0/4066271251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f02f4039070 con 0x5590ab00cf00 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030e9dc740 10 client.15009 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030e9dc740 10 client.15009 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030e9dc740 20 client.15009 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030e9dc740 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab096360 0x5590ab095070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030e9dc740 4 client.15009 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 --> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] -- command(tid 0: {"prefix": "status"}) -- 0x5590aaf70b10 con 0x5590ab096360 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030a39f640 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab096360 0x5590ab095070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f030a39f640 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab096360 0x5590ab095070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9eeb1d4cbff74dd0 server_cookie=64f918fe27cce33d in_seq=0 out_seq=0 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.801+0000 7f02edffb640 10 client.15009 ms_handle_connect on v2:172.21.15.173:6838/2860435891 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f02edffb640 1 -- 172.21.15.81:0/4066271251 <== mds.2 v2:172.21.15.173:6838/2860435891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5590aaf70b10 con 0x5590ab096360 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f02edffb640 10 client.15009 handle_command_reply: tid=0 2024-09-12T12:15:52.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 client.15009 shutdown 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 msgr2=0x5590ab021760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab021760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f02f4004700 tx=0x7f02f401bcc0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 shutdown_connections 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x5590ab096360 0x5590ab095070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5590ab011b70 0x5590ab021e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590ab00cf00 0x5590ab021760 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 --2- 172.21.15.81:0/4066271251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5590ab00c540 0x5590ab030fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f02edffb640 0 client.15009 ms_handle_reset on v2:172.21.15.173:6838/2860435891 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 >> 172.21.15.81:0/4066271251 conn(0x5590aaffea10 msgr2=0x5590ab00bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 shutdown_connections 2024-09-12T12:15:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 1 -- 172.21.15.81:0/4066271251 wait complete. 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.802+0000 7f030e9dc740 20 client.15009 trim_cache size 0 max 16384 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24457, 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:15:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:15:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 68.616330301000005, 2024-09-12T12:15:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:15:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:15:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:15:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 96.488632166000002 2024-09-12T12:15:52.816 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:15:52.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f02f00a2d10 msgr2=0x7f02f00a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f02f00a2d10 0x7f02f00a51d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0316e0 tx=0x7f02fc005ef0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 msgr2=0x7f03041986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:52.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 0x7f03041986c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f030000b4a0 tx=0x7f030000b960 comp rx=0 tx=0).stop 2024-09-12T12:15:52.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 shutdown_connections 2024-09-12T12:15:52.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f02f00a2d10 0x7f02f00a51d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0304106a80 0x7f030419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0304101420 0x7f0304198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 --2- 172.21.15.81:0/4266543936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0304100a80 0x7f03041986c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:52.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 >> 172.21.15.81:0/4266543936 conn(0x7f03040fc7a0 msgr2=0x7f030406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:52.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 shutdown_connections 2024-09-12T12:15:52.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:52.803+0000 7f030c603640 1 -- 172.21.15.81:0/4266543936 wait complete. 2024-09-12T12:15:53.469 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:53 smithi081 ceph-mon[30948]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:53.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T12:15:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:53 smithi103 ceph-mon[35094]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:53.741 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:53.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:53 smithi173 ceph-mon[35326]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:15:54.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 -- 172.21.15.81:0/2326929394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 msgr2=0x7fdbe81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 --2- 172.21.15.81:0/2326929394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81029b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009900 tx=0x7fdbd002a480 comp rx=0 tx=0).stop 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 -- 172.21.15.81:0/2326929394 shutdown_connections 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 --2- 172.21.15.81:0/2326929394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe8102ef0 0x7fdbe810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 --2- 172.21.15.81:0/2326929394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81029b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 --2- 172.21.15.81:0/2326929394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe8100e20 0x7fdbe8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 -- 172.21.15.81:0/2326929394 >> 172.21.15.81:0/2326929394 conn(0x7fdbe80fc7d0 msgr2=0x7fdbe80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.167+0000 7fdbedf83640 1 -- 172.21.15.81:0/2326929394 shutdown_connections 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.168+0000 7fdbedf83640 1 -- 172.21.15.81:0/2326929394 wait complete. 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.168+0000 7fdbedf83640 1 Processor -- start 2024-09-12T12:15:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.168+0000 7fdbedf83640 1 -- start start 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.168+0000 7fdbedf83640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe8100e20 0x7fdbe8197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.168+0000 7fdbedf83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.168+0000 7fdbedf83640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe8102ef0 0x7fdbe8197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbedf83640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81110e0 con 0x7fdbe8102570 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbedf83640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8110f60 con 0x7fdbe8102ef0 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbedf83640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe8111260 con 0x7fdbe8100e20 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57176/0 (socket says 172.21.15.81:57176) 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/4128344464 learned_addr learned my addr 172.21.15.81:0/4128344464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe8100e20 0x7fdbe8197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe7fff640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe8102ef0 0x7fdbe8197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/4128344464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe8100e20 msgr2=0x7fdbe8197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe8100e20 0x7fdbe8197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/4128344464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe8102ef0 msgr2=0x7fdbe8197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe8102ef0 0x7fdbe8197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/4128344464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe81a6af0 con 0x7fdbe8102570 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81977c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0006010 tx=0x7fdbd0004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe4ff9640 1 -- 172.21.15.81:0/4128344464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd003f030 con 0x7fdbe8102570 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe81a6d80 con 0x7fdbe8102570 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe4ff9640 1 -- 172.21.15.81:0/4128344464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbd0005500 con 0x7fdbe8102570 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.169+0000 7fdbe4ff9640 1 -- 172.21.15.81:0/4128344464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0035070 con 0x7fdbe8102570 2024-09-12T12:15:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.170+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe81a7200 con 0x7fdbe8102570 2024-09-12T12:15:54.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.172+0000 7fdbe4ff9640 1 -- 172.21.15.81:0/4128344464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbd0042030 con 0x7fdbe8102570 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.172+0000 7fdbf035c740 1 Processor -- start 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.172+0000 7fdbf035c740 1 -- start start 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.172+0000 7fdbe4ff9640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdbd40a2c10 0x7fdbd40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.172+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 0x563431215db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5634312162f0 0x563431220670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563431220bb0 0x563431222fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbf035c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56343117c090 con 0x5634312159d0 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbf035c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563431123a70 con 0x563431220bb0 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbf035c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563431178050 con 0x5634312162f0 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 0x563431215db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe7fff640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdbd40a2c10 0x7fdbd40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 0x563431215db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57182/0 (socket says 172.21.15.81:57182) 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 -- 172.21.15.81:0/3305298728 learned_addr learned my addr 172.21.15.81:0/3305298728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe4ff9640 1 -- 172.21.15.81:0/4128344464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fdbd00ef7b0 con 0x7fdbe8102570 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5634312162f0 0x563431220670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 -- 172.21.15.81:0/3305298728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5634312162f0 msgr2=0x563431220670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5634312162f0 0x563431220670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 -- 172.21.15.81:0/3305298728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563431220bb0 msgr2=0x563431222fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563431220bb0 0x563431222fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 -- 172.21.15.81:0/3305298728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563431130130 con 0x5634312159d0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe7fff640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdbd40a2c10 0x7fdbd40a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ad70 tx=0x7fdbe000e720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 0x563431215db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800b820 tx=0x7fdbd800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bedee6153c32afc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbddffb640 1 -- 172.21.15.81:0/3305298728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800d950 con 0x5634312159d0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbddffb640 1 -- 172.21.15.81:0/3305298728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbd8019070 con 0x5634312159d0 2024-09-12T12:15:54.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.173+0000 7fdbddffb640 1 -- 172.21.15.81:0/3305298728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80123e0 con 0x5634312159d0 2024-09-12T12:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 -- 172.21.15.81:0/3305298728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 msgr2=0x563431215db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 0x563431215db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800b820 tx=0x7fdbd800bce0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 -- 172.21.15.81:0/3305298728 shutdown_connections 2024-09-12T12:15:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563431220bb0 0x563431222fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5634312162f0 0x563431220670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3305298728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312159d0 0x563431215db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 -- 172.21.15.81:0/3305298728 >> 172.21.15.81:0/3305298728 conn(0x563431211f60 msgr2=0x563431212340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 -- 172.21.15.81:0/3305298728 shutdown_connections 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 -- 172.21.15.81:0/3305298728 wait complete. 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.174+0000 7fdbf035c740 1 -- start start 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 Processor -- start 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431220340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563431223780 con 0x5634312162f0 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563431136f20 con 0x5634312159d0 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563431223900 con 0x563431220bb0 2024-09-12T12:15:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbf035c740 10 client.0 _ll_register_callbacks cb 0x563431100030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57190/0 (socket says 172.21.15.81:57190) 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/497332180 learned_addr learned my addr 172.21.15.81:0/497332180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431220340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/497332180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 msgr2=0x56343121dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 msgr2=0x563431220340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431220340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.175+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/497332180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563430eed2b0 con 0x5634312162f0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121d6e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00bbf40 tx=0x7fdbd0037f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aaca57b0ea95f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/497332180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0049070 con 0x5634312162f0 2024-09-12T12:15:54.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/497332180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fdbd00b8620 con 0x5634312162f0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd8019070 con 0x5634312162f0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/497332180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbd00bb910 con 0x5634312162f0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 10 client.15021 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56343122efd0 con 0x5634312162f0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/497332180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbd8019070 con 0x5634312162f0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/497332180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fdbd00da050 con 0x5634312162f0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 10 client.15021 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 10 client.15021 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 20 client.15021 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x5634312315e0 0x563431232a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 4 client.15021 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.176+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 --> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563431189600 con 0x5634312315e0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.177+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x5634312315e0 0x563431232a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.177+0000 7fdbc6ffd640 10 client.15021 ms_handle_connect on v2:172.21.15.103:6836/4210602713 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.177+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x5634312315e0 0x563431232a50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1013cd3fc7c166a5 server_cookie=971d230d175e2f4e in_seq=0 out_seq=0 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/497332180 <== mds.1 v2:172.21.15.103:6836/4210602713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563431189600 con 0x5634312315e0 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbc6ffd640 10 client.15021 handle_command_reply: tid=0 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 client.15021 shutdown 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 msgr2=0x56343121d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121d6e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00bbf40 tx=0x7fdbd0037f30 comp rx=0 tx=0).stop 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 shutdown_connections 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x5634312315e0 0x563431232a50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121d6e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 --2- 172.21.15.81:0/497332180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431220340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 >> 172.21.15.81:0/497332180 conn(0x563431211f60 msgr2=0x563431217c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbc6ffd640 0 client.15021 ms_handle_reset on v2:172.21.15.103:6836/4210602713 2024-09-12T12:15:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 shutdown_connections 2024-09-12T12:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 1 -- 172.21.15.81:0/497332180 wait complete. 2024-09-12T12:15:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.178+0000 7fdbf035c740 20 client.15021 trim_cache size 0 max 16384 2024-09-12T12:15:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 Processor -- start 2024-09-12T12:15:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 -- start start 2024-09-12T12:15:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431231cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563431230d90 con 0x5634312162f0 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563431231460 con 0x5634312159d0 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbf035c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563431231b30 con 0x563431220bb0 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57194/0 (socket says 172.21.15.81:57194) 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/3330328462 learned_addr learned my addr 172.21.15.81:0/3330328462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe7fff640 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/3330328462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 msgr2=0x56343121c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/3330328462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 msgr2=0x563431231cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431231cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431231cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/3330328462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563431211d90 con 0x5634312162f0 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.196+0000 7fdbe7fff640 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121bfb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00ba260 tx=0x7fdbd0003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f89b14913bbd65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbdd7fa640 1 -- 172.21.15.81:0/3330328462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0085070 con 0x5634312162f0 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbdd7fa640 1 -- 172.21.15.81:0/3330328462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbd0087050 con 0x5634312162f0 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbdd7fa640 1 -- 172.21.15.81:0/3330328462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0049070 con 0x5634312162f0 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 -- 172.21.15.81:0/3330328462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 msgr2=0x56343121bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121bfb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdbd00ba260 tx=0x7fdbd0003680 comp rx=0 tx=0).stop 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 -- 172.21.15.81:0/3330328462 shutdown_connections 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x56343121c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x56343121bfb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 --2- 172.21.15.81:0/3330328462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431231cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.197+0000 7fdbf035c740 1 -- 172.21.15.81:0/3330328462 >> 172.21.15.81:0/3330328462 conn(0x563431211f60 msgr2=0x56343120cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 -- 172.21.15.81:0/3330328462 shutdown_connections 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 -- 172.21.15.81:0/3330328462 wait complete. 2024-09-12T12:15:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 -- start start 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 Processor -- start 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431235c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x5634312361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x5634312366e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5634312328d0 con 0x5634312162f0 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563431232200 con 0x5634312159d0 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563431232fa0 con 0x563431220bb0 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.198+0000 7fdbf035c740 10 client.0 _ll_register_callbacks cb 0x7fdbd0005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x5634312361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x5634312361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57210/0 (socket says 172.21.15.81:57210) 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/2744448686 learned_addr learned my addr 172.21.15.81:0/2744448686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431235c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe7fff640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x5634312366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/2744448686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 msgr2=0x5634312366e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x5634312366e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 msgr2=0x563431235c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431235c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 -- 172.21.15.81:0/2744448686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563431299eb0 con 0x5634312162f0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbe6ffd640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x5634312361a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005ec0 tx=0x7fdbd00ba4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bfba394db7ffa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/2744448686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0085070 con 0x5634312162f0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/2744448686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fdbd00bc290 con 0x5634312162f0 2024-09-12T12:15:54.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbd0087050 con 0x5634312162f0 2024-09-12T12:15:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/2744448686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbd0049050 con 0x5634312162f0 2024-09-12T12:15:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbf035c740 10 client.15027 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563431299eb0 con 0x5634312162f0 2024-09-12T12:15:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.199+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/2744448686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbd0087050 con 0x5634312162f0 2024-09-12T12:15:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/2744448686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fdbd00da040 con 0x5634312162f0 2024-09-12T12:15:54.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbf035c740 10 client.15027 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbf035c740 10 client.15027 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbf035c740 20 client.15027 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbf035c740 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x56343129f500 0x56343129e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbf035c740 4 client.15027 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 --> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] -- command(tid 0: {"prefix": "status"}) -- 0x563431183b10 con 0x56343129f500 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x56343129f500 0x56343129e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbe77fe640 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x56343129f500 0x56343129e210 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45b099ea03d089b9 server_cookie=1e3c010071dbec4f in_seq=0 out_seq=0 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbc6ffd640 10 client.15027 ms_handle_connect on v2:172.21.15.103:6836/4210602713 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbc6ffd640 1 -- 172.21.15.81:0/2744448686 <== mds.1 v2:172.21.15.103:6836/4210602713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563431183b10 con 0x56343129f500 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.200+0000 7fdbc6ffd640 10 client.15027 handle_command_reply: tid=0 2024-09-12T12:15:54.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 client.15027 shutdown 2024-09-12T12:15:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 msgr2=0x5634312361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x5634312361a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005ec0 tx=0x7fdbd00ba4c0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 shutdown_connections 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x56343129f500 0x56343129e210 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563431220bb0 0x5634312366e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5634312162f0 0x5634312361a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbc6ffd640 0 client.15027 ms_handle_reset on v2:172.21.15.103:6836/4210602713 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 --2- 172.21.15.81:0/2744448686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5634312159d0 0x563431235c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 >> 172.21.15.81:0/2744448686 conn(0x563431211f60 msgr2=0x56343121d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 shutdown_connections 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 1 -- 172.21.15.81:0/2744448686 wait complete. 2024-09-12T12:15:54.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbf035c740 20 client.15027 trim_cache size 0 max 16384 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24461, 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 71.023575202000004, 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:15:54.211 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:15:54.212 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:15:54.212 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 100.460743718 2024-09-12T12:15:54.212 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:15:54.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdbd40a2c10 msgr2=0x7fdbd40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbedf83640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdbd40a2c10 0x7fdbd40a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ad70 tx=0x7fdbe000e720 comp rx=0 tx=0).stop 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 msgr2=0x7fdbe81977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.201+0000 7fdbedf83640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81977c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0006010 tx=0x7fdbd0004c00 comp rx=0 tx=0).stop 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 shutdown_connections 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fdbd40a2c10 0x7fdbd40a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbe8102ef0 0x7fdbe8197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe8102570 0x7fdbe81977c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 --2- 172.21.15.81:0/4128344464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbe8100e20 0x7fdbe8197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 >> 172.21.15.81:0/4128344464 conn(0x7fdbe80fc7d0 msgr2=0x7fdbe8106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:54.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 shutdown_connections 2024-09-12T12:15:54.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:54.202+0000 7fdbedf83640 1 -- 172.21.15.81:0/4128344464 wait complete. 2024-09-12T12:15:55.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T12:15:55.260 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:55 smithi103 ceph-mon[35094]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:55.689 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:55 smithi081 ceph-mon[30948]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2136488699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc102360 msgr2=0x7fe0fc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2136488699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc102360 0x7fe0fc10e890 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4009cd0 tx=0x7fe0f402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2136488699 shutdown_connections 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2136488699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc102360 0x7fe0fc10e890 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2136488699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2136488699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc1079c0 0x7fe0fc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2136488699 >> 172.21.15.81:0/2136488699 conn(0x7fe0fc0fd6e0 msgr2=0x7fe0fc0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2136488699 shutdown_connections 2024-09-12T12:15:55.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.770+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2136488699 wait complete. 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 Processor -- start 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 -- start start 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc102360 0x7fe0fc1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0fc1079c0 0x7fe0fc19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc111f20 con 0x7fe0fc1019c0 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc111da0 con 0x7fe0fc1079c0 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.771+0000 7fe0fb59e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1120a0 con 0x7fe0fc102360 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57234/0 (socket says 172.21.15.81:57234) 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 -- 172.21.15.81:0/2567247675 learned_addr learned my addr 172.21.15.81:0/2567247675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0fc1079c0 0x7fe0fc19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc102360 0x7fe0fc1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 -- 172.21.15.81:0/2567247675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc102360 msgr2=0x7fe0fc1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc102360 0x7fe0fc1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 -- 172.21.15.81:0/2567247675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0fc1079c0 msgr2=0x7fe0fc19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0fc1079c0 0x7fe0fc19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 -- 172.21.15.81:0/2567247675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc19d350 con 0x7fe0fc1019c0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc102360 0x7fe0fc1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc1983a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c890 tx=0x7fe0ec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/2567247675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec004220 con 0x7fe0fc1019c0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/2567247675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0ec0043c0 con 0x7fe0fc1019c0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc19d640 con 0x7fe0fc1019c0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/2567247675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec004b10 con 0x7fe0fc1019c0 2024-09-12T12:15:55.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.772+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1a4f20 con 0x7fe0fc1019c0 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.774+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/2567247675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe0ec0051b0 con 0x7fe0fc1019c0 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 Processor -- start 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 -- start start 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe0eb7fe640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe0e40a2c90 0x7fe0e40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da8382f090 con 0x55da838c8ab0 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55da837d6a70 con 0x55da838c93d0 2024-09-12T12:15:55.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe0eb7fe640 1 -- 172.21.15.81:0/2567247675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fe0ec0cf1a0 con 0x7fe0fc1019c0 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.775+0000 7fe10309f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55da8382b050 con 0x55da838d81c0 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57248/0 (socket says 172.21.15.81:57248) 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3060916390 learned_addr learned my addr 172.21.15.81:0/3060916390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3060916390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 msgr2=0x55da838da5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838da5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3060916390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 msgr2=0x55da838d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3060916390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da837e3130 con 0x55da838c8ab0 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe0e40a2c90 0x7fe0e40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838c8e90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec005500 tx=0x7fe0ec09b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343cdd81bef24676 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0e8ff9640 1 -- 172.21.15.81:0/3060916390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec01d040 con 0x55da838c8ab0 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0e8ff9640 1 -- 172.21.15.81:0/3060916390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0ec0a4610 con 0x55da838c8ab0 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.776+0000 7fe0e8ff9640 1 -- 172.21.15.81:0/3060916390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec004cb0 con 0x55da838c8ab0 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 -- 172.21.15.81:0/3060916390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 msgr2=0x55da838c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838c8e90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec005500 tx=0x7fe0ec09b430 comp rx=0 tx=0).stop 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe0e40a2c90 0x7fe0e40a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55da838c64e0 tx=0x7fe0f4031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 -- 172.21.15.81:0/3060916390 shutdown_connections 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838da5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 --2- 172.21.15.81:0/3060916390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838c8e90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 -- 172.21.15.81:0/3060916390 >> 172.21.15.81:0/3060916390 conn(0x55da838c5160 msgr2=0x55da838c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 -- 172.21.15.81:0/3060916390 shutdown_connections 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.777+0000 7fe10309f740 1 -- 172.21.15.81:0/3060916390 wait complete. 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 -- start start 2024-09-12T12:15:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 Processor -- start 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da838dad90 con 0x55da838c8ab0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55da837e9f20 con 0x55da838c93d0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55da838daf10 con 0x55da838d81c0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe10309f740 10 client.0 _ll_register_callbacks cb 0x55da837b3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838d7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57250/0 (socket says 172.21.15.81:57250) 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3745057195 learned_addr learned my addr 172.21.15.81:0/3745057195 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3745057195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 msgr2=0x55da838d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 msgr2=0x55da838d4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 -- 172.21.15.81:0/3745057195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da835a02b0 con 0x55da838c8ab0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838d7ae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec097e00 tx=0x7fe0ec09b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b0b8ed29b87b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.778+0000 7fe0e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/3745057195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0b3070 con 0x55da838c8ab0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/3745057195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fe0ec0ba1f0 con 0x55da838c8ab0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0ec0a4610 con 0x55da838c8ab0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/3745057195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe0ec01d040 con 0x55da838c8ab0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 10 client.15039 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55da838e67a0 con 0x55da838c8ab0 2024-09-12T12:15:55.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/3745057195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0ec0a4610 con 0x55da838c8ab0 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/3745057195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fe0ec086150 con 0x55da838c8ab0 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 10 client.15039 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 10 client.15039 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 20 client.15039 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da838e88a0 0x55da838e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 4 client.15039 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.779+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da8383c600 con 0x55da838e88a0 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.780+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da838e88a0 0x55da838e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.780+0000 7fe0e1ffb640 10 client.15039 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:15:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.780+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da838e88a0 0x55da838e9d10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc2650a09e58d1ca server_cookie=bc3a6468ca458f9e in_seq=0 out_seq=0 2024-09-12T12:15:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/3745057195 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da8383c600 con 0x55da838e88a0 2024-09-12T12:15:55.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe0e1ffb640 10 client.15039 handle_command_reply: tid=0 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 client.15039 shutdown 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 msgr2=0x55da838d7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838d7ae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec097e00 tx=0x7fe0ec09b170 comp rx=0 tx=0).stop 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 shutdown_connections 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da838e88a0 0x55da838e9d10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838d4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe0e1ffb640 0 client.15039 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 --2- 172.21.15.81:0/3745057195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838d7ae0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 >> 172.21.15.81:0/3745057195 conn(0x55da838c5160 msgr2=0x55da838caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 shutdown_connections 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 1 -- 172.21.15.81:0/3745057195 wait complete. 2024-09-12T12:15:55.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.781+0000 7fe10309f740 20 client.15039 trim_cache size 0 max 16384 2024-09-12T12:15:55.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.798+0000 7fe10309f740 1 Processor -- start 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 -- start start 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da838e8050 con 0x55da838c8ab0 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55da838e8720 con 0x55da838c93d0 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe10309f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55da838e8df0 con 0x55da838d81c0 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838e81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57252/0 (socket says 172.21.15.81:57252) 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 -- 172.21.15.81:0/4055153237 learned_addr learned my addr 172.21.15.81:0/4055153237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 -- 172.21.15.81:0/4055153237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 msgr2=0x55da838d0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 -- 172.21.15.81:0/4055153237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 msgr2=0x55da838e9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 -- 172.21.15.81:0/4055153237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da838c9200 con 0x55da838c8ab0 2024-09-12T12:15:55.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838e81d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec099c50 tx=0x7fe0ec09b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b6564a52de2092 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0e3fff640 1 -- 172.21.15.81:0/4055153237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0b3070 con 0x55da838c8ab0 2024-09-12T12:15:55.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0e3fff640 1 -- 172.21.15.81:0/4055153237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0ec004f50 con 0x55da838c8ab0 2024-09-12T12:15:55.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.799+0000 7fe0e3fff640 1 -- 172.21.15.81:0/4055153237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec09a930 con 0x55da838c8ab0 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 -- 172.21.15.81:0/4055153237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 msgr2=0x55da838e81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838e81d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec099c50 tx=0x7fe0ec09b430 comp rx=0 tx=0).stop 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 -- 172.21.15.81:0/4055153237 shutdown_connections 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838d81c0 0x55da838d0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838c93d0 0x55da838e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 --2- 172.21.15.81:0/4055153237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838e81d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 -- 172.21.15.81:0/4055153237 >> 172.21.15.81:0/4055153237 conn(0x55da838c5160 msgr2=0x55da838cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 -- 172.21.15.81:0/4055153237 shutdown_connections 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 -- 172.21.15.81:0/4055153237 wait complete. 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 -- start start 2024-09-12T12:15:55.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.800+0000 7fe10309f740 1 Processor -- start 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838c93d0 0x55da838ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838d81c0 0x55da83950fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55da838e9b90 con 0x55da838c8ab0 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55da838e94c0 con 0x55da838d81c0 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55da838ea260 con 0x55da838c93d0 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe10309f740 10 client.0 _ll_register_callbacks cb 0x7fe0ec09b300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838eb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57258/0 (socket says 172.21.15.81:57258) 2024-09-12T12:15:55.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 -- 172.21.15.81:0/223191810 learned_addr learned my addr 172.21.15.81:0/223191810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838c93d0 0x55da838ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838d81c0 0x55da83950fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 -- 172.21.15.81:0/223191810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838c93d0 msgr2=0x55da838ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838c93d0 0x55da838ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 -- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838d81c0 msgr2=0x55da83950fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838d81c0 0x55da83950fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 -- 172.21.15.81:0/223191810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da83951610 con 0x55da838c8ab0 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fad9d640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838d81c0 0x55da83950fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0fa59c640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838eb6b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec09b930 tx=0x7fe0ec004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a3eb0f8aadac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/223191810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0b3070 con 0x55da838c8ab0 2024-09-12T12:15:55.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.801+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/223191810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fe0ec0b4ba0 con 0x55da838c8ab0 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0ec004f50 con 0x55da838c8ab0 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/223191810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe0ec0a9050 con 0x55da838c8ab0 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 10 client.15045 fetch_fsmap learned FSMap version 26 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55da83951610 con 0x55da838c8ab0 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/223191810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0ec004f50 con 0x55da838c8ab0 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/223191810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fe0ec084030 con 0x55da838c8ab0 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 10 client.15045 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 10 client.15045 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 20 client.15045 populate_metadata read hostname 'smithi081' 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da83956e40 0x55da83955b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 4 client.15045 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "status"}) -- 0x55da83836b10 con 0x55da83956e40 2024-09-12T12:15:55.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.802+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da83956e40 0x55da83955b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe0f9d9b640 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da83956e40 0x55da83955b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e18c68b58c2ede75 server_cookie=11d4160cae98a30 in_seq=0 out_seq=0 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe0e1ffb640 10 client.15045 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe0e1ffb640 1 -- 172.21.15.81:0/223191810 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55da83836b10 con 0x55da83956e40 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe0e1ffb640 10 client.15045 handle_command_reply: tid=0 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 client.15045 shutdown 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 msgr2=0x55da838eb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838eb6b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec09b930 tx=0x7fe0ec004570 comp rx=0 tx=0).stop 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 shutdown_connections 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55da83956e40 0x55da83955b50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da838d81c0 0x55da83950fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55da838c93d0 0x55da838ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe0e1ffb640 0 client.15045 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 --2- 172.21.15.81:0/223191810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da838c8ab0 0x55da838eb6b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 >> 172.21.15.81:0/223191810 conn(0x55da838c5160 msgr2=0x55da838cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 shutdown_connections 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 1 -- 172.21.15.81:0/223191810 wait complete. 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.803+0000 7fe10309f740 20 client.15045 trim_cache size 0 max 16384 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24485, 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:15:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 79.423117922000003, 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 90.283185974000006 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:15:55.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe0e40a2c90 msgr2=0x7fe0e40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe0e40a2c90 0x7fe0e40a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55da838c64e0 tx=0x7fe0f4031000 comp rx=0 tx=0).stop 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 msgr2=0x7fe0fc1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc1983a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c890 tx=0x7fe0ec00cd50 comp rx=0 tx=0).stop 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 shutdown_connections 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe0e40a2c90 0x7fe0e40a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0fc1079c0 0x7fe0fc19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc102360 0x7fe0fc1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 --2- 172.21.15.81:0/2567247675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0fc1019c0 0x7fe0fc1983a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 >> 172.21.15.81:0/2567247675 conn(0x7fe0fc0fd6e0 msgr2=0x7fe0fc0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 shutdown_connections 2024-09-12T12:15:55.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:55.804+0000 7fe0fb59e640 1 -- 172.21.15.81:0/2567247675 wait complete. 2024-09-12T12:15:55.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:55 smithi173 ceph-mon[35326]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:56.571 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T12:15:56.571 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T12:15:56.582 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:15:56.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T12:15:56.827 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 -- 172.21.15.81:0/3757179958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c1078c0 msgr2=0x7f272c109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 --2- 172.21.15.81:0/3757179958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c1078c0 0x7f272c109d10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2724009900 tx=0x7f272402a410 comp rx=0 tx=0).stop 2024-09-12T12:15:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 -- 172.21.15.81:0/3757179958 shutdown_connections 2024-09-12T12:15:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 --2- 172.21.15.81:0/3757179958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c1078c0 0x7f272c109d10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 --2- 172.21.15.81:0/3757179958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c104f90 0x7f272c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 --2- 172.21.15.81:0/3757179958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 0x7f272c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 -- 172.21.15.81:0/3757179958 >> 172.21.15.81:0/3757179958 conn(0x7f272c0fc280 msgr2=0x7f272c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 -- 172.21.15.81:0/3757179958 shutdown_connections 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.294+0000 7f273174c640 1 -- 172.21.15.81:0/3757179958 wait complete. 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 Processor -- start 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 -- start start 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 0x7f272c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 0x7f272c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c1078c0 0x7f272c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f272c10d9e0 con 0x7f272c104f90 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f272c10d860 con 0x7f272c102660 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f273174c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f272c10db60 con 0x7f272c1078c0 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f272a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 0x7f272c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f272a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 0x7f272c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57280/0 (socket says 172.21.15.81:57280) 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.295+0000 7f272a7fc640 1 -- 172.21.15.81:0/377268802 learned_addr learned my addr 172.21.15.81:0/377268802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272b7fe640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c1078c0 0x7f272c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272affd640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 0x7f272c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272a7fc640 1 -- 172.21.15.81:0/377268802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c1078c0 msgr2=0x7f272c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272a7fc640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c1078c0 0x7f272c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272a7fc640 1 -- 172.21.15.81:0/377268802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 msgr2=0x7f272c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272a7fc640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 0x7f272c197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272a7fc640 1 -- 172.21.15.81:0/377268802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272c19fb60 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272b7fe640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c1078c0 0x7f272c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272affd640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 0x7f272c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f272a7fc640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 0x7f272c198470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f271400ccb0 tx=0x7f271400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714004b20 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2714004cc0 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272c19fe50 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271400f8f0 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.296+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f272c1a0300 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.297+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f272c0fdd70 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.298+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f271400fa90 con 0x7f272c104f90 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.299+0000 7f2723fff640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f270c0a2c40 0x7f270c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.299+0000 7f272affd640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f270c0a2c40 0x7f270c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.299+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f27140cf200 con 0x7f272c104f90 2024-09-12T12:15:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.299+0000 7f272affd640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f270c0a2c40 0x7f270c0a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f271c0058c0 tx=0x7f271c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.303+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2714014030 con 0x7f272c104f90 2024-09-12T12:15:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.487+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f272c062630 con 0x7f270c0a2c40 2024-09-12T12:15:57.487 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:57 smithi081 ceph-mon[30948]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:57.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.488+0000 7f2723fff640 1 -- 172.21.15.81:0/377268802 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f272c062630 con 0x7f270c0a2c40 2024-09-12T12:15:57.488 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-09-12T12:15:57.488 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-09-12T12:15:57.488 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-09-12T12:15:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f270c0a2c40 msgr2=0x7f270c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f270c0a2c40 0x7f270c0a5100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f271c0058c0 tx=0x7f271c005ec0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 msgr2=0x7f272c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 0x7f272c198470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f271400ccb0 tx=0x7f271400a620 comp rx=0 tx=0).stop 2024-09-12T12:15:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 shutdown_connections 2024-09-12T12:15:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f270c0a2c40 0x7f270c0a5100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f272c1078c0 0x7f272c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f272c104f90 0x7f272c198470 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 --2- 172.21.15.81:0/377268802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f272c102660 0x7f272c197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 >> 172.21.15.81:0/377268802 conn(0x7f272c0fc280 msgr2=0x7f272c102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 shutdown_connections 2024-09-12T12:15:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:57.490+0000 7f273174c640 1 -- 172.21.15.81:0/377268802 wait complete. 2024-09-12T12:15:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:57 smithi103 ceph-mon[35094]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:57.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:57 smithi173 ceph-mon[35326]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:15:58.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T12:15:58.424 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:15:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1752974683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50102e00 msgr2=0x7f7b50103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1752974683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50102e00 0x7f7b50103280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009900 tx=0x7f7b3c02a410 comp rx=0 tx=0).stop 2024-09-12T12:15:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1752974683 shutdown_connections 2024-09-12T12:15:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1752974683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 0x7f7b5010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1752974683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50102e00 0x7f7b50103280 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1752974683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50101c00 0x7f7b50102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1752974683 >> 172.21.15.81:0/1752974683 conn(0x7f7b500fd390 msgr2=0x7f7b500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1752974683 shutdown_connections 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.933+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1752974683 wait complete. 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 Processor -- start 2024-09-12T12:15:58.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 -- start start 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 0x7f7b50197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50102e00 0x7f7b50198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 0x7f7b5019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5010da20 con 0x7f7b50101c00 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5010d8a0 con 0x7f7b50102e00 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b56bd3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5010dba0 con 0x7f7b501037c0 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 0x7f7b50197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 0x7f7b50197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57300/0 (socket says 172.21.15.81:57300) 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 -- 172.21.15.81:0/1795924886 learned_addr learned my addr 172.21.15.81:0/1795924886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b4ffff640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50102e00 0x7f7b50198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:58.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b55170640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 0x7f7b5019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 -- 172.21.15.81:0/1795924886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 msgr2=0x7f7b5019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 0x7f7b5019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 -- 172.21.15.81:0/1795924886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50102e00 msgr2=0x7f7b50198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50102e00 0x7f7b50198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b5496f640 1 -- 172.21.15.81:0/1795924886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5019fc10 con 0x7f7b50101c00 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b55170640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 0x7f7b5019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.934+0000 7f7b4ffff640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50102e00 0x7f7b50198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.935+0000 7f7b5496f640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 0x7f7b50197fe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c970 tx=0x7f7b4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.935+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44007c10 con 0x7f7b50101c00 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.935+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7b44007db0 con 0x7f7b50101c00 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.935+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5019ff00 con 0x7f7b50101c00 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.935+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400fa40 con 0x7f7b50101c00 2024-09-12T12:15:58.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.935+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b501a03e0 con 0x7f7b50101c00 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.936+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b50108ed0 con 0x7f7b50101c00 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.937+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7b4400fbe0 con 0x7f7b50101c00 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.937+0000 7f7b4dffb640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7b400a2cc0 0x7f7b400a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.937+0000 7f7b4ffff640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7b400a2cc0 0x7f7b400a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.938+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f7b440cf4b0 con 0x7f7b50101c00 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.938+0000 7f7b4ffff640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7b400a2cc0 0x7f7b400a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000c00 tx=0x7f7b3c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:15:58.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:58.942+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b4409c440 con 0x7f7b50101c00 2024-09-12T12:15:59.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.119+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7b50062630 con 0x7f7b400a2cc0 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.130+0000 7f7b4dffb640 1 -- 172.21.15.81:0/1795924886 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f7b50062630 con 0x7f7b400a2cc0 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:mds.a smithi081 running (96s) 19s ago 96s 16.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 ee0b88d6e6c1 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:mds.b smithi103 running (93s) 26s ago 93s 28.7M - 19.1.1-298-gb53b6d3e 54467abc55f8 e88a5a817926 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:mds.c smithi173 running (108s) 26s ago 107s 20.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 ea24f7a944cb 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:mds.d smithi081 running (115s) 19s ago 115s 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 75db628b4dd6 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:mds.e smithi103 running (113s) 26s ago 112s 18.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 374ff74323ff 2024-09-12T12:15:59.132 INFO:teuthology.orchestra.run.smithi081.stdout:mds.f smithi173 running (110s) 26s ago 110s 19.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 e0790123f713 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mds.g smithi081 running (100s) 19s ago 99s 16.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 474301c7659f 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mds.h smithi103 running (105s) 26s ago 105s 20.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 a9ecb9b59d86 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mds.i smithi173 running (103s) 26s ago 102s 19.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 6620330d374a 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mds.j smithi081 running (119s) 19s ago 118s 14.5M - 19.1.1-298-gb53b6d3e 54467abc55f8 97081209fd1a 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mds.k smithi103 running (2m) 26s ago 2m 19.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 5d098296042f 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mds.l smithi173 running (2m) 26s ago 2m 19.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 b7aaae45e3b8 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.x smithi081 *:9283,8765 running (8m) 19s ago 8m 509M - 19.1.1-298-gb53b6d3e 54467abc55f8 100e314494c1 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.y smithi103 *:8443,8765 running (7m) 26s ago 7m 444M - 19.1.1-298-gb53b6d3e 54467abc55f8 6b5607096053 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.z smithi173 *:8443,8765 running (7m) 26s ago 7m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 5738d836e6b9 2024-09-12T12:15:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a smithi081 running (8m) 19s ago 8m 50.0M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 7a932bbc29bf 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b smithi103 running (7m) 26s ago 7m 44.4M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 97a24c01293c 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c smithi173 running (7m) 26s ago 7m 39.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 7a8df5e459ad 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (6m) 19s ago 6m 57.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 0f433ba0a035 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi103 running (6m) 26s ago 6m 56.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 16cdeef16592 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi173 running (6m) 26s ago 6m 58.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 2f78740efd82 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi081 running (5m) 19s ago 5m 47.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 418ee817528d 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi103 running (5m) 26s ago 5m 48.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d1dbd82e6416 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi173 running (4m) 26s ago 4m 47.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 013233dbd6a1 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 smithi081 running (4m) 19s ago 4m 45.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bac7293e2a36 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 smithi103 running (4m) 26s ago 4m 54.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 3272ae43e5c1 2024-09-12T12:15:59.134 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 smithi173 running (3m) 26s ago 3m 46.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e5bf21fc8982 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 smithi081 running (3m) 19s ago 3m 46.9M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 bb40364fa3f3 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 smithi103 running (2m) 26s ago 2m 48.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 8dc9b54123d8 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 smithi173 running (2m) 26s ago 2m 51.3M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f0fd51ce9aae 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7b400a2cc0 msgr2=0x7f7b400a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7b400a2cc0 0x7f7b400a5180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c000c00 tx=0x7f7b3c031640 comp rx=0 tx=0).stop 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 msgr2=0x7f7b50197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:15:59.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 0x7f7b50197fe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c970 tx=0x7f7b4400ce30 comp rx=0 tx=0).stop 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 shutdown_connections 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f7b400a2cc0 0x7f7b400a5180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b501037c0 0x7f7b5019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b50102e00 0x7f7b50198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 --2- 172.21.15.81:0/1795924886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50101c00 0x7f7b50197fe0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 >> 172.21.15.81:0/1795924886 conn(0x7f7b500fd390 msgr2=0x7f7b501060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 shutdown_connections 2024-09-12T12:15:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:15:59.133+0000 7f7b56bd3640 1 -- 172.21.15.81:0/1795924886 wait complete. 2024-09-12T12:15:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:59 smithi103 ceph-mon[35094]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:15:59 smithi103 ceph-mon[35094]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:59.706 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:59 smithi173 ceph-mon[35326]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:59.706 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:15:59 smithi173 ceph-mon[35326]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:59.810 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:59 smithi081 ceph-mon[30948]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:15:59.810 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:15:59 smithi081 ceph-mon[30948]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:15:59.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T12:16:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:00.438 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:00 smithi081 ceph-mon[30948]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 -- 172.21.15.81:0/1094990134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 msgr2=0x7f11601028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 --2- 172.21.15.81:0/1094990134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f11601028a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1154009900 tx=0x7f115402a410 comp rx=0 tx=0).stop 2024-09-12T12:16:00.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 -- 172.21.15.81:0/1094990134 shutdown_connections 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 --2- 172.21.15.81:0/1094990134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1160105790 0x7f1160105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 --2- 172.21.15.81:0/1094990134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160102de0 0x7f1160105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 --2- 172.21.15.81:0/1094990134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f11601028a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 -- 172.21.15.81:0/1094990134 >> 172.21.15.81:0/1094990134 conn(0x7f11600fc2a0 msgr2=0x7f11600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 -- 172.21.15.81:0/1094990134 shutdown_connections 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.517+0000 7f11652f3640 1 -- 172.21.15.81:0/1094990134 wait complete. 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 Processor -- start 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 -- start start 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f116019e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160102de0 0x7f116019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1160105790 0x7f11601a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1160114040 con 0x7f1160100490 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1160113ec0 con 0x7f1160105790 2024-09-12T12:16:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f11652f3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11601141c0 con 0x7f1160102de0 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f116019e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f116019e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57308/0 (socket says 172.21.15.81:57308) 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 -- 172.21.15.81:0/3103971551 learned_addr learned my addr 172.21.15.81:0/3103971551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115e7fc640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160102de0 0x7f116019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115f7fe640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1160105790 0x7f11601a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 -- 172.21.15.81:0/3103971551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160102de0 msgr2=0x7f116019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160102de0 0x7f116019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 -- 172.21.15.81:0/3103971551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1160105790 msgr2=0x7f11601a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1160105790 0x7f11601a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.518+0000 7f115effd640 1 -- 172.21.15.81:0/3103971551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11601a6250 con 0x7f1160100490 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.519+0000 7f115effd640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f116019e620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1154009a20 tx=0x7f1154004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.519+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115403f030 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.519+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1154003d00 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.519+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11601a64e0 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.519+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035070 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.519+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11601a6a40 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.520+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11600fdd90 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.521+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1154042030 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.522+0000 7f1147fff640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f11480a2c40 0x7f11480a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.522+0000 7f115e7fc640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f11480a2c40 0x7f11480a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.522+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f11540ef830 con 0x7f1160100490 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.522+0000 7f115e7fc640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f11480a2c40 0x7f11480a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1150005fd0 tx=0x7f1150005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.526+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11540bc730 con 0x7f1160100490 2024-09-12T12:16:00.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:00 smithi103 ceph-mon[35094]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:00.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.699+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f1160062630 con 0x7f11480a2c40 2024-09-12T12:16:00.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.705+0000 7f1147fff640 1 -- 172.21.15.81:0/3103971551 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f1160062630 con 0x7f11480a2c40 2024-09-12T12:16:00.706 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T12:16:00.706 INFO:teuthology.orchestra.run.smithi081.stdout:mds.all 12/12 28s ago 2m smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-09-12T12:16:00.707 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 3/3 28s ago 7m smithi081=x;smithi103=y;smithi173=z;count:3 2024-09-12T12:16:00.707 INFO:teuthology.orchestra.run.smithi081.stdout:mon 3/3 28s ago 7m smithi081:172.21.15.81=a;smithi103:172.21.15.103=b;smithi173:172.21.15.173=c;count:3 2024-09-12T12:16:00.707 INFO:teuthology.orchestra.run.smithi081.stdout:osd 12 28s ago - 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.707+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f11480a2c40 msgr2=0x7f11480a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.707+0000 7f11652f3640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f11480a2c40 0x7f11480a5100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1150005fd0 tx=0x7f1150005850 comp rx=0 tx=0).stop 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.707+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 msgr2=0x7f116019e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.707+0000 7f11652f3640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f116019e620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1154009a20 tx=0x7f1154004430 comp rx=0 tx=0).stop 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 shutdown_connections 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f11480a2c40 0x7f11480a5100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1160105790 0x7f11601a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1160102de0 0x7f116019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 --2- 172.21.15.81:0/3103971551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1160100490 0x7f116019e620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 >> 172.21.15.81:0/3103971551 conn(0x7f11600fc2a0 msgr2=0x7f1160103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 shutdown_connections 2024-09-12T12:16:00.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:00.708+0000 7f11652f3640 1 -- 172.21.15.81:0/3103971551 wait complete. 2024-09-12T12:16:00.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:00 smithi173 ceph-mon[35326]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:01.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T12:16:01.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:01 smithi081 ceph-mon[30948]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:01.624 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:01 smithi103 ceph-mon[35094]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:01.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:01 smithi173 ceph-mon[35326]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 -- 172.21.15.81:0/840004341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c101c00 msgr2=0x7f783c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 --2- 172.21.15.81:0/840004341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c101c00 0x7f783c102000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7838009900 tx=0x7f783802a410 comp rx=0 tx=0).stop 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 -- 172.21.15.81:0/840004341 shutdown_connections 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 --2- 172.21.15.81:0/840004341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f783c1037c0 0x7f783c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 --2- 172.21.15.81:0/840004341 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c102e00 0x7f783c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 --2- 172.21.15.81:0/840004341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c101c00 0x7f783c102000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 -- 172.21.15.81:0/840004341 >> 172.21.15.81:0/840004341 conn(0x7f783c0fd390 msgr2=0x7f783c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 -- 172.21.15.81:0/840004341 shutdown_connections 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.017+0000 7f784463e640 1 -- 172.21.15.81:0/840004341 wait complete. 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 Processor -- start 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 -- start start 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c101c00 0x7f783c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 0x7f783c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f783c1037c0 0x7f783c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f783c10da20 con 0x7f783c102e00 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f783c10d8a0 con 0x7f783c101c00 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f784463e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f783c10dba0 con 0x7f783c1037c0 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 0x7f783c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 0x7f783c198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57312/0 (socket says 172.21.15.81:57312) 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 -- 172.21.15.81:0/2809682009 learned_addr learned my addr 172.21.15.81:0/2809682009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f78423da640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c101c00 0x7f783c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7842bdb640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f783c1037c0 0x7f783c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 -- 172.21.15.81:0/2809682009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f783c1037c0 msgr2=0x7f783c19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f783c1037c0 0x7f783c19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 -- 172.21.15.81:0/2809682009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c101c00 msgr2=0x7f783c198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c101c00 0x7f783c198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 -- 172.21.15.81:0/2809682009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c19fc70 con 0x7f783c102e00 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.018+0000 7f7841bd9640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 0x7f783c198580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f782c00e9f0 tx=0x7f782c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.019+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c00cd80 con 0x7f783c102e00 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.019+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f782c010930 con 0x7f783c102e00 2024-09-12T12:16:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.019+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c19ff60 con 0x7f783c102e00 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.019+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c018b00 con 0x7f783c102e00 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.019+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c1a0490 con 0x7f783c102e00 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.020+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c108fd0 con 0x7f783c102e00 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.021+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f782c018ca0 con 0x7f783c102e00 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.022+0000 7f78337fe640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78280a2c40 0x7f78280a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.022+0000 7f78423da640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78280a2c40 0x7f78280a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.022+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f782c0cf930 con 0x7f783c102e00 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.022+0000 7f78423da640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78280a2c40 0x7f78280a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7838006010 tx=0x7f7838005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.025+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f782c09c730 con 0x7f783c102e00 2024-09-12T12:16:02.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.197+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f783c062630 con 0x7f78280a2c40 2024-09-12T12:16:02.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.198+0000 7f78337fe640 1 -- 172.21.15.81:0/2809682009 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f783c062630 con 0x7f78280a2c40 2024-09-12T12:16:02.200 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-09-12T12:16:02.200 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-09-12T12:16:02.200 INFO:teuthology.orchestra.run.smithi081.stdout:smithi103 172.21.15.103 2024-09-12T12:16:02.200 INFO:teuthology.orchestra.run.smithi081.stdout:smithi173 172.21.15.173 2024-09-12T12:16:02.200 INFO:teuthology.orchestra.run.smithi081.stdout:3 hosts in cluster 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.200+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78280a2c40 msgr2=0x7f78280a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.200+0000 7f784463e640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78280a2c40 0x7f78280a5100 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7838006010 tx=0x7f7838005be0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 msgr2=0x7f783c198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 0x7f783c198580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f782c00e9f0 tx=0x7f782c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 shutdown_connections 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f78280a2c40 0x7f78280a5100 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f783c1037c0 0x7f783c19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f783c102e00 0x7f783c198580 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 --2- 172.21.15.81:0/2809682009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f783c101c00 0x7f783c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:02.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 >> 172.21.15.81:0/2809682009 conn(0x7f783c0fd390 msgr2=0x7f783c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 shutdown_connections 2024-09-12T12:16:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:02.201+0000 7f784463e640 1 -- 172.21.15.81:0/2809682009 wait complete. 2024-09-12T12:16:02.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:02 smithi103 ceph-mon[35094]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:02.746 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:02 smithi081 ceph-mon[30948]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:02.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T12:16:02.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:02 smithi173 ceph-mon[35326]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:03.454 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:03 smithi081 ceph-mon[30948]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:03.454 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:03 smithi081 ceph-mon[30948]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:16:03.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 -- 172.21.15.81:0/535406077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0102e00 msgr2=0x7f21b0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 --2- 172.21.15.81:0/535406077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0102e00 0x7f21b0103280 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f21a0009900 tx=0x7f21a002a410 comp rx=0 tx=0).stop 2024-09-12T12:16:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 -- 172.21.15.81:0/535406077 shutdown_connections 2024-09-12T12:16:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 --2- 172.21.15.81:0/535406077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b01037c0 0x7f21b010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 --2- 172.21.15.81:0/535406077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b0102e00 0x7f21b0103280 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 --2- 172.21.15.81:0/535406077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b0101c00 0x7f21b0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 -- 172.21.15.81:0/535406077 >> 172.21.15.81:0/535406077 conn(0x7f21b00fd390 msgr2=0x7f21b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 -- 172.21.15.81:0/535406077 shutdown_connections 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.534+0000 7f21b7dde640 1 -- 172.21.15.81:0/535406077 wait complete. 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 Processor -- start 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 -- start start 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b0101c00 0x7f21b0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b0102e00 0x7f21b0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 0x7f21b019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21b010da40 con 0x7f21b01037c0 2024-09-12T12:16:03.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21b010d8c0 con 0x7f21b0101c00 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b7dde640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f21b010dbc0 con 0x7f21b0102e00 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b637b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 0x7f21b019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b637b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 0x7f21b019f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51272/0 (socket says 172.21.15.81:51272) 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b637b640 1 -- 172.21.15.81:0/3829246461 learned_addr learned my addr 172.21.15.81:0/3829246461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b5379640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b0102e00 0x7f21b0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.535+0000 7f21b5b7a640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b0101c00 0x7f21b0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b637b640 1 -- 172.21.15.81:0/3829246461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b0102e00 msgr2=0x7f21b0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b637b640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b0102e00 0x7f21b0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b637b640 1 -- 172.21.15.81:0/3829246461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b0101c00 msgr2=0x7f21b0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b637b640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b0101c00 0x7f21b0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b637b640 1 -- 172.21.15.81:0/3829246461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b019fc70 con 0x7f21b01037c0 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b637b640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 0x7f21b019f600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f21a800eaa0 tx=0x7f21a800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8004d20 con 0x7f21b01037c0 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f21a8005020 con 0x7f21b01037c0 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b019ff60 con 0x7f21b01037c0 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a80116b0 con 0x7f21b01037c0 2024-09-12T12:16:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.536+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b01a0490 con 0x7f21b01037c0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.537+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b0108fb0 con 0x7f21b01037c0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.538+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f21a80051d0 con 0x7f21b01037c0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.539+0000 7f21a6ffd640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f219c0a2cc0 0x7f219c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.539+0000 7f21b5b7a640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f219c0a2cc0 0x7f219c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.539+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f21a80cf230 con 0x7f21b01037c0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.539+0000 7f21b5b7a640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f219c0a2cc0 0x7f219c0a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21b0102c60 tx=0x7f21ac009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.543+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f21a8016030 con 0x7f21b01037c0 2024-09-12T12:16:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:03 smithi103 ceph-mon[35094]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:03 smithi103 ceph-mon[35094]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:16:03.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.716+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f21b0062630 con 0x7f219c0a2cc0 2024-09-12T12:16:03.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.718+0000 7f21a6ffd640 1 -- 172.21.15.81:0/3829246461 <== mgr.14150 v2:172.21.15.81:6800/4236049851 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f21b0062630 con 0x7f219c0a2cc0 2024-09-12T12:16:03.719 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T12:16:03.719 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T12:16:03.719 INFO:teuthology.orchestra.run.smithi081.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T12:16:03.720 INFO:teuthology.orchestra.run.smithi081.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T12:16:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f219c0a2cc0 msgr2=0x7f219c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f219c0a2cc0 0x7f219c0a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21b0102c60 tx=0x7f21ac009110 comp rx=0 tx=0).stop 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 msgr2=0x7f21b019f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 0x7f21b019f600 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f21a800eaa0 tx=0x7f21a800eea0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 shutdown_connections 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f219c0a2cc0 0x7f219c0a5180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21b01037c0 0x7f21b019f600 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21b0102e00 0x7f21b0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 --2- 172.21.15.81:0/3829246461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21b0101c00 0x7f21b0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 >> 172.21.15.81:0/3829246461 conn(0x7f21b00fd390 msgr2=0x7f21b0106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 shutdown_connections 2024-09-12T12:16:03.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:03.720+0000 7f21b7dde640 1 -- 172.21.15.81:0/3829246461 wait complete. 2024-09-12T12:16:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:03 smithi173 ceph-mon[35326]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:03 smithi173 ceph-mon[35326]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:16:04.405 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T12:16:04.417 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:16:04.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T12:16:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- 172.21.15.81:0/2128937070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f4102e00 msgr2=0x7f18f4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- 172.21.15.81:0/2128937070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f4102e00 0x7f18f4103280 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009900 tx=0x7f18e802a410 comp rx=0 tx=0).stop 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- 172.21.15.81:0/2128937070 shutdown_connections 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- 172.21.15.81:0/2128937070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f41037c0 0x7f18f410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- 172.21.15.81:0/2128937070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f4102e00 0x7f18f4103280 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- 172.21.15.81:0/2128937070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f4101c00 0x7f18f4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- 172.21.15.81:0/2128937070 >> 172.21.15.81:0/2128937070 conn(0x7f18f40fd390 msgr2=0x7f18f40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- 172.21.15.81:0/2128937070 shutdown_connections 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- 172.21.15.81:0/2128937070 wait complete. 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 Processor -- start 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- start start 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f4101c00 0x7f18f4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f4102e00 0x7f18f41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 0x7f18f419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18f410d9c0 con 0x7f18f41037c0 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18f410d840 con 0x7f18f4102e00 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.126+0000 7f18fb910640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18f410db40 con 0x7f18f4101c00 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 0x7f18f419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 0x7f18f419f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51288/0 (socket says 172.21.15.81:51288) 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 -- 172.21.15.81:0/331242455 learned_addr learned my addr 172.21.15.81:0/331242455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f96ac640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f4101c00 0x7f18f4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f8eab640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f4102e00 0x7f18f41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 -- 172.21.15.81:0/331242455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f4101c00 msgr2=0x7f18f4197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f4101c00 0x7f18f4197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 -- 172.21.15.81:0/331242455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f4102e00 msgr2=0x7f18f41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f4102e00 0x7f18f41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 -- 172.21.15.81:0/331242455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f419fbc0 con 0x7f18f41037c0 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f8eab640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f4102e00 0x7f18f41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18f9ead640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 0x7f18f419f550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00eaa0 tx=0x7f18ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00cdb0 con 0x7f18f41037c0 2024-09-12T12:16:05.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f18ec004b20 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f419feb0 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec011760 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.127+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41a0360 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.128+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f4108fb0 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.129+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f18ec004cd0 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.130+0000 7f18e67fc640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18e00a2cc0 0x7f18e00a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.130+0000 7f18f96ac640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18e00a2cc0 0x7f18e00a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.130+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f18ec0cf6d0 con 0x7f18f41037c0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.131+0000 7f18f96ac640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18e00a2cc0 0x7f18e00a5180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:05.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.133+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18ec016030 con 0x7f18f41037c0 2024-09-12T12:16:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.335+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f18f402da10 con 0x7f18f41037c0 2024-09-12T12:16:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.336+0000 7f18e67fc640 1 -- 172.21.15.81:0/331242455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3134 (secure 0 0 0) 0x7f18ec09c650 con 0x7f18f41037c0 2024-09-12T12:16:05.336 INFO:teuthology.orchestra.run.smithi081.stdout:e26 2024-09-12T12:16:05.336 INFO:teuthology.orchestra.run.smithi081.stdout:btime 2024-09-12T12:14:47:212167+0000 2024-09-12T12:16:05.336 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T12:16:05.336 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:16:05.336 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 26 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-12T12:14:35.911015+0000 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-12T12:14:47.212145+0000 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 300 2024-09-12T12:16:05.337 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 5 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1,2,3,4 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24485,1=24461,2=24457,3=24437,4=24436} 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-09-12T12:16:05.338 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:qdb_cluster leader: 24485 members: 24485,24461,24457,24437,24436 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b{0:24485} state up:active seq 4 addr [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f{0:24424} state up:standby-replay seq 1 addr [v2:172.21.15.173:6834/3014376257,v1:172.21.15.173:6835/3014376257] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.h{1:24461} state up:active seq 9 addr [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.k{1:24407} state up:standby-replay seq 1 addr [v2:172.21.15.103:6832/3064461197,v1:172.21.15.103:6833/3064461197] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.i{2:24457} state up:active seq 8 addr [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.l{2:24394} state up:standby-replay seq 1 addr [v2:172.21.15.173:6832/372466772,v1:172.21.15.173:6833/372466772] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e{3:24437} state up:active seq 11 addr [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a{3:14610} state up:standby-replay seq 1 addr [v2:172.21.15.81:6840/1006182135,v1:172.21.15.81:6841/1006182135] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c{4:24436} state up:active seq 10 addr [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.g{4:14598} state up:standby-replay seq 1 addr [v2:172.21.15.81:6838/3279635401,v1:172.21.15.81:6839/3279635401] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.81:6834/4073646080,v1:172.21.15.81:6835/4073646080] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.340 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.81:6836/3120489264,v1:172.21.15.81:6837/3120489264] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T12:16:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:16:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18e00a2cc0 msgr2=0x7f18e00a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18e00a2cc0 0x7f18e00a5180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f0005850 comp rx=0 tx=0).stop 2024-09-12T12:16:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 msgr2=0x7f18f419f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 0x7f18f419f550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00eaa0 tx=0x7f18ec00ef60 comp rx=0 tx=0).stop 2024-09-12T12:16:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 shutdown_connections 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18e00a2cc0 0x7f18e00a5180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f41037c0 0x7f18f419f550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18f4102e00 0x7f18f41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 --2- 172.21.15.81:0/331242455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18f4101c00 0x7f18f4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 >> 172.21.15.81:0/331242455 conn(0x7f18f40fd390 msgr2=0x7f18f4106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 shutdown_connections 2024-09-12T12:16:05.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:05.338+0000 7f18fb910640 1 -- 172.21.15.81:0/331242455 wait complete. 2024-09-12T12:16:05.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:05 smithi081 ceph-mon[30948]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:05 smithi081 ceph-mon[30948]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:05 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/331242455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:16:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:05 smithi103 ceph-mon[35094]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:05 smithi103 ceph-mon[35094]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:05 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/331242455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:16:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:05 smithi173 ceph-mon[35326]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:05 smithi173 ceph-mon[35326]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:05.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:05 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/331242455' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T12:16:05.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T12:16:06.202 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.652+0000 7f883ff8a640 1 -- 172.21.15.81:0/3886164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 msgr2=0x7f8838100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.652+0000 7f883ff8a640 1 --2- 172.21.15.81:0/3886164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f8838100ed0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8828009900 tx=0x7f882802a410 comp rx=0 tx=0).stop 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- 172.21.15.81:0/3886164236 shutdown_connections 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 --2- 172.21.15.81:0/3886164236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8838102690 0x7f8838108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 --2- 172.21.15.81:0/3886164236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8838101cd0 0x7f8838102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 --2- 172.21.15.81:0/3886164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f8838100ed0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- 172.21.15.81:0/3886164236 >> 172.21.15.81:0/3886164236 conn(0x7f88380fc280 msgr2=0x7f88380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- 172.21.15.81:0/3886164236 shutdown_connections 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- 172.21.15.81:0/3886164236 wait complete. 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 Processor -- start 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- start start 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f883806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8838101cd0 0x7f883819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8838102690 0x7f883819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f883810c940 con 0x7f8838100ad0 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f883810c7c0 con 0x7f8838102690 2024-09-12T12:16:06.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883ff8a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f883810cac0 con 0x7f8838101cd0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.653+0000 7f883dd26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f883806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f883806ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51302/0 (socket says 172.21.15.81:51302) 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 -- 172.21.15.81:0/144140465 learned_addr learned my addr 172.21.15.81:0/144140465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 -- 172.21.15.81:0/144140465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8838101cd0 msgr2=0x7f883819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883d525640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8838101cd0 0x7f883819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883e527640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8838102690 0x7f883819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8838101cd0 0x7f883819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 -- 172.21.15.81:0/144140465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8838102690 msgr2=0x7f883819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8838102690 0x7f883819f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 -- 172.21.15.81:0/144140465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883819fc70 con 0x7f8838100ad0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883dd26640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f883806ab10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f88280316a0 tx=0x7f8828032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882803f070 con 0x7f8838100ad0 2024-09-12T12:16:06.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883819ff00 con 0x7f8838100ad0 2024-09-12T12:16:06.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f882803b460 con 0x7f8838100ad0 2024-09-12T12:16:06.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828035070 con 0x7f8838100ad0 2024-09-12T12:16:06.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.654+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88381a03e0 con 0x7f8838100ad0 2024-09-12T12:16:06.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.655+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8838107e80 con 0x7f8838100ad0 2024-09-12T12:16:06.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.656+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f882803ba30 con 0x7f8838100ad0 2024-09-12T12:16:06.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.657+0000 7f882effd640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f88240a2c10 0x7f88240a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:06.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.658+0000 7f883d525640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f88240a2c10 0x7f88240a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:06.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.658+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f88280efb80 con 0x7f8838100ad0 2024-09-12T12:16:06.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.658+0000 7f883d525640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f88240a2c10 0x7f88240a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f883806a890 tx=0x7f8834005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:06.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.661+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88280bc980 con 0x7f8838100ad0 2024-09-12T12:16:06.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.828+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f883802d9c0 con 0x7f8838100ad0 2024-09-12T12:16:06.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.829+0000 7f882effd640 1 -- 172.21.15.81:0/144140465 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v79) ==== 56+0+5236 (secure 0 0 0) 0x7f88280bc280 con 0x7f8838100ad0 2024-09-12T12:16:06.829 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 79 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-12T12:07:02.815407+0000 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-12T12:14:50.215414+0000 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 26 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client luminous 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release squid 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-09-12T12:16:06.830 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 12 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 8 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/1527983778,v1:172.21.15.81:6803/1527983778] [v2:172.21.15.81:6804/1527983778,v1:172.21.15.81:6805/1527983778] exists,up eec0ad60-853a-44dc-9453-3ec54f1ca452 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 12 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6800/2968403799,v1:172.21.15.103:6801/2968403799] [v2:172.21.15.103:6802/2968403799,v1:172.21.15.103:6803/2968403799] exists,up c632ebfd-7044-4070-839b-9abc5275937e 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 17 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/3783460889,v1:172.21.15.173:6801/3783460889] [v2:172.21.15.173:6802/3783460889,v1:172.21.15.173:6803/3783460889] exists,up e4133af2-0de8-4d7c-a428-c04eee0d9b54 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 23 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/839409711,v1:172.21.15.81:6811/839409711] [v2:172.21.15.81:6812/839409711,v1:172.21.15.81:6813/839409711] exists,up 255d0d9f-47b0-45d3-98c8-17ce85b3cf2a 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 30 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6808/1884074772,v1:172.21.15.103:6809/1884074772] [v2:172.21.15.103:6810/1884074772,v1:172.21.15.103:6811/1884074772] exists,up 233bf67e-6d2b-498b-ace5-aef1a3f5a107 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 34 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6808/1780701631,v1:172.21.15.173:6809/1780701631] [v2:172.21.15.173:6810/1780701631,v1:172.21.15.173:6811/1780701631] exists,up dfaddbb0-cfb9-4a0d-907e-47556befc325 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 41 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6818/3383572766,v1:172.21.15.81:6819/3383572766] [v2:172.21.15.81:6820/3383572766,v1:172.21.15.81:6821/3383572766] exists,up e5583451-c189-446a-996a-c0289f513116 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 45 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6816/4035639207,v1:172.21.15.103:6817/4035639207] [v2:172.21.15.103:6818/4035639207,v1:172.21.15.103:6819/4035639207] exists,up d9081e5c-accf-4824-9a98-7b13e7037047 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 up in weight 1 up_from 52 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/754254770,v1:172.21.15.173:6817/754254770] [v2:172.21.15.173:6818/754254770,v1:172.21.15.173:6819/754254770] exists,up c1b297bd-6351-4c68-b4c1-985906cdbade 2024-09-12T12:16:06.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 up in weight 1 up_from 59 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/4277266165,v1:172.21.15.81:6827/4277266165] [v2:172.21.15.81:6828/4277266165,v1:172.21.15.81:6829/4277266165] exists,up 2bdbbf2c-ec45-4561-b86a-93e24b7a8359 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 up in weight 1 up_from 64 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6824/2351516633,v1:172.21.15.103:6825/2351516633] [v2:172.21.15.103:6826/2351516633,v1:172.21.15.103:6827/2351516633] exists,up b8bad4f9-e18c-4226-bb8e-30a1a5a80985 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 up in weight 1 up_from 71 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6824/2112038655,v1:172.21.15.173:6825/2112038655] [v2:172.21.15.173:6826/2112038655,v1:172.21.15.173:6827/2112038655] exists,up 73635e20-81fb-4323-ba44-febfdf20688f 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.4 [2,11] 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 2.1d [8,11] 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.2 [3,9] 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.14 [4,6] 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.1d [5,9] 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:pg_upmap_items 3.3c [4,9] 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/904274119 expires 2024-09-13T12:07:48.253532+0000 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2617771430 expires 2024-09-13T12:07:48.253532+0000 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/2203121669 expires 2024-09-13T12:07:48.253532+0000 2024-09-12T12:16:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/4253084359 expires 2024-09-13T12:07:24.724306+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/1070489278 expires 2024-09-13T12:07:24.724306+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2369792857 expires 2024-09-13T12:07:48.253532+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/478495135 expires 2024-09-13T12:07:24.724306+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/2203121669 expires 2024-09-13T12:07:48.253532+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/2716402580 expires 2024-09-13T12:07:24.724306+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/2716402580 expires 2024-09-13T12:07:24.724306+0000 2024-09-12T12:16:06.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f88240a2c10 msgr2=0x7f88240a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f88240a2c10 0x7f88240a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f883806a890 tx=0x7f8834005c60 comp rx=0 tx=0).stop 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 msgr2=0x7f883806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f883806ab10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f88280316a0 tx=0x7f8828032d90 comp rx=0 tx=0).stop 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 shutdown_connections 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f88240a2c10 0x7f88240a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8838102690 0x7f883819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8838101cd0 0x7f883819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 --2- 172.21.15.81:0/144140465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8838100ad0 0x7f883806ab10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.832+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 >> 172.21.15.81:0/144140465 conn(0x7f88380fc280 msgr2=0x7f8838105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.833+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 shutdown_connections 2024-09-12T12:16:06.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:06.833+0000 7f883ff8a640 1 -- 172.21.15.81:0/144140465 wait complete. 2024-09-12T12:16:07.546 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T12:16:07.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:16:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:07 smithi081 ceph-mon[30948]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:07 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/144140465' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:16:07.804 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:07 smithi173 ceph-mon[35326]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:07 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/144140465' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:16:07.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:07 smithi103 ceph-mon[35094]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:07.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:07 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/144140465' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T12:16:08.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 -- 172.21.15.81:0/3952920629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4102790 msgr2=0x7fe3b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 --2- 172.21.15.81:0/3952920629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4102790 0x7fe3b41067e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4009ca0 tx=0x7fe3a402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 -- 172.21.15.81:0/3952920629 shutdown_connections 2024-09-12T12:16:08.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 --2- 172.21.15.81:0/3952920629 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b4106f10 0x7fe3b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 --2- 172.21.15.81:0/3952920629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4102790 0x7fe3b41067e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 --2- 172.21.15.81:0/3952920629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4101de0 0x7fe3b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 -- 172.21.15.81:0/3952920629 >> 172.21.15.81:0/3952920629 conn(0x7fe3b40fd8e0 msgr2=0x7fe3b40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 -- 172.21.15.81:0/3952920629 shutdown_connections 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.208+0000 7fe3bad75640 1 -- 172.21.15.81:0/3952920629 wait complete. 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 Processor -- start 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 -- start start 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b4101de0 0x7fe3b41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4102790 0x7fe3b4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 0x7fe3b419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b4112090 con 0x7fe3b4106f10 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b4111f10 con 0x7fe3b4102790 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3bad75640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b4112210 con 0x7fe3b4101de0 2024-09-12T12:16:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3b9312640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 0x7fe3b419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3b9312640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 0x7fe3b419cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51314/0 (socket says 172.21.15.81:51314) 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3b9312640 1 -- 172.21.15.81:0/472709340 learned_addr learned my addr 172.21.15.81:0/472709340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3b3fff640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4102790 0x7fe3b4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.209+0000 7fe3b8b11640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b4101de0 0x7fe3b41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b9312640 1 -- 172.21.15.81:0/472709340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b4101de0 msgr2=0x7fe3b41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b9312640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b4101de0 0x7fe3b41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b9312640 1 -- 172.21.15.81:0/472709340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4102790 msgr2=0x7fe3b4198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b9312640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4102790 0x7fe3b4198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b9312640 1 -- 172.21.15.81:0/472709340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b419d490 con 0x7fe3b4106f10 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b9312640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 0x7fe3b419cdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00d750 tx=0x7fe39c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c017070 con 0x7fe3b4106f10 2024-09-12T12:16:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b419d780 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe39c005520 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004e00 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.210+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b41a5060 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.211+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b41021c0 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.212+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe39c004fa0 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.213+0000 7fe3b1ffb640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe3a00a2c10 0x7fe3a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.213+0000 7fe3b8b11640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe3a00a2c10 0x7fe3a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.213+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fe39c0cea40 con 0x7fe3b4106f10 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.213+0000 7fe3b8b11640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe3a00a2c10 0x7fe3a00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac005fd0 tx=0x7fe3ac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.217+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe39c09b940 con 0x7fe3b4106f10 2024-09-12T12:16:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.419+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3b402d7c0 con 0x7fe3b4106f10 2024-09-12T12:16:08.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.419+0000 7fe3b1ffb640 1 -- 172.21.15.81:0/472709340 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11982 (secure 0 0 0) 0x7fe39c09b240 con 0x7fe3b4106f10 2024-09-12T12:16:08.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:08.420 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-12T12:14:47:212167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:14:47.212145+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:16:08.420 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.421+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe3a00a2c10 msgr2=0x7fe3a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.421+0000 7fe3bad75640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe3a00a2c10 0x7fe3a00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac005fd0 tx=0x7fe3ac005850 comp rx=0 tx=0).stop 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.421+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 msgr2=0x7fe3b419cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.421+0000 7fe3bad75640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 0x7fe3b419cdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00d750 tx=0x7fe39c00dc10 comp rx=0 tx=0).stop 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 shutdown_connections 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fe3a00a2c10 0x7fe3a00a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3b4106f10 0x7fe3b419cdb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3b4102790 0x7fe3b4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 --2- 172.21.15.81:0/472709340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe3b4101de0 0x7fe3b41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 >> 172.21.15.81:0/472709340 conn(0x7fe3b40fd8e0 msgr2=0x7fe3b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 shutdown_connections 2024-09-12T12:16:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:08.422+0000 7fe3bad75640 1 -- 172.21.15.81:0/472709340 wait complete. 2024-09-12T12:16:08.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:08 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/472709340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:08.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:08 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/472709340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:08.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:08 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/472709340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:09.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:16:09.314 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:09.758 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:09 smithi081 ceph-mon[30948]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:16:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 -- 172.21.15.81:0/2671454123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc103760 msgr2=0x7f3cfc107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 --2- 172.21.15.81:0/2671454123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc103760 0x7f3cfc107ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009930 tx=0x7f3cec02a420 comp rx=0 tx=0).stop 2024-09-12T12:16:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 -- 172.21.15.81:0/2671454123 shutdown_connections 2024-09-12T12:16:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 --2- 172.21.15.81:0/2671454123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 --2- 172.21.15.81:0/2671454123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc103760 0x7f3cfc107ba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 --2- 172.21.15.81:0/2671454123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc102db0 0x7f3cfc103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.757+0000 7f3d03691640 1 -- 172.21.15.81:0/2671454123 >> 172.21.15.81:0/2671454123 conn(0x7f3cfc0fc7d0 msgr2=0x7f3cfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.758+0000 7f3d03691640 1 -- 172.21.15.81:0/2671454123 shutdown_connections 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.758+0000 7f3d03691640 1 -- 172.21.15.81:0/2671454123 wait complete. 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.758+0000 7f3d03691640 1 Processor -- start 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.758+0000 7f3d03691640 1 -- start start 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc102db0 0x7f3cfc100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc103760 0x7f3cfc100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc112210 con 0x7f3cfc1082e0 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc112090 con 0x7f3cfc103760 2024-09-12T12:16:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc112390 con 0x7f3cfc102db0 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51328/0 (socket says 172.21.15.81:51328) 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 -- 172.21.15.81:0/106145122 learned_addr learned my addr 172.21.15.81:0/106145122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d0142d640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc102db0 0x7f3cfc100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d00c2c640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc103760 0x7f3cfc100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 -- 172.21.15.81:0/106145122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc102db0 msgr2=0x7f3cfc100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc102db0 0x7f3cfc100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 -- 172.21.15.81:0/106145122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc103760 msgr2=0x7f3cfc100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc103760 0x7f3cfc100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 -- 172.21.15.81:0/106145122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc1a6bb0 con 0x7f3cfc1082e0 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d00c2c640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc103760 0x7f3cfc100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d01c2e640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc101490 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400cce0 tx=0x7f3cf400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400f450 con 0x7f3cfc1082e0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3cf400faf0 con 0x7f3cfc1082e0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc1a6ea0 con 0x7f3cfc1082e0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4018cc0 con 0x7f3cfc1082e0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.759+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc1a7300 con 0x7f3cfc1082e0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.760+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cfc103190 con 0x7f3cfc1082e0 2024-09-12T12:16:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.761+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3cf400f5f0 con 0x7f3cfc1082e0 2024-09-12T12:16:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.762+0000 7f3cf27fc640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.762+0000 7f3d0142d640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.762+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f3cf40cf700 con 0x7f3cfc1082e0 2024-09-12T12:16:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.763+0000 7f3d0142d640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009890 tx=0x7f3cf8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.765+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3cf4014030 con 0x7f3cfc1082e0 2024-09-12T12:16:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:09 smithi173 ceph-mon[35326]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:16:09.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:09 smithi103 ceph-mon[35094]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:16:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.968+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cfc101f40 con 0x7f3cfc1082e0 2024-09-12T12:16:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.969+0000 7f3cf27fc640 1 -- 172.21.15.81:0/106145122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11982 (secure 0 0 0) 0x7f3cf409c590 con 0x7f3cfc1082e0 2024-09-12T12:16:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:09.971 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"btime":"2024-09-12T12:14:47:212167+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:14:47.212145+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:16:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3ce80a2c10 msgr2=0x7f3ce80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009890 tx=0x7f3cf8008040 comp rx=0 tx=0).stop 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 msgr2=0x7f3cfc101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc101490 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400cce0 tx=0x7f3cf400a620 comp rx=0 tx=0).stop 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 shutdown_connections 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc1082e0 0x7f3cfc101490 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc103760 0x7f3cfc100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 --2- 172.21.15.81:0/106145122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc102db0 0x7f3cfc100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 >> 172.21.15.81:0/106145122 conn(0x7f3cfc0fc7d0 msgr2=0x7f3cfc106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 shutdown_connections 2024-09-12T12:16:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:09.971+0000 7f3d03691640 1 -- 172.21.15.81:0/106145122 wait complete. 2024-09-12T12:16:10.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:10 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/106145122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:10.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:16:10.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:10 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/106145122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:10.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:10 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/106145122' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 -- 172.21.15.81:0/3139327731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 msgr2=0x7f89c410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 --2- 172.21.15.81:0/3139327731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c410d950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009cd0 tx=0x7f89bc02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 -- 172.21.15.81:0/3139327731 shutdown_connections 2024-09-12T12:16:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 --2- 172.21.15.81:0/3139327731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c410d950 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 --2- 172.21.15.81:0/3139327731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c4100a80 0x7f89c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 --2- 172.21.15.81:0/3139327731 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c4106a80 0x7f89c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 -- 172.21.15.81:0/3139327731 >> 172.21.15.81:0/3139327731 conn(0x7f89c40fc7a0 msgr2=0x7f89c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 -- 172.21.15.81:0/3139327731 shutdown_connections 2024-09-12T12:16:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.388+0000 7f89c923f640 1 -- 172.21.15.81:0/3139327731 wait complete. 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 Processor -- start 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 -- start start 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c4100a80 0x7f89c40fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c40fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c4106a80 0x7f89c40fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4110fa0 con 0x7f89c4101420 2024-09-12T12:16:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4110e20 con 0x7f89c4106a80 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c923f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4111120 con 0x7f89c4100a80 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c40fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c40fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51346/0 (socket says 172.21.15.81:51346) 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c259c640 1 -- 172.21.15.81:0/267202092 learned_addr learned my addr 172.21.15.81:0/267202092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.389+0000 7f89c359e640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c4106a80 0x7f89c40fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c2d9d640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c4100a80 0x7f89c40fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c259c640 1 -- 172.21.15.81:0/267202092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c4100a80 msgr2=0x7f89c40fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c259c640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c4100a80 0x7f89c40fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c259c640 1 -- 172.21.15.81:0/267202092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c4106a80 msgr2=0x7f89c40fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c259c640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c4106a80 0x7f89c40fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c259c640 1 -- 172.21.15.81:0/267202092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c41a6980 con 0x7f89c4101420 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c259c640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c40fd240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d950 tx=0x7f89b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b8017070 con 0x7f89c4101420 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f89b8009c30 con 0x7f89c4101420 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b800f740 con 0x7f89c4101420 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c41a6c70 con 0x7f89c4101420 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.390+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41a7160 con 0x7f89c4101420 2024-09-12T12:16:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.391+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c4100ee0 con 0x7f89c4101420 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.392+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f89b8010a80 con 0x7f89c4101420 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.393+0000 7f89abfff640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f89ac0a2c10 0x7f89ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.393+0000 7f89c2d9d640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f89ac0a2c10 0x7f89ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.393+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f89b80ced60 con 0x7f89c4101420 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.393+0000 7f89c2d9d640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f89ac0a2c10 0x7f89ac0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005e00 tx=0x7f89b4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.397+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89b8009de0 con 0x7f89c4101420 2024-09-12T12:16:11.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.568+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89c4109a90 con 0x7f89c4101420 2024-09-12T12:16:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.569+0000 7f89abfff640 1 -- 172.21.15.81:0/267202092 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22643 (secure 0 0 0) 0x7f89b809bc60 con 0x7f89c4101420 2024-09-12T12:16:11.570 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:11.570 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:14:50.215414+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f89ac0a2c10 msgr2=0x7f89ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f89ac0a2c10 0x7f89ac0a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f89b4005e00 tx=0x7f89b4005c50 comp rx=0 tx=0).stop 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 msgr2=0x7f89c40fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c40fd240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f89b800d950 tx=0x7f89b800de10 comp rx=0 tx=0).stop 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 shutdown_connections 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f89ac0a2c10 0x7f89ac0a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c4106a80 0x7f89c40fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89c4101420 0x7f89c40fd240 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 --2- 172.21.15.81:0/267202092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89c4100a80 0x7f89c40fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:11.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 >> 172.21.15.81:0/267202092 conn(0x7f89c40fc7a0 msgr2=0x7f89c406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:11.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 shutdown_connections 2024-09-12T12:16:11.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:11.572+0000 7f89c923f640 1 -- 172.21.15.81:0/267202092 wait complete. 2024-09-12T12:16:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:11 smithi103 ceph-mon[35094]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:11.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:11 smithi081 ceph-mon[30948]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:11.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:11 smithi173 ceph-mon[35326]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:12.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:14:35.911015+0000', 'modified': '2024-09-12T12:14:47.212145+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24485, 'mds_1': 24461, 'mds_2': 24457, 'mds_3': 24437, 'mds_4': 24436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/3279635401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3279635401}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3279635401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/1006182135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 1006182135}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 1006182135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/372466772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 372466772}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 372466772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24407': {'gid': 24407, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.103:6833/3064461197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 3064461197}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 3064461197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6835/3014376257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 3014376257}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 3014376257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'c', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/359177011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 359177011}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 359177011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6835/4242406176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 4242406176}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 4242406176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.173:6839/2860435891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2860435891}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2860435891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.103:6837/4210602713', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6836', 'nonce': 4210602713}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 4210602713}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/3967449570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 3967449570}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 3967449570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24485, 24461, 24457, 24437, 24436]} 2024-09-12T12:16:12.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T12:16:12.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:16:12.422 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:12.829 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:12 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/267202092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:16:12.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:12 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/267202092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:16:12.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 -- 172.21.15.81:0/3352934226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 msgr2=0x7f268c10ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 --2- 172.21.15.81:0/3352934226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c10ea80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2684009ca0 tx=0x7f268402a8c0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 -- 172.21.15.81:0/3352934226 shutdown_connections 2024-09-12T12:16:12.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 --2- 172.21.15.81:0/3352934226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c10ea80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 --2- 172.21.15.81:0/3352934226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c102780 0x7f268c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 --2- 172.21.15.81:0/3352934226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268c101dd0 0x7f268c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 -- 172.21.15.81:0/3352934226 >> 172.21.15.81:0/3352934226 conn(0x7f268c0fd8b0 msgr2=0x7f268c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 -- 172.21.15.81:0/3352934226 shutdown_connections 2024-09-12T12:16:12.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.909+0000 7f269156d640 1 -- 172.21.15.81:0/3352934226 wait complete. 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 Processor -- start 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 -- start start 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c101dd0 0x7f268c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268c102780 0x7f268c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1120c0 con 0x7f268c106f00 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f268c111f40 con 0x7f268c102780 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f269156d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f268c112240 con 0x7f268c101dd0 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f268b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f268b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51626/0 (socket says 172.21.15.81:51626) 2024-09-12T12:16:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f268b7fe640 1 -- 172.21.15.81:0/3964785462 learned_addr learned my addr 172.21.15.81:0/3964785462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:12.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f2683fff640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268c102780 0x7f268c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f268affd640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c101dd0 0x7f268c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.910+0000 7f268b7fe640 1 -- 172.21.15.81:0/3964785462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c101dd0 msgr2=0x7f268c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f268b7fe640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c101dd0 0x7f268c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f268b7fe640 1 -- 172.21.15.81:0/3964785462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268c102780 msgr2=0x7f268c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f268b7fe640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268c102780 0x7f268c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f268b7fe640 1 -- 172.21.15.81:0/3964785462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c1a6940 con 0x7f268c106f00 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f268affd640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c101dd0 0x7f268c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f268b7fe640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c074f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2684009dc0 tx=0x7f2684031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f2688ff9640 1 -- 172.21.15.81:0/3964785462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268402fba0 con 0x7f268c106f00 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f2688ff9640 1 -- 172.21.15.81:0/3964785462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f268402fd40 con 0x7f268c106f00 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c1a6bd0 con 0x7f268c106f00 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f2688ff9640 1 -- 172.21.15.81:0/3964785462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684046910 con 0x7f268c106f00 2024-09-12T12:16:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.911+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c1a7160 con 0x7f268c106f00 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.913+0000 7f2688ff9640 1 -- 172.21.15.81:0/3964785462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2684030c50 con 0x7f268c106f00 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.913+0000 7f2693946740 1 Processor -- start 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.913+0000 7f2693946740 1 -- start start 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2693946740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb2cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2693946740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb37670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2693946740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb39fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2688ff9640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f26780a2c90 0x7f26780a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2693946740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c62ca93090 con 0x55c62cb37bb0 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2693946740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c62ca3aa70 con 0x55c62cb2d2f0 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2693946740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c62ca8f050 con 0x55c62cb2c9d0 2024-09-12T12:16:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb39fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb39fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51636/0 (socket says 172.21.15.81:51636) 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 -- 172.21.15.81:0/2721242562 learned_addr learned my addr 172.21.15.81:0/2721242562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f268b7fe640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f26780a2c90 0x7f26780a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb2cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f268affd640 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb37670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2688ff9640 1 -- 172.21.15.81:0/3964785462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f26840f0800 con 0x7f268c106f00 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 -- 172.21.15.81:0/2721242562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 msgr2=0x55c62cb2cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb2cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 -- 172.21.15.81:0/2721242562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 msgr2=0x55c62cb37670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb37670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.914+0000 7f2683fff640 1 -- 172.21.15.81:0/2721242562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62ca47130 con 0x55c62cb37bb0 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.915+0000 7f2683fff640 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb39fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f26740117e0 tx=0x7f267400a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8c1f71be98ccea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.915+0000 7f268b7fe640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f26780a2c90 0x7f26780a5150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f26840b9570 tx=0x7f26840901d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.915+0000 7f26817fa640 1 -- 172.21.15.81:0/2721242562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674011e20 con 0x55c62cb37bb0 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.915+0000 7f26817fa640 1 -- 172.21.15.81:0/2721242562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2674005020 con 0x55c62cb37bb0 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.915+0000 7f26817fa640 1 -- 172.21.15.81:0/2721242562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674004a00 con 0x55c62cb37bb0 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- 172.21.15.81:0/2721242562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 msgr2=0x55c62cb39fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb39fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f26740117e0 tx=0x7f267400a760 comp rx=0 tx=0).stop 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- 172.21.15.81:0/2721242562 shutdown_connections 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb39fa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb37670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- 172.21.15.81:0/2721242562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb2cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- 172.21.15.81:0/2721242562 >> 172.21.15.81:0/2721242562 conn(0x55c62cb28f60 msgr2=0x55c62cb29340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- 172.21.15.81:0/2721242562 shutdown_connections 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- 172.21.15.81:0/2721242562 wait complete. 2024-09-12T12:16:12.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- start start 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 Processor -- start 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb37460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 0x55c62cb347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb37bb0 0x55c62cb34cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb3a780 con 0x55c62cb2d2f0 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c62ca4df20 con 0x55c62cb37bb0 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb3a900 con 0x55c62cb2c9d0 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f2693946740 10 client.0 _ll_register_callbacks cb 0x55c62ca17030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.916+0000 7f268affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 0x55c62cb347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 0x55c62cb347b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51644/0 (socket says 172.21.15.81:51644) 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 -- 172.21.15.81:0/1163099546 learned_addr learned my addr 172.21.15.81:0/1163099546 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f2683fff640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb37460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 -- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 msgr2=0x55c62cb37460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb37460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f2683fff640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb37bb0 0x55c62cb34cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 -- 172.21.15.81:0/1163099546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb37bb0 msgr2=0x55c62cb34cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb37bb0 0x55c62cb34cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 -- 172.21.15.81:0/1163099546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62c8042b0 con 0x55c62cb2d2f0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f2683fff640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb37bb0 0x55c62cb34cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f268affd640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 0x55c62cb347b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f267c010500 tx=0x7f267c0109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e7fdbc0de9e4c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f26727fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f26727fc640 1 -- 172.21.15.81:0/1163099546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c018070 con 0x55c62cb2d2f0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f26727fc640 1 -- 172.21.15.81:0/1163099546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f267c014640 con 0x55c62cb2d2f0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2674005020 con 0x55c62cb2d2f0 2024-09-12T12:16:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f26727fc640 1 -- 172.21.15.81:0/1163099546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f267c024050 con 0x55c62cb2d2f0 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f2693946740 10 client.15117 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c62cb46130 con 0x55c62cb2d2f0 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.917+0000 7f26727fc640 1 -- 172.21.15.81:0/1163099546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2674005020 con 0x55c62cb2d2f0 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f26727fc640 1 -- 172.21.15.81:0/1163099546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f267c012ac0 con 0x55c62cb2d2f0 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2693946740 10 client.15117 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2693946740 10 client.15117 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2693946740 20 client.15117 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2693946740 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cb48770 0x55c62cb49be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2693946740 4 client.15117 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 --> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c62caa0600 con 0x55c62cb48770 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2683fff640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cb48770 0x55c62cb49be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f2683fff640 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cb48770 0x55c62cb49be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=321493de819e507c server_cookie=83138efa65d39442 in_seq=0 out_seq=0 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.918+0000 7f26727fc640 10 client.15117 ms_handle_connect on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f26727fc640 1 -- 172.21.15.81:0/1163099546 <== mds.4 v2:172.21.15.173:6836/359177011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c62caa0600 con 0x55c62cb48770 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f26727fc640 10 client.15117 handle_command_reply: tid=0 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 client.15117 shutdown 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 msgr2=0x55c62cb347b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 0x55c62cb347b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f267c010500 tx=0x7f267c0109c0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 shutdown_connections 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cb48770 0x55c62cb49be0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb37bb0 0x55c62cb34cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f26727fc640 0 client.15117 ms_handle_reset on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2d2f0 0x55c62cb347b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 --2- 172.21.15.81:0/1163099546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2c9d0 0x55c62cb37460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 >> 172.21.15.81:0/1163099546 conn(0x55c62cb28f60 msgr2=0x55c62cb2ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 shutdown_connections 2024-09-12T12:16:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.919+0000 7f2693946740 1 -- 172.21.15.81:0/1163099546 wait complete. 2024-09-12T12:16:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.920+0000 7f2693946740 20 client.15117 trim_cache size 0 max 16384 2024-09-12T12:16:12.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:12 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/267202092' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 Processor -- start 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 -- start start 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 0x55c62cb480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb2eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb37bb0 0x55c62cb31a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb47f20 con 0x55c62cb2c9d0 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb485f0 con 0x55c62cb2d2f0 2024-09-12T12:16:12.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2693946740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb48cc0 con 0x55c62cb37bb0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 0x55c62cb480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 0x55c62cb480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51652/0 (socket says 172.21.15.81:51652) 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f2683fff640 1 -- 172.21.15.81:0/1353120571 learned_addr learned my addr 172.21.15.81:0/1353120571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.937+0000 7f268affd640 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb2eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2683fff640 1 -- 172.21.15.81:0/1353120571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb37bb0 msgr2=0x55c62cb31a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2683fff640 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb37bb0 0x55c62cb31a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2683fff640 1 -- 172.21.15.81:0/1353120571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 msgr2=0x55c62cb2eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2683fff640 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb2eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2683fff640 1 -- 172.21.15.81:0/1353120571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62cb2d120 con 0x55c62cb2c9d0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f268affd640 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb2eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2683fff640 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 0x55c62cb480a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f26740117e0 tx=0x7f267400a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da34087e3366a061 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2680ff9640 1 -- 172.21.15.81:0/1353120571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674005550 con 0x55c62cb2c9d0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2680ff9640 1 -- 172.21.15.81:0/1353120571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f267402d070 con 0x55c62cb2c9d0 2024-09-12T12:16:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.938+0000 7f2680ff9640 1 -- 172.21.15.81:0/1353120571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674028b00 con 0x55c62cb2c9d0 2024-09-12T12:16:12.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- 172.21.15.81:0/1353120571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 msgr2=0x55c62cb480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 0x55c62cb480a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f26740117e0 tx=0x7f267400a510 comp rx=0 tx=0).stop 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- 172.21.15.81:0/1353120571 shutdown_connections 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb37bb0 0x55c62cb31a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2d2f0 0x55c62cb2eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- 172.21.15.81:0/1353120571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb2c9d0 0x55c62cb480a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- 172.21.15.81:0/1353120571 >> 172.21.15.81:0/1353120571 conn(0x55c62cb28f60 msgr2=0x55c62cb2e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- 172.21.15.81:0/1353120571 shutdown_connections 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- 172.21.15.81:0/1353120571 wait complete. 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- start start 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 Processor -- start 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2c9d0 0x55c62cb52730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2d2f0 0x55c62cb4bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb4c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb49a60 con 0x55c62cb37bb0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb49390 con 0x55c62cb2c9d0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c62cb4a130 con 0x55c62cb2d2f0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2693946740 10 client.0 _ll_register_callbacks cb 0x7f267c007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb4c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb4c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51662/0 (socket says 172.21.15.81:51662) 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.939+0000 7f2683fff640 1 -- 172.21.15.81:0/421579283 learned_addr learned my addr 172.21.15.81:0/421579283 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2c9d0 0x55c62cb52730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f268affd640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2d2f0 0x55c62cb4bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 -- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2d2f0 msgr2=0x55c62cb4bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2d2f0 0x55c62cb4bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 -- 172.21.15.81:0/421579283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2c9d0 msgr2=0x55c62cb52730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2c9d0 0x55c62cb52730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 -- 172.21.15.81:0/421579283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62cb50250 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f268affd640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2d2f0 0x55c62cb4bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2683fff640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb4c1d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f267400aad0 tx=0x7f2674028680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2b2fe51e047cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f26727fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f26727fc640 1 -- 172.21.15.81:0/421579283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267400a680 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f26727fc640 1 -- 172.21.15.81:0/421579283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f26740288a0 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f267402d070 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f26727fc640 1 -- 172.21.15.81:0/421579283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2674028aa0 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2693946740 10 client.15123 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c62cbb3040 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f26727fc640 1 -- 172.21.15.81:0/421579283 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f267402d070 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f26727fc640 1 -- 172.21.15.81:0/421579283 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f267403f030 con 0x55c62cb37bb0 2024-09-12T12:16:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.940+0000 7f2693946740 10 client.15123 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 10 client.15123 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 20 client.15123 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cbb73c0 0x55c62cbb60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 4 client.15123 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 --> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] -- command(tid 0: {"prefix": "status"}) -- 0x55c62ca9ab10 con 0x55c62cbb73c0 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f268affd640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cbb73c0 0x55c62cbb60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f268affd640 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cbb73c0 0x55c62cbb60d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d6071c6781b2f51 server_cookie=29e7c91638e710a4 in_seq=0 out_seq=0 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f26727fc640 10 client.15123 ms_handle_connect on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:12.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f26727fc640 1 -- 172.21.15.81:0/421579283 <== mds.4 v2:172.21.15.173:6836/359177011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c62ca9ab10 con 0x55c62cbb73c0 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f26727fc640 10 client.15123 handle_command_reply: tid=0 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 1 client.15123 shutdown 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 msgr2=0x55c62cb4c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.941+0000 7f2693946740 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb4c1d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f267400aad0 tx=0x7f2674028680 comp rx=0 tx=0).stop 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 shutdown_connections 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c62cb37bb0 0x55c62cb4c1d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c62cb2d2f0 0x55c62cb4bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55c62cbb73c0 0x55c62cbb60d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 --2- 172.21.15.81:0/421579283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c62cb2c9d0 0x55c62cb52730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 >> 172.21.15.81:0/421579283 conn(0x55c62cb28f60 msgr2=0x55c62cb2ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f26727fc640 0 client.15123 ms_handle_reset on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 shutdown_connections 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 1 -- 172.21.15.81:0/421579283 wait complete. 2024-09-12T12:16:12.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f2693946740 20 client.15123 trim_cache size 0 max 16384 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24436, 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 86.741202381999997, 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:16:12.950 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 121.738665072 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f26780a2c90 msgr2=0x7f26780a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f26780a2c90 0x7f26780a5150 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f26840b9570 tx=0x7f26840901d0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 msgr2=0x7f268c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:12.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c074f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2684009dc0 tx=0x7f2684031b10 comp rx=0 tx=0).stop 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 shutdown_connections 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f26780a2c90 0x7f26780a5150 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f268c106f00 0x7f268c074f70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268c102780 0x7f268c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 --2- 172.21.15.81:0/3964785462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f268c101dd0 0x7f268c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 >> 172.21.15.81:0/3964785462 conn(0x7f268c0fd8b0 msgr2=0x7f268c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 shutdown_connections 2024-09-12T12:16:12.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:12.942+0000 7f269156d640 1 -- 172.21.15.81:0/3964785462 wait complete. 2024-09-12T12:16:13.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:13 smithi081 ceph-mon[30948]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:16:13.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-12T12:16:13.898 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:13 smithi173 ceph-mon[35326]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:16:13.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:13 smithi103 ceph-mon[35094]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-12T12:16:14.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 -- 172.21.15.81:0/2792104725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 msgr2=0x7f32a01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 --2- 172.21.15.81:0/2792104725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a01029b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3294009900 tx=0x7f329402a480 comp rx=0 tx=0).stop 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 -- 172.21.15.81:0/2792104725 shutdown_connections 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 --2- 172.21.15.81:0/2792104725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0102ef0 0x7f32a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 --2- 172.21.15.81:0/2792104725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a01029b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 --2- 172.21.15.81:0/2792104725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a0100e20 0x7f32a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 -- 172.21.15.81:0/2792104725 >> 172.21.15.81:0/2792104725 conn(0x7f32a00fc7d0 msgr2=0x7f32a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 -- 172.21.15.81:0/2792104725 shutdown_connections 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 -- 172.21.15.81:0/2792104725 wait complete. 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.389+0000 7f32a62c3640 1 Processor -- start 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 -- start start 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a0100e20 0x7f32a01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0102ef0 0x7f32a019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32a0111070 con 0x7f32a0102570 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32a0110ef0 con 0x7f32a0100e20 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a62c3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32a01111f0 con 0x7f32a0102ef0 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51684/0 (socket says 172.21.15.81:51684) 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 -- 172.21.15.81:0/3822191104 learned_addr learned my addr 172.21.15.81:0/3822191104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329ffff640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a0100e20 0x7f32a01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f32a4860640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0102ef0 0x7f32a019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 -- 172.21.15.81:0/3822191104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0102ef0 msgr2=0x7f32a019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0102ef0 0x7f32a019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 -- 172.21.15.81:0/3822191104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a0100e20 msgr2=0x7f32a01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a0100e20 0x7f32a01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.390+0000 7f329f7fe640 1 -- 172.21.15.81:0/3822191104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a019d470 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.391+0000 7f329f7fe640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a0198a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3294006010 tx=0x7f3294004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.391+0000 7f329d7fa640 1 -- 172.21.15.81:0/3822191104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329403f030 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.391+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a019d700 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.391+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a01a5040 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.391+0000 7f329d7fa640 1 -- 172.21.15.81:0/3822191104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3294005500 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.391+0000 7f329d7fa640 1 -- 172.21.15.81:0/3822191104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294035070 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.393+0000 7f32a869c740 1 Processor -- start 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.393+0000 7f329d7fa640 1 -- 172.21.15.81:0/3822191104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3294042030 con 0x7f32a0102570 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.393+0000 7f32a869c740 1 -- start start 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a869c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc69d0 0x564197fc6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a869c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fd1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a869c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 0x564197fd3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a869c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564197f2d090 con 0x564197fd1bb0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a869c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564197ed4a70 con 0x564197fc69d0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a869c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564197f29050 con 0x564197fc72f0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 0x564197fd3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 0x564197fd3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51692/0 (socket says 172.21.15.81:51692) 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 -- 172.21.15.81:0/114078762 learned_addr learned my addr 172.21.15.81:0/114078762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329ffff640 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fd1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a4860640 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc69d0 0x564197fc6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 -- 172.21.15.81:0/114078762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 msgr2=0x564197fd1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fd1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 -- 172.21.15.81:0/114078762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc69d0 msgr2=0x564197fc6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc69d0 0x564197fc6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 -- 172.21.15.81:0/114078762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564197ee1130 con 0x564197fd1bb0 2024-09-12T12:16:14.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329d7fa640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f32880a2c90 0x7f32880a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f32a4860640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f32880a2c90 0x7f32880a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.394+0000 7f329f7fe640 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 0x564197fd3fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f32940ece30 tx=0x7f32940f5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e328fa85220e3497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f329d7fa640 1 -- 172.21.15.81:0/3822191104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f32940ef440 con 0x7f32a0102570 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f32867fc640 1 -- 172.21.15.81:0/114078762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940b7ee0 con 0x564197fd1bb0 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f32867fc640 1 -- 172.21.15.81:0/114078762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32940bc340 con 0x564197fd1bb0 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f32867fc640 1 -- 172.21.15.81:0/114078762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940bb5a0 con 0x564197fd1bb0 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f32a869c740 1 -- 172.21.15.81:0/114078762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 msgr2=0x564197fd3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f32a869c740 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 0x564197fd3fa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f32940ece30 tx=0x7f32940f5770 comp rx=0 tx=0).stop 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.395+0000 7f32a4860640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f32880a2c90 0x7f32880a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3298007f80 tx=0x7f3298007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- 172.21.15.81:0/114078762 shutdown_connections 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fd1bb0 0x564197fd3fa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fd1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 --2- 172.21.15.81:0/114078762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc69d0 0x564197fc6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- 172.21.15.81:0/114078762 >> 172.21.15.81:0/114078762 conn(0x564197fc2f60 msgr2=0x564197fc3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- 172.21.15.81:0/114078762 shutdown_connections 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- 172.21.15.81:0/114078762 wait complete. 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- start start 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 Processor -- start 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fd1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564197fd4540 con 0x564197fc69d0 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564197ee7f20 con 0x564197fc72f0 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.396+0000 7f32a869c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564197fd46c0 con 0x564197fd1bb0 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f32a869c740 10 client.0 _ll_register_callbacks cb 0x564197eb1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:14.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fd1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fd1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51700/0 (socket says 172.21.15.81:51700) 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 -- 172.21.15.81:0/4114949367 learned_addr learned my addr 172.21.15.81:0/4114949367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329f7fe640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f32a4860640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 -- 172.21.15.81:0/4114949367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 msgr2=0x564197fceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 -- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 msgr2=0x564197fce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 -- 172.21.15.81:0/4114949367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564197c9e2b0 con 0x564197fc69d0 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f329ffff640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fd1300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3290010a50 tx=0x7f3290010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c23b07745a042b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f327f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f327f7fe640 1 -- 172.21.15.81:0/4114949367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329001e060 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f327f7fe640 1 -- 172.21.15.81:0/4114949367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f329000fb10 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32940bc340 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f327f7fe640 1 -- 172.21.15.81:0/4114949367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f329000fd10 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f32a869c740 10 client.15135 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.397+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564197fdfd50 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f327f7fe640 1 -- 172.21.15.81:0/4114949367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32940bc340 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f327f7fe640 1 -- 172.21.15.81:0/4114949367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3290023070 con 0x564197fc69d0 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f32a869c740 10 client.15135 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f32a869c740 10 client.15135 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f32a869c740 20 client.15135 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f32a869c740 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564197fe2400 0x564197fe3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f32a869c740 4 client.15135 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:14.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 --> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564197f3a600 con 0x564197fe2400 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.398+0000 7f329f7fe640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564197fe2400 0x564197fe3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f329f7fe640 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564197fe2400 0x564197fe3870 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9459ce2e5679c8a8 server_cookie=ba4b38ce57d2e379 in_seq=0 out_seq=0 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f327f7fe640 10 client.15135 ms_handle_connect on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f327f7fe640 1 -- 172.21.15.81:0/4114949367 <== mds.3 v2:172.21.15.103:6834/4242406176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564197f3a600 con 0x564197fe2400 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f327f7fe640 10 client.15135 handle_command_reply: tid=0 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 client.15135 shutdown 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 msgr2=0x564197fd1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fd1300 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3290010a50 tx=0x7f3290010f10 comp rx=0 tx=0).stop 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 shutdown_connections 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564197fe2400 0x564197fe3870 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 --2- 172.21.15.81:0/4114949367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fd1300 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f327f7fe640 0 client.15135 ms_handle_reset on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.399+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 >> 172.21.15.81:0/4114949367 conn(0x564197fc2f60 msgr2=0x564197fc8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.400+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 shutdown_connections 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.400+0000 7f32a869c740 1 -- 172.21.15.81:0/4114949367 wait complete. 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.400+0000 7f32a869c740 20 client.15135 trim_cache size 0 max 16384 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.417+0000 7f32a869c740 1 Processor -- start 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.417+0000 7f32a869c740 1 -- start start 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.417+0000 7f32a869c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fc9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.417+0000 7f32a869c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fc9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f32a869c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fcb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f32a869c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564197fe1bb0 con 0x564197fc69d0 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f32a869c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564197fe2280 con 0x564197fc72f0 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f32a869c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564197fe2950 con 0x564197fd1bb0 2024-09-12T12:16:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fc9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fc9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51710/0 (socket says 172.21.15.81:51710) 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 -- 172.21.15.81:0/4153669744 learned_addr learned my addr 172.21.15.81:0/4153669744 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 -- 172.21.15.81:0/4153669744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 msgr2=0x564197fcb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fcb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 -- 172.21.15.81:0/4153669744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 msgr2=0x564197fc9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329f7fe640 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fc9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fc9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 -- 172.21.15.81:0/4153669744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564197fc2d90 con 0x564197fc69d0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f329ffff640 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fc9560 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f32900106d0 tx=0x7f3290010700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b88082a51836cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f3285ffb640 1 -- 172.21.15.81:0/4153669744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290029020 con 0x564197fc69d0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f3285ffb640 1 -- 172.21.15.81:0/4153669744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f329000fb10 con 0x564197fc69d0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.418+0000 7f3285ffb640 1 -- 172.21.15.81:0/4153669744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329001aac0 con 0x564197fc69d0 2024-09-12T12:16:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 -- 172.21.15.81:0/4153669744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 msgr2=0x564197fc9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fc9560 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f32900106d0 tx=0x7f3290010700 comp rx=0 tx=0).stop 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 -- 172.21.15.81:0/4153669744 shutdown_connections 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fd1bb0 0x564197fcb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fc72f0 0x564197fc9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 --2- 172.21.15.81:0/4153669744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fc9560 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 -- 172.21.15.81:0/4153669744 >> 172.21.15.81:0/4153669744 conn(0x564197fc2f60 msgr2=0x564197fccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 -- 172.21.15.81:0/4153669744 shutdown_connections 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:14.443 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24437, 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 89.231745134999997, 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 128.26196246500001 2024-09-12T12:16:14.444 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 -- 172.21.15.81:0/4153669744 wait complete. 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.419+0000 7f32a869c740 1 -- start start 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 Processor -- start 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fcb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fcbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fd1bb0 0x564197fcc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x564197fe36f0 con 0x564197fc69d0 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564197fe3020 con 0x564197fd1bb0 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564197fe3dc0 con 0x564197fc72f0 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a869c740 10 client.0 _ll_register_callbacks cb 0x7f329000a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fcb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fcb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51726/0 (socket says 172.21.15.81:51726) 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 -- 172.21.15.81:0/1922475992 learned_addr learned my addr 172.21.15.81:0/1922475992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f32a4860640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fd1bb0 0x564197fcc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329f7fe640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fcbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 -- 172.21.15.81:0/1922475992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 msgr2=0x564197fcbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fcbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 -- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fd1bb0 msgr2=0x564197fcc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fd1bb0 0x564197fcc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.420+0000 7f329ffff640 1 -- 172.21.15.81:0/1922475992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564197fe8430 con 0x564197fc69d0 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f329ffff640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fcb830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3290010a50 tx=0x7f329000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e200e3fb48ef1183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f327f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f327f7fe640 1 -- 172.21.15.81:0/1922475992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290029030 con 0x564197fc69d0 2024-09-12T12:16:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f327f7fe640 1 -- 172.21.15.81:0/1922475992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f329001a800 con 0x564197fc69d0 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f329000fb10 con 0x564197fc69d0 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f327f7fe640 1 -- 172.21.15.81:0/1922475992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f329001e030 con 0x564197fc69d0 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 10 client.15141 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56419804cfd0 con 0x564197fc69d0 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f327f7fe640 1 -- 172.21.15.81:0/1922475992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f329000fb10 con 0x564197fc69d0 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f327f7fe640 1 -- 172.21.15.81:0/1922475992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3290023070 con 0x564197fc69d0 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 10 client.15141 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 20 client.15141 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564198051770 0x564198050480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 4 client.15141 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.421+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 --> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] -- command(tid 0: {"prefix": "status"}) -- 0x564197f34b10 con 0x564198051770 2024-09-12T12:16:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.422+0000 7f329f7fe640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564198051770 0x564198050480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.422+0000 7f329f7fe640 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564198051770 0x564198050480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6c7f9bbe2996f675 server_cookie=cf2dd622d7d7341f in_seq=0 out_seq=0 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.422+0000 7f327f7fe640 10 client.15141 ms_handle_connect on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.422+0000 7f327f7fe640 1 -- 172.21.15.81:0/1922475992 <== mds.3 v2:172.21.15.103:6834/4242406176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564197f34b10 con 0x564198051770 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.422+0000 7f327f7fe640 10 client.15141 handle_command_reply: tid=0 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.422+0000 7f32a869c740 1 client.15141 shutdown 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 msgr2=0x564197fcb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fcb830 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3290010a50 tx=0x7f329000f870 comp rx=0 tx=0).stop 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 shutdown_connections 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564197fd1bb0 0x564197fcc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x564198051770 0x564198050480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f327f7fe640 0 client.15141 ms_handle_reset on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564197fc72f0 0x564197fcbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 --2- 172.21.15.81:0/1922475992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564197fc69d0 0x564197fcb830 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 >> 172.21.15.81:0/1922475992 conn(0x564197fc2f60 msgr2=0x564197fc9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 shutdown_connections 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 1 -- 172.21.15.81:0/1922475992 wait complete. 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a869c740 20 client.15141 trim_cache size 0 max 16384 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f32880a2c90 msgr2=0x7f32880a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f32880a2c90 0x7f32880a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3298007f80 tx=0x7f3298007520 comp rx=0 tx=0).stop 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 msgr2=0x7f32a0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a0198a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3294006010 tx=0x7f3294004c00 comp rx=0 tx=0).stop 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 shutdown_connections 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f32880a2c90 0x7f32880a5150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32a0102ef0 0x7f32a019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0102570 0x7f32a0198a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 --2- 172.21.15.81:0/3822191104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a0100e20 0x7f32a01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.423+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 >> 172.21.15.81:0/3822191104 conn(0x7f32a00fc7d0 msgr2=0x7f32a006a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.424+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 shutdown_connections 2024-09-12T12:16:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:14.424+0000 7f32a62c3640 1 -- 172.21.15.81:0/3822191104 wait complete. 2024-09-12T12:16:15.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:16:15.581 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:15.587 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:15 smithi081 ceph-mon[30948]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:15.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:15 smithi173 ceph-mon[35326]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:15.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:15 smithi103 ceph-mon[35094]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:16.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 -- 172.21.15.81:0/1925509627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040102d90 msgr2=0x7fc040103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1925509627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040102d90 0x7fc040103170 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc030009930 tx=0x7fc03002a420 comp rx=0 tx=0).stop 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 -- 172.21.15.81:0/1925509627 shutdown_connections 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1925509627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc040108290 0x7fc04010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1925509627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040103740 0x7fc040107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1925509627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040102d90 0x7fc040103170 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 -- 172.21.15.81:0/1925509627 >> 172.21.15.81:0/1925509627 conn(0x7fc0400fc7d0 msgr2=0x7fc0400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 -- 172.21.15.81:0/1925509627 shutdown_connections 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.022+0000 7fc045eb7640 1 -- 172.21.15.81:0/1925509627 wait complete. 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 Processor -- start 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 -- start start 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc040102d90 0x7fc0401009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 0x7fc040100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040108290 0x7fc040101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc040112230 con 0x7fc040103740 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0401120b0 con 0x7fc040102d90 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc045eb7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc0401123b0 con 0x7fc040108290 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 0x7fc040100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 0x7fc040100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51732/0 (socket says 172.21.15.81:51732) 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 -- 172.21.15.81:0/1690745463 learned_addr learned my addr 172.21.15.81:0/1690745463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc03ffff640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040108290 0x7fc040101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc040102d90 0x7fc0401009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 -- 172.21.15.81:0/1690745463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040108290 msgr2=0x7fc040101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040108290 0x7fc040101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 -- 172.21.15.81:0/1690745463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc040102d90 msgr2=0x7fc0401009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc040102d90 0x7fc0401009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc037fff640 1 -- 172.21.15.81:0/1690745463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0401a6b70 con 0x7fc040103740 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.023+0000 7fc03ffff640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040108290 0x7fc040101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.024+0000 7fc037fff640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 0x7fc040100f30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c970 tx=0x7fc02800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.024+0000 7fc03d7fa640 1 -- 172.21.15.81:0/1690745463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028007bb0 con 0x7fc040103740 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.024+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0401a6e60 con 0x7fc040103740 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.024+0000 7fc03d7fa640 1 -- 172.21.15.81:0/1690745463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc028007d50 con 0x7fc040103740 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.024+0000 7fc03d7fa640 1 -- 172.21.15.81:0/1690745463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028018860 con 0x7fc040103740 2024-09-12T12:16:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.024+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0401a7310 con 0x7fc040103740 2024-09-12T12:16:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.026+0000 7fc03d7fa640 1 -- 172.21.15.81:0/1690745463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc028018b20 con 0x7fc040103740 2024-09-12T12:16:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.026+0000 7fc048290740 1 Processor -- start 2024-09-12T12:16:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.026+0000 7fc048290740 1 -- start start 2024-09-12T12:16:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc048290740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950acedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc048290740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950acf2f0 0x557950ad9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc048290740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ad9bb0 0x557950adbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc048290740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557950a35090 con 0x557950ace9d0 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc048290740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5579509dca70 con 0x557950acf2f0 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc048290740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557950a31050 con 0x557950ad9bb0 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950acedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950acedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51734/0 (socket says 172.21.15.81:51734) 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 -- 172.21.15.81:0/1615467427 learned_addr learned my addr 172.21.15.81:0/1615467427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc037fff640 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ad9bb0 0x557950adbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950acf2f0 0x557950ad9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 -- 172.21.15.81:0/1615467427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ad9bb0 msgr2=0x557950adbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ad9bb0 0x557950adbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 -- 172.21.15.81:0/1615467427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950acf2f0 msgr2=0x557950ad9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950acf2f0 0x557950ad9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 -- 172.21.15.81:0/1615467427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579509e9130 con 0x557950ace9d0 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950acf2f0 0x557950ad9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03d7fa640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc02c0a2c10 0x7fc02c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03ffff640 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950acedb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc03800c450 tx=0x7fc03800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8745ca8dd100e3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.027+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc02c0a2c10 0x7fc02c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc03d7fa640 1 -- 172.21.15.81:0/1690745463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc0280cf2f0 con 0x7fc040103740 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc035ffb640 1 -- 172.21.15.81:0/1615467427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038007430 con 0x557950ace9d0 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc035ffb640 1 -- 172.21.15.81:0/1615467427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc038007ad0 con 0x557950ace9d0 2024-09-12T12:16:16.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc035ffb640 1 -- 172.21.15.81:0/1615467427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03800abc0 con 0x557950ace9d0 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 -- 172.21.15.81:0/1615467427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 msgr2=0x557950acedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc02c0a2c10 0x7fc02c0a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc030000c00 tx=0x7fc0300058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950acedb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc03800c450 tx=0x7fc03800c910 comp rx=0 tx=0).stop 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 -- 172.21.15.81:0/1615467427 shutdown_connections 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ad9bb0 0x557950adbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950acf2f0 0x557950ad9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 --2- 172.21.15.81:0/1615467427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950acedb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.028+0000 7fc048290740 1 -- 172.21.15.81:0/1615467427 >> 172.21.15.81:0/1615467427 conn(0x557950acaf60 msgr2=0x557950acb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 -- 172.21.15.81:0/1615467427 shutdown_connections 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 -- 172.21.15.81:0/1615467427 wait complete. 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 -- start start 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 Processor -- start 2024-09-12T12:16:16.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950ad93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557950adc780 con 0x557950acf2f0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5579509eff20 con 0x557950ad9bb0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557950adc900 con 0x557950ace9d0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc048290740 10 client.0 _ll_register_callbacks cb 0x5579509b9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc037fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc037fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51750/0 (socket says 172.21.15.81:51750) 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.029+0000 7fc037fff640 1 -- 172.21.15.81:0/2973575654 learned_addr learned my addr 172.21.15.81:0/2973575654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc03ffff640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950ad93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc037fff640 1 -- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 msgr2=0x557950ad93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc037fff640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950ad93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc037fff640 1 -- 172.21.15.81:0/2973575654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 msgr2=0x557950ad6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc037fff640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc037fff640 1 -- 172.21.15.81:0/2973575654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579507a62b0 con 0x557950acf2f0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950ad93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc03ffff640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc037fff640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad6720 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc028017000 tx=0x7fc02800a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c536a377fa29ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc01effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc01effd640 1 -- 172.21.15.81:0/2973575654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02809b530 con 0x557950acf2f0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc038007ad0 con 0x557950acf2f0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc01effd640 1 -- 172.21.15.81:0/2973575654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc02809b040 con 0x557950acf2f0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc01effd640 1 -- 172.21.15.81:0/2973575654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc02809b350 con 0x557950acf2f0 2024-09-12T12:16:16.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc048290740 10 client.15153 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557950ae8020 con 0x557950acf2f0 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.030+0000 7fc01effd640 1 -- 172.21.15.81:0/2973575654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc038007ad0 con 0x557950acf2f0 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc01effd640 1 -- 172.21.15.81:0/2973575654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc028020030 con 0x557950acf2f0 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc048290740 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc048290740 10 client.15153 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc048290740 20 client.15153 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc048290740 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950aea600 0x557950aeba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc048290740 4 client.15153 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 --> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557950a42600 con 0x557950aea600 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950aea600 0x557950aeba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950aea600 0x557950aeba70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93595d62d2a10a4e server_cookie=8003530a34766dbe in_seq=0 out_seq=0 2024-09-12T12:16:16.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.031+0000 7fc01effd640 10 client.15153 ms_handle_connect on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc01effd640 1 -- 172.21.15.81:0/2973575654 <== mds.2 v2:172.21.15.173:6838/2860435891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557950a42600 con 0x557950aea600 2024-09-12T12:16:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc01effd640 10 client.15153 handle_command_reply: tid=0 2024-09-12T12:16:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 client.15153 shutdown 2024-09-12T12:16:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 msgr2=0x557950ad6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad6720 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc028017000 tx=0x7fc02800a480 comp rx=0 tx=0).stop 2024-09-12T12:16:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 shutdown_connections 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950aea600 0x557950aeba70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad6720 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc01effd640 0 client.15153 ms_handle_reset on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 --2- 172.21.15.81:0/2973575654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950ad93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.032+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 >> 172.21.15.81:0/2973575654 conn(0x557950acaf60 msgr2=0x557950ad0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.033+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 shutdown_connections 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.033+0000 7fc048290740 1 -- 172.21.15.81:0/2973575654 wait complete. 2024-09-12T12:16:16.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.033+0000 7fc048290740 20 client.15153 trim_cache size 0 max 16384 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 Processor -- start 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 -- start start 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950aeacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557950ae9db0 con 0x557950acf2f0 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557950aea480 con 0x557950ad9bb0 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc048290740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557950aeab50 con 0x557950ace9d0 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51756/0 (socket says 172.21.15.81:51756) 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 -- 172.21.15.81:0/3625583110 learned_addr learned my addr 172.21.15.81:0/3625583110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc03ffff640 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 -- 172.21.15.81:0/3625583110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 msgr2=0x557950aeacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950aeacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 -- 172.21.15.81:0/3625583110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 msgr2=0x557950ad4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 -- 172.21.15.81:0/3625583110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557950ad74e0 con 0x557950acf2f0 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc03ffff640 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.050+0000 7fc037fff640 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad5fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc02809b6f0 tx=0x7fc02800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82e313ea090e773 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc0357fa640 1 -- 172.21.15.81:0/3625583110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02809c0f0 con 0x557950acf2f0 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc0357fa640 1 -- 172.21.15.81:0/3625583110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0280d2a90 con 0x557950acf2f0 2024-09-12T12:16:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc0357fa640 1 -- 172.21.15.81:0/3625583110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02809ae40 con 0x557950acf2f0 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 -- 172.21.15.81:0/3625583110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 msgr2=0x557950ad5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad5fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc02809b6f0 tx=0x7fc02800af90 comp rx=0 tx=0).stop 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 -- 172.21.15.81:0/3625583110 shutdown_connections 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950ad4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950acf2f0 0x557950ad5fe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 --2- 172.21.15.81:0/3625583110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950ace9d0 0x557950aeacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 -- 172.21.15.81:0/3625583110 >> 172.21.15.81:0/3625583110 conn(0x557950acaf60 msgr2=0x557950ad66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 -- 172.21.15.81:0/3625583110 shutdown_connections 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.051+0000 7fc048290740 1 -- 172.21.15.81:0/3625583110 wait complete. 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 -- start start 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 Processor -- start 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950af41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950aed470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950aed9b0 0x557950aede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557950aeb8f0 con 0x557950ace9d0 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557950aeb220 con 0x557950ad9bb0 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557950aebfc0 con 0x557950aed9b0 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc048290740 10 client.0 _ll_register_callbacks cb 0x7fc0280058a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950af41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950af41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51766/0 (socket says 172.21.15.81:51766) 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 -- 172.21.15.81:0/1475714994 learned_addr learned my addr 172.21.15.81:0/1475714994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc037fff640 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950aed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 -- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950aed9b0 msgr2=0x557950aede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950aed9b0 0x557950aede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 -- 172.21.15.81:0/1475714994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 msgr2=0x557950aed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950aed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.052+0000 7fc03f7fe640 1 -- 172.21.15.81:0/1475714994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557950af1d00 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc03f7fe640 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950af41e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc030005ab0 tx=0x7fc030005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be04b187d436b96a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc01effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc01effd640 1 -- 172.21.15.81:0/1475714994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030035050 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc01effd640 1 -- 172.21.15.81:0/1475714994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc030003800 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0280d2a90 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc01effd640 1 -- 172.21.15.81:0/1475714994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc03005f050 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 10 client.15159 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557950b54e60 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc01effd640 1 -- 172.21.15.81:0/1475714994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0280d2a90 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc01effd640 1 -- 172.21.15.81:0/1475714994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc03003bcc0 con 0x557950ace9d0 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 10 client.15159 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 10 client.15159 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 20 client.15159 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950b59a20 0x557950b58730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 4 client.15159 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.053+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 --> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] -- command(tid 0: {"prefix": "status"}) -- 0x557950a3cb10 con 0x557950b59a20 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc037fff640 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950b59a20 0x557950b58730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc037fff640 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950b59a20 0x557950b58730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a2622129277ba82 server_cookie=8dff28561d68080e in_seq=0 out_seq=0 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc01effd640 10 client.15159 ms_handle_connect on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc01effd640 1 -- 172.21.15.81:0/1475714994 <== mds.2 v2:172.21.15.173:6838/2860435891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557950a3cb10 con 0x557950b59a20 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc01effd640 10 client.15159 handle_command_reply: tid=0 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 client.15159 shutdown 2024-09-12T12:16:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 msgr2=0x557950af41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950af41e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc030005ab0 tx=0x7fc030005bd0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 shutdown_connections 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x557950b59a20 0x557950b58730 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557950aed9b0 0x557950aede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557950ad9bb0 0x557950aed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc01effd640 0 client.15159 ms_handle_reset on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 --2- 172.21.15.81:0/1475714994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557950ace9d0 0x557950af41e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.054+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 >> 172.21.15.81:0/1475714994 conn(0x557950acaf60 msgr2=0x557950ad4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 shutdown_connections 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc048290740 1 -- 172.21.15.81:0/1475714994 wait complete. 2024-09-12T12:16:16.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc048290740 20 client.15159 trim_cache size 0 max 16384 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24457, 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 91.868888896000001, 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:16:16.062 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:16:16.063 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 119.74119020800001 2024-09-12T12:16:16.063 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:16.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc02c0a2c10 msgr2=0x7fc02c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc02c0a2c10 0x7fc02c0a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc030000c00 tx=0x7fc0300058b0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 msgr2=0x7fc040100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:16.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 0x7fc040100f30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc02800c970 tx=0x7fc02800ce30 comp rx=0 tx=0).stop 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 shutdown_connections 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc02c0a2c10 0x7fc02c0a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc040108290 0x7fc040101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc040103740 0x7fc040100f30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 --2- 172.21.15.81:0/1690745463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc040102d90 0x7fc0401009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 >> 172.21.15.81:0/1690745463 conn(0x7fc0400fc7d0 msgr2=0x7fc040105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 shutdown_connections 2024-09-12T12:16:16.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:16.055+0000 7fc045eb7640 1 -- 172.21.15.81:0/1690745463 wait complete. 2024-09-12T12:16:16.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T12:16:17.003 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 -- 172.21.15.81:0/2113810455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 msgr2=0x7f3d9c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 --2- 172.21.15.81:0/2113810455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c10d950 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009cd0 tx=0x7f3d9402a8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 -- 172.21.15.81:0/2113810455 shutdown_connections 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 --2- 172.21.15.81:0/2113810455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c10d950 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 --2- 172.21.15.81:0/2113810455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 0x7f3d9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 --2- 172.21.15.81:0/2113810455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 0x7f3d9c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 -- 172.21.15.81:0/2113810455 >> 172.21.15.81:0/2113810455 conn(0x7f3d9c0fc7a0 msgr2=0x7f3d9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 -- 172.21.15.81:0/2113810455 shutdown_connections 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 -- 172.21.15.81:0/2113810455 wait complete. 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 Processor -- start 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.514+0000 7f3da27ca640 1 -- start start 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 0x7f3d9c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 0x7f3d9c1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c110fe0 con 0x7f3d9c101420 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c110e60 con 0x7f3d9c106a80 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c111160 con 0x7f3d9c100a80 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51786/0 (socket says 172.21.15.81:51786) 2024-09-12T12:16:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 -- 172.21.15.81:0/3852456350 learned_addr learned my addr 172.21.15.81:0/3852456350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 0x7f3d9c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da0d67640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 0x7f3d9c1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 -- 172.21.15.81:0/3852456350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 msgr2=0x7f3d9c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 0x7f3d9c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 -- 172.21.15.81:0/3852456350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 msgr2=0x7f3d9c1a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 0x7f3d9c1a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 -- 172.21.15.81:0/3852456350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c1a4980 con 0x7f3d9c101420 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 0x7f3d9c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da0d67640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 0x7f3d9c1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c199900 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400b4a0 tx=0x7f3d8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d99ffb640 1 -- 172.21.15.81:0/3852456350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84014070 con 0x7f3d9c101420 2024-09-12T12:16:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9c1a4b50 con 0x7f3d9c101420 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d99ffb640 1 -- 172.21.15.81:0/3852456350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d84010b10 con 0x7f3d9c101420 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3d99ffb640 1 -- 172.21.15.81:0/3852456350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84017d60 con 0x7f3d9c101420 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.515+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9c1a5010 con 0x7f3d9c101420 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.517+0000 7f3d99ffb640 1 -- 172.21.15.81:0/3852456350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3d84017070 con 0x7f3d9c101420 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 Processor -- start 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 -- start start 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8aadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de6b811090 con 0x55de6b8b5bb0 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de6b7b8a70 con 0x55de6b8ab2f0 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de6b80d050 con 0x55de6b8aa9d0 2024-09-12T12:16:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51794/0 (socket says 172.21.15.81:51794) 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3d93fff640 1 -- 172.21.15.81:0/988997485 learned_addr learned my addr 172.21.15.81:0/988997485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3d99ffb640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d880a2c10 0x7f3d880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da0d67640 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8aadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.518+0000 7f3da0d67640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d880a2c10 0x7f3d880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d99ffb640 1 -- 172.21.15.81:0/3852456350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f3d840ce430 con 0x7f3d9c101420 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d93fff640 1 -- 172.21.15.81:0/988997485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 msgr2=0x55de6b8aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d93fff640 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8aadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d93fff640 1 -- 172.21.15.81:0/988997485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 msgr2=0x55de6b8b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d93fff640 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d93fff640 1 -- 172.21.15.81:0/988997485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6b7c5130 con 0x55de6b8b5bb0 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3da0d67640 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d93fff640 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b7fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3d840971a0 tx=0x7f3d840047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570d6cbd088808e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3da0d67640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d880a2c10 0x7f3d880a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d94005fe0 tx=0x7f3d94031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d927fc640 1 -- 172.21.15.81:0/988997485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8401e070 con 0x55de6b8b5bb0 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d927fc640 1 -- 172.21.15.81:0/988997485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d8409b440 con 0x55de6b8b5bb0 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.519+0000 7f3d927fc640 1 -- 172.21.15.81:0/988997485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84010cc0 con 0x55de6b8b5bb0 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 -- 172.21.15.81:0/988997485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 msgr2=0x55de6b8b7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b7fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3d840971a0 tx=0x7f3d840047d0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 -- 172.21.15.81:0/988997485 shutdown_connections 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b7fa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/988997485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8aadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 -- 172.21.15.81:0/988997485 >> 172.21.15.81:0/988997485 conn(0x55de6b8a6f60 msgr2=0x55de6b8a7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 -- 172.21.15.81:0/988997485 shutdown_connections 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 -- 172.21.15.81:0/988997485 wait complete. 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 -- start start 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.520+0000 7f3da4ba3740 1 Processor -- start 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 0x55de6b8b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8b8720 con 0x55de6b8aa9d0 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de6b7cbf20 con 0x55de6b8ab2f0 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8b88a0 con 0x55de6b8b5bb0 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 10 client.0 _ll_register_callbacks cb 0x55de6b795030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 0x55de6b8b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 0x55de6b8b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51798/0 (socket says 172.21.15.81:51798) 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 -- 172.21.15.81:0/3752618853 learned_addr learned my addr 172.21.15.81:0/3752618853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da0d67640 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 -- 172.21.15.81:0/3752618853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8b5bb0 msgr2=0x55de6b8b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 -- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 msgr2=0x55de6b8b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 -- 172.21.15.81:0/3752618853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6b5822b0 con 0x55de6b8aa9d0 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 0x55de6b8b54a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00bf30 tx=0x7f3d8c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7201c4c5ddb658 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/3752618853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c01f060 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/3752618853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f3d8c010960 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d8409b440 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.521+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/3752618853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d8c010b60 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 10 client.15171 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55de6b8c40f0 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/3752618853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d8409b440 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/3752618853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3d8c024070 con 0x55de6b8aa9d0 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 10 client.15171 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 10 client.15171 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:16:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 20 client.15171 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b8c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 4 client.15171 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 --> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de6b81e600 con 0x55de6b8c67a0 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.522+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b8c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.523+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b8c7c10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3ccaf6b1eee9271c server_cookie=47cd85b2ecd618f in_seq=0 out_seq=0 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.523+0000 7f3d7b7fe640 10 client.15171 ms_handle_connect on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.523+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/3752618853 <== mds.1 v2:172.21.15.103:6836/4210602713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de6b81e600 con 0x55de6b8c67a0 2024-09-12T12:16:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.523+0000 7f3d7b7fe640 10 client.15171 handle_command_reply: tid=0 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.523+0000 7f3da4ba3740 1 client.15171 shutdown 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 msgr2=0x55de6b8b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 0x55de6b8b54a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00bf30 tx=0x7f3d8c0128e0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 shutdown_connections 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b8c7c10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3d7b7fe640 0 client.15171 ms_handle_reset on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8b5bb0 0x55de6b8b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8ab2f0 0x55de6b8b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3752618853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8aa9d0 0x55de6b8b54a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 >> 172.21.15.81:0/3752618853 conn(0x55de6b8a6f60 msgr2=0x55de6b8acc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 shutdown_connections 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3752618853 wait complete. 2024-09-12T12:16:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.524+0000 7f3da4ba3740 20 client.15171 trim_cache size 0 max 16384 2024-09-12T12:16:17.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 Processor -- start 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 -- start start 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8c5f50 con 0x55de6b8ab2f0 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8c6620 con 0x55de6b8b5bb0 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8c6cf0 con 0x55de6b8aa9d0 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51808/0 (socket says 172.21.15.81:51808) 2024-09-12T12:16:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 -- 172.21.15.81:0/3020512797 learned_addr learned my addr 172.21.15.81:0/3020512797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3da0d67640 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 -- 172.21.15.81:0/3020512797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 msgr2=0x55de6b8add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 -- 172.21.15.81:0/3020512797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 msgr2=0x55de6b8aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 -- 172.21.15.81:0/3020512797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6b8c5d80 con 0x55de6b8ab2f0 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d93fff640 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8afa50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3d8409acd0 tx=0x7f3d840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be26d135d449ebd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.542+0000 7f3d91ffb640 1 -- 172.21.15.81:0/3020512797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8401e040 con 0x55de6b8ab2f0 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3d91ffb640 1 -- 172.21.15.81:0/3020512797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d840ce240 con 0x55de6b8ab2f0 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3d91ffb640 1 -- 172.21.15.81:0/3020512797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8406e0b0 con 0x55de6b8ab2f0 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3020512797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 msgr2=0x55de6b8afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8afa50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3d8409acd0 tx=0x7f3d840046c0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3020512797 shutdown_connections 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8afa50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/3020512797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3020512797 >> 172.21.15.81:0/3020512797 conn(0x55de6b8a6f60 msgr2=0x55de6b8ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3020512797 shutdown_connections 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 -- 172.21.15.81:0/3020512797 wait complete. 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.543+0000 7f3da4ba3740 1 -- start start 2024-09-12T12:16:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 Processor -- start 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8c7a90 con 0x55de6b8ab2f0 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8c73c0 con 0x55de6b8b5bb0 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de6b8c8160 con 0x55de6b8aa9d0 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da4ba3740 10 client.0 _ll_register_callbacks cb 0x7f3d8c00b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51818/0 (socket says 172.21.15.81:51818) 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 -- 172.21.15.81:0/2467425876 learned_addr learned my addr 172.21.15.81:0/2467425876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3da0d67640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 -- 172.21.15.81:0/2467425876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 msgr2=0x55de6b8cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 -- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 msgr2=0x55de6b8c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d93fff640 1 -- 172.21.15.81:0/2467425876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6b8c9730 con 0x55de6b8ab2f0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.544+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d93fff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8cefa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004810 tx=0x7f3d84017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57d85e3d1cf7953 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/2467425876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8409b440 con 0x55de6b8ab2f0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/2467425876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f3d840173f0 con 0x55de6b8ab2f0 2024-09-12T12:16:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d840ce240 con 0x55de6b8ab2f0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/2467425876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d84010cc0 con 0x55de6b8ab2f0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 10 client.15177 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55de6b8cdec0 con 0x55de6b8ab2f0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/2467425876 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d840ce240 con 0x55de6b8ab2f0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/2467425876 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3d84062070 con 0x55de6b8ab2f0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 10 client.15177 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 10 client.15177 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 20 client.15177 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b933710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 4 client.15177 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.545+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 --> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] -- command(tid 0: {"prefix": "status"}) -- 0x55de6b818b10 con 0x55de6b8c67a0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b933710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3d7b7fe640 10 client.15177 ms_handle_connect on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3d9bfff640 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b933710 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=872eef7b181f80c3 server_cookie=6bfd725d68ca9e8b in_seq=0 out_seq=0 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3d7b7fe640 1 -- 172.21.15.81:0/2467425876 <== mds.1 v2:172.21.15.103:6836/4210602713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55de6b818b10 con 0x55de6b8c67a0 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3d7b7fe640 10 client.15177 handle_command_reply: tid=0 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 client.15177 shutdown 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 msgr2=0x55de6b8cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8cefa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3d84004810 tx=0x7f3d84017360 comp rx=0 tx=0).stop 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 shutdown_connections 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55de6b8c67a0 0x55de6b933710 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55de6b8b5bb0 0x55de6b8c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de6b8ab2f0 0x55de6b8cefa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3d7b7fe640 0 client.15177 ms_handle_reset on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 --2- 172.21.15.81:0/2467425876 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de6b8aa9d0 0x55de6b8cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 >> 172.21.15.81:0/2467425876 conn(0x55de6b8a6f60 msgr2=0x55de6b8ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 shutdown_connections 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.546+0000 7f3da4ba3740 1 -- 172.21.15.81:0/2467425876 wait complete. 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da4ba3740 20 client.15177 trim_cache size 0 max 16384 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-12T12:16:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24461, 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 94.369167880000006, 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 123.806339201 2024-09-12T12:16:17.561 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d880a2c10 msgr2=0x7f3d880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d880a2c10 0x7f3d880a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3d94005fe0 tx=0x7f3d94031000 comp rx=0 tx=0).stop 2024-09-12T12:16:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 msgr2=0x7f3d9c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c199900 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400b4a0 tx=0x7f3d8400b960 comp rx=0 tx=0).stop 2024-09-12T12:16:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 shutdown_connections 2024-09-12T12:16:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d880a2c10 0x7f3d880a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d9c106a80 0x7f3d9c1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d9c101420 0x7f3d9c199900 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 --2- 172.21.15.81:0/3852456350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d9c100a80 0x7f3d9c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 >> 172.21.15.81:0/3852456350 conn(0x7f3d9c0fc7a0 msgr2=0x7f3d9c0fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 shutdown_connections 2024-09-12T12:16:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:17.547+0000 7f3da27ca640 1 -- 172.21.15.81:0/3852456350 wait complete. 2024-09-12T12:16:17.837 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:17 smithi081 ceph-mon[30948]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:17.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:17 smithi173 ceph-mon[35326]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:17.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:17 smithi103 ceph-mon[35094]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-12T12:16:18.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T12:16:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 -- 172.21.15.81:0/992622448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954100a80 msgr2=0x7fa954100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 --2- 172.21.15.81:0/992622448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954100a80 0x7fa954100ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa944009930 tx=0x7fa94402a420 comp rx=0 tx=0).stop 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 -- 172.21.15.81:0/992622448 shutdown_connections 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 --2- 172.21.15.81:0/992622448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954101420 0x7fa95410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 --2- 172.21.15.81:0/992622448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954100a80 0x7fa954100ee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 --2- 172.21.15.81:0/992622448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954106a80 0x7fa954106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 -- 172.21.15.81:0/992622448 >> 172.21.15.81:0/992622448 conn(0x7fa9540fc7a0 msgr2=0x7fa9540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 -- 172.21.15.81:0/992622448 shutdown_connections 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.074+0000 7fa95be34640 1 -- 172.21.15.81:0/992622448 wait complete. 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 Processor -- start 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 -- start start 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954100a80 0x7fa954198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 0x7fa954198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954106a80 0x7fa95419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa954111060 con 0x7fa954101420 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa954110ee0 con 0x7fa954100a80 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa95be34640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa9541111e0 con 0x7fa954106a80 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa9593cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 0x7fa954198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa9593cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 0x7fa954198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51842/0 (socket says 172.21.15.81:51842) 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.075+0000 7fa9593cf640 1 -- 172.21.15.81:0/274560018 learned_addr learned my addr 172.21.15.81:0/274560018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954106a80 0x7fa95419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa959bd0640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954100a80 0x7fa954198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa9593cf640 1 -- 172.21.15.81:0/274560018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954106a80 msgr2=0x7fa95419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa9593cf640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954106a80 0x7fa95419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa9593cf640 1 -- 172.21.15.81:0/274560018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954100a80 msgr2=0x7fa954198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa9593cf640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954100a80 0x7fa954198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa9593cf640 1 -- 172.21.15.81:0/274560018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95419d640 con 0x7fa954101420 2024-09-12T12:16:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954106a80 0x7fa95419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa959bd0640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954100a80 0x7fa954198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa9593cf640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 0x7fa954198bd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa944009a50 tx=0x7fa944004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa94affd640 1 -- 172.21.15.81:0/274560018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94403f030 con 0x7fa954101420 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa94affd640 1 -- 172.21.15.81:0/274560018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa944003af0 con 0x7fa954101420 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95419d8d0 con 0x7fa954101420 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa94affd640 1 -- 172.21.15.81:0/274560018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944035070 con 0x7fa954101420 2024-09-12T12:16:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.076+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9541a5210 con 0x7fa954101420 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.078+0000 7fa94affd640 1 -- 172.21.15.81:0/274560018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fa944042030 con 0x7fa954101420 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 Processor -- start 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 -- start start 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14961db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa1496c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa1496efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa148c8090 con 0x55aa149619d0 2024-09-12T12:16:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1486fa70 con 0x55aa1496cbb0 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95e20d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa148c4050 con 0x55aa149622f0 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95a3d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14961db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95a3d1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14961db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51848/0 (socket says 172.21.15.81:51848) 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa95a3d1640 1 -- 172.21.15.81:0/3280570339 learned_addr learned my addr 172.21.15.81:0/3280570339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa1496efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.079+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa1496c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 -- 172.21.15.81:0/3280570339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 msgr2=0x55aa1496c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa94affd640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa9400a2b80 0x7fa9400a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa1496c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 -- 172.21.15.81:0/3280570339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 msgr2=0x55aa1496efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa1496efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 -- 172.21.15.81:0/3280570339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1487c130 con 0x55aa149619d0 2024-09-12T12:16:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa1496c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa1496efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa94affd640 1 -- 172.21.15.81:0/274560018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fa9440ef9c0 con 0x7fa954101420 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14961db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c450 tx=0x7fa94c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c758a623fcb7b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa9400a2b80 0x7fa9400a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa93ffff640 1 -- 172.21.15.81:0/3280570339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00c270 con 0x55aa149619d0 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa93ffff640 1 -- 172.21.15.81:0/3280570339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa94c01d040 con 0x55aa149619d0 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.080+0000 7fa93ffff640 1 -- 172.21.15.81:0/3280570339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00a620 con 0x55aa149619d0 2024-09-12T12:16:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 -- 172.21.15.81:0/3280570339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 msgr2=0x55aa14961db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa9400a2b80 0x7fa9400a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa94c017000 tx=0x7fa94c00ad40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14961db0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c450 tx=0x7fa94c00c910 comp rx=0 tx=0).stop 2024-09-12T12:16:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 -- 172.21.15.81:0/3280570339 shutdown_connections 2024-09-12T12:16:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa1496efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa1496c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3280570339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14961db0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 -- 172.21.15.81:0/3280570339 >> 172.21.15.81:0/3280570339 conn(0x55aa1495df60 msgr2=0x55aa1495e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 -- 172.21.15.81:0/3280570339 shutdown_connections 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 -- 172.21.15.81:0/3280570339 wait complete. 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 -- start start 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.081+0000 7fa95e20d740 1 Processor -- start 2024-09-12T12:16:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa1496c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14969720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14969c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1496f780 con 0x55aa149622f0 2024-09-12T12:16:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa14882f20 con 0x55aa1496cbb0 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1496f900 con 0x55aa149619d0 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 10 client.0 _ll_register_callbacks cb 0x55aa1484c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14969720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14969720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51850/0 (socket says 172.21.15.81:51850) 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 -- 172.21.15.81:0/4067074664 learned_addr learned my addr 172.21.15.81:0/4067074664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa959bd0640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa1496c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14969c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 -- 172.21.15.81:0/4067074664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 msgr2=0x55aa1496c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa1496c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 -- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 msgr2=0x55aa14969c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14969c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 -- 172.21.15.81:0/4067074664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa146392b0 con 0x55aa149622f0 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14969c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa9593cf640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14969720 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa944009900 tx=0x7fa944043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4173ca85ac1c24d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa93d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa93d7fa640 1 -- 172.21.15.81:0/4067074664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944049050 con 0x55aa149622f0 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa93d7fa640 1 -- 172.21.15.81:0/4067074664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fa94403b460 con 0x55aa149622f0 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.082+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa94c01d040 con 0x55aa149622f0 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa93d7fa640 1 -- 172.21.15.81:0/4067074664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa9440dae60 con 0x55aa149622f0 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 10 client.15189 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aa1497afa0 con 0x55aa149622f0 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa93d7fa640 1 -- 172.21.15.81:0/4067074664 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa94c01d040 con 0x55aa149622f0 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa93d7fa640 1 -- 172.21.15.81:0/4067074664 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fa9440b8890 con 0x55aa149622f0 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 10 client.15189 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 10 client.15189 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 20 client.15189 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa1497d5f0 0x55aa1497ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 4 client.15189 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa148d5600 con 0x55aa1497d5f0 2024-09-12T12:16:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.083+0000 7fa959bd0640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa1497d5f0 0x55aa1497ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.084+0000 7fa959bd0640 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa1497d5f0 0x55aa1497ea60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d2b96b4fce6138 server_cookie=195ba5983a3b433f in_seq=0 out_seq=0 2024-09-12T12:16:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.084+0000 7fa93d7fa640 10 client.15189 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.084+0000 7fa93d7fa640 1 -- 172.21.15.81:0/4067074664 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa148d5600 con 0x55aa1497d5f0 2024-09-12T12:16:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.084+0000 7fa93d7fa640 10 client.15189 handle_command_reply: tid=0 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.084+0000 7fa95e20d740 1 client.15189 shutdown 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 msgr2=0x55aa14969720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14969720 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa944009900 tx=0x7fa944043000 comp rx=0 tx=0).stop 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 shutdown_connections 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa1497d5f0 0x55aa1497ea60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14969c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14969720 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 --2- 172.21.15.81:0/4067074664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa1496c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa93d7fa640 0 client.15189 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 >> 172.21.15.81:0/4067074664 conn(0x55aa1495df60 msgr2=0x55aa14963c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 shutdown_connections 2024-09-12T12:16:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 1 -- 172.21.15.81:0/4067074664 wait complete. 2024-09-12T12:16:19.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.085+0000 7fa95e20d740 20 client.15189 trim_cache size 0 max 16384 2024-09-12T12:16:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 Processor -- start 2024-09-12T12:16:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 -- start start 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa14968fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14967ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14968530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1497cda0 con 0x55aa149622f0 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1497d470 con 0x55aa1496cbb0 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.102+0000 7fa95e20d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1497db40 con 0x55aa149619d0 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14967ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14967ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51866/0 (socket says 172.21.15.81:51866) 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 -- 172.21.15.81:0/3470678335 learned_addr learned my addr 172.21.15.81:0/3470678335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14968530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa14968fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 -- 172.21.15.81:0/3470678335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 msgr2=0x55aa14968fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa14968fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 -- 172.21.15.81:0/3470678335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 msgr2=0x55aa14968530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14968530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 -- 172.21.15.81:0/3470678335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1496a4e0 con 0x55aa149622f0 2024-09-12T12:16:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa95a3d1640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14968530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa14968fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14967ff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa94403d040 tx=0x7fa944009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6f726fbfc9d6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa93f7fe640 1 -- 172.21.15.81:0/3470678335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944049030 con 0x55aa149622f0 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa93f7fe640 1 -- 172.21.15.81:0/3470678335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa9440c05d0 con 0x55aa149622f0 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.103+0000 7fa93f7fe640 1 -- 172.21.15.81:0/3470678335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440c4a00 con 0x55aa149622f0 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 -- 172.21.15.81:0/3470678335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 msgr2=0x55aa14967ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14967ff0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa94403d040 tx=0x7fa944009580 comp rx=0 tx=0).stop 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 -- 172.21.15.81:0/3470678335 shutdown_connections 2024-09-12T12:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14968530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149622f0 0x55aa14967ff0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3470678335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149619d0 0x55aa14968fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 -- 172.21.15.81:0/3470678335 >> 172.21.15.81:0/3470678335 conn(0x55aa1495df60 msgr2=0x55aa149696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 -- 172.21.15.81:0/3470678335 shutdown_connections 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 -- 172.21.15.81:0/3470678335 wait complete. 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 -- start start 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.104+0000 7fa95e20d740 1 Processor -- start 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14987260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa14966300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14966840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1497e8e0 con 0x55aa149619d0 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1497e210 con 0x55aa1496cbb0 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1497efb0 con 0x55aa149622f0 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 10 client.0 _ll_register_callbacks cb 0x7fa9440b8540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14987260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14987260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51876/0 (socket says 172.21.15.81:51876) 2024-09-12T12:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 -- 172.21.15.81:0/3238735829 learned_addr learned my addr 172.21.15.81:0/3238735829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa14966300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 -- 172.21.15.81:0/3238735829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 msgr2=0x55aa14966300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa14966300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 -- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 msgr2=0x55aa14966840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14966840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 -- 172.21.15.81:0/3238735829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa14966e00 con 0x55aa149619d0 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa959bd0640 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14987260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55aa1496cae0 tx=0x7fa950017810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0868be2407ccdc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa93d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa93d7fa640 1 -- 172.21.15.81:0/3238735829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95000f040 con 0x55aa149619d0 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9440c05d0 con 0x55aa149619d0 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.105+0000 7fa93d7fa640 1 -- 172.21.15.81:0/3238735829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fa950024420 con 0x55aa149619d0 2024-09-12T12:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa93d7fa640 1 -- 172.21.15.81:0/3238735829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa950024620 con 0x55aa149619d0 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 10 client.15195 fetch_fsmap learned FSMap version 26 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aa14985b40 con 0x55aa149619d0 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa93d7fa640 1 -- 172.21.15.81:0/3238735829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa9440c05d0 con 0x55aa149619d0 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa93d7fa640 1 -- 172.21.15.81:0/3238735829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fa9500157f0 con 0x55aa149619d0 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 10 client.15195 fetch_fsmap finished waiting for FSMap version 26 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 10 client.15195 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 20 client.15195 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa149ec690 0x55aa149eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 4 client.15195 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "status"}) -- 0x55aa148cfb10 con 0x55aa149ec690 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.106+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa149ec690 0x55aa149eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa93d7fa640 10 client.15195 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa9593cf640 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa149ec690 0x55aa149eb3a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93918802a0acfb22 server_cookie=a57a4a23e94c4fb0 in_seq=0 out_seq=0 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa93d7fa640 1 -- 172.21.15.81:0/3238735829 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55aa148cfb10 con 0x55aa149ec690 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa93d7fa640 10 client.15195 handle_command_reply: tid=0 2024-09-12T12:16:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 client.15195 shutdown 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 msgr2=0x55aa14987260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14987260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55aa1496cae0 tx=0x7fa950017810 comp rx=0 tx=0).stop 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 shutdown_connections 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55aa149ec690 0x55aa149eb3a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1496cbb0 0x55aa14966840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa149622f0 0x55aa14966300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa93d7fa640 0 client.15195 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 --2- 172.21.15.81:0/3238735829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa149619d0 0x55aa14987260 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 >> 172.21.15.81:0/3238735829 conn(0x55aa1495df60 msgr2=0x55aa149696e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 shutdown_connections 2024-09-12T12:16:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 1 -- 172.21.15.81:0/3238735829 wait complete. 2024-09-12T12:16:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.107+0000 7fa95e20d740 20 client.15195 trim_cache size 0 max 16384 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24485, 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 102.726966635, 2024-09-12T12:16:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 26, 2024-09-12T12:16:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-09-12T12:16:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 77, 2024-09-12T12:16:19.136 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 113.587036199 2024-09-12T12:16:19.136 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa9400a2b80 msgr2=0x7fa9400a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa9400a2b80 0x7fa9400a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa94c017000 tx=0x7fa94c00ad40 comp rx=0 tx=0).stop 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 msgr2=0x7fa954198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 0x7fa954198bd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa944009a50 tx=0x7fa944004270 comp rx=0 tx=0).stop 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 shutdown_connections 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fa9400a2b80 0x7fa9400a5040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa954106a80 0x7fa95419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa954101420 0x7fa954198bd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 --2- 172.21.15.81:0/274560018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa954100a80 0x7fa954198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 >> 172.21.15.81:0/274560018 conn(0x7fa9540fc7a0 msgr2=0x7fa95406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 shutdown_connections 2024-09-12T12:16:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.108+0000 7fa95be34640 1 -- 172.21.15.81:0/274560018 wait complete. 2024-09-12T12:16:19.710 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:19 smithi081 ceph-mon[30948]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:16:19.710 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:19 smithi081 ceph-mon[30948]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T12:16:19.737 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T12:16:19.747 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T12:16:19.747 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T12:16:19.747 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T12:16:19.748 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T12:16:19.748 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T12:16:19.749 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:16:19.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T12:16:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.849+0000 7f18e6423640 1 -- 172.21.15.81:0/2406319630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 msgr2=0x7f18e01049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.849+0000 7f18e6423640 1 --2- 172.21.15.81:0/2406319630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e01049d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009900 tx=0x7f18d002a410 comp rx=0 tx=0).stop 2024-09-12T12:16:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 -- 172.21.15.81:0/2406319630 shutdown_connections 2024-09-12T12:16:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 --2- 172.21.15.81:0/2406319630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 0x7f18e0109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 --2- 172.21.15.81:0/2406319630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 0x7f18e0107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 --2- 172.21.15.81:0/2406319630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e01049d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 -- 172.21.15.81:0/2406319630 >> 172.21.15.81:0/2406319630 conn(0x7f18e00fc1e0 msgr2=0x7f18e00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 -- 172.21.15.81:0/2406319630 shutdown_connections 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 -- 172.21.15.81:0/2406319630 wait complete. 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 Processor -- start 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 -- start start 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 0x7f18e01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.850+0000 7f18e6423640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 0x7f18e019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e6423640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18e010d9a0 con 0x7f18e01025e0 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e6423640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18e010d820 con 0x7f18e0107840 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e6423640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18e010db20 con 0x7f18e0104f10 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e0197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51896/0 (socket says 172.21.15.81:51896) 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 -- 172.21.15.81:0/2139545077 learned_addr learned my addr 172.21.15.81:0/2139545077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e49c0640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 0x7f18e019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 -- 172.21.15.81:0/2139545077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 msgr2=0x7f18e01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18df7fe640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 0x7f18e01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 0x7f18e01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 -- 172.21.15.81:0/2139545077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 msgr2=0x7f18e019f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 0x7f18e019f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 -- 172.21.15.81:0/2139545077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e019faa0 con 0x7f18e01025e0 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18df7fe640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 0x7f18e01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e49c0640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 0x7f18e019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dffff640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e0197e80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f18d00316a0 tx=0x7f18d0032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d003f030 con 0x7f18e01025e0 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f18d0003d00 con 0x7f18e01025e0 2024-09-12T12:16:19.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e019fd30 con 0x7f18e01025e0 2024-09-12T12:16:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0035070 con 0x7f18e01025e0 2024-09-12T12:16:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.851+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e01a01c0 con 0x7f18e01025e0 2024-09-12T12:16:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.852+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e00fdcd0 con 0x7f18e01025e0 2024-09-12T12:16:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.853+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f18d0042030 con 0x7f18e01025e0 2024-09-12T12:16:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.854+0000 7f18dd7fa640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18c80a2cb0 0x7f18c80a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.854+0000 7f18df7fe640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18c80a2cb0 0x7f18c80a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.854+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f18d00ef5a0 con 0x7f18e01025e0 2024-09-12T12:16:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.854+0000 7f18df7fe640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18c80a2cb0 0x7f18c80a5170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f18e0199390 tx=0x7f18d4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:19.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:19.858+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18d00bc5a0 con 0x7f18e01025e0 2024-09-12T12:16:19.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:19 smithi173 ceph-mon[35326]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:16:19.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:19 smithi173 ceph-mon[35326]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T12:16:19.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:19 smithi103 ceph-mon[35094]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-12T12:16:19.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:19 smithi103 ceph-mon[35094]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-12T12:16:20.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.069+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f18e0062df0 con 0x7f18e01025e0 2024-09-12T12:16:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.479+0000 7f18dd7fa640 1 -- 172.21.15.81:0/2139545077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f18d00bbea0 con 0x7f18e01025e0 2024-09-12T12:16:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18c80a2cb0 msgr2=0x7f18c80a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18c80a2cb0 0x7f18c80a5170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f18e0199390 tx=0x7f18d4005d90 comp rx=0 tx=0).stop 2024-09-12T12:16:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 msgr2=0x7f18e0197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:20.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e0197e80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f18d00316a0 tx=0x7f18d0032d70 comp rx=0 tx=0).stop 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 shutdown_connections 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f18c80a2cb0 0x7f18c80a5170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18e0107840 0x7f18e019f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18e0104f10 0x7f18e01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 --2- 172.21.15.81:0/2139545077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e01025e0 0x7f18e0197e80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 >> 172.21.15.81:0/2139545077 conn(0x7f18e00fc1e0 msgr2=0x7f18e0102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 shutdown_connections 2024-09-12T12:16:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:20.481+0000 7f18e6423640 1 -- 172.21.15.81:0/2139545077 wait complete. 2024-09-12T12:16:20.498 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T12:16:20.525 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T12:16:20.525 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T12:16:20.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:20.525 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-12T12:16:20.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:20.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-12T12:16:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-12T12:16:20.611 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:16:20.611 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-12T12:16:20.612 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T12:16:20.612 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:20.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T12:16:20.836 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2139545077' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: ignoring --setuser ceph since I am not root 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: ignoring --setgroup ceph since I am not root 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-mgr[37130]: -- 172.21.15.173:0/3844476441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5db2c50e0 con 0x55e5db2a2800 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:20.631+0000 7ffa3f156040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:20.688+0000 7ffa3f156040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:20.835+0000 7ffa3f156040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:20.837 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2139545077' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T12:16:20.838 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: ignoring --setuser ceph since I am not root 2024-09-12T12:16:20.838 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: ignoring --setgroup ceph since I am not root 2024-09-12T12:16:20.838 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-mgr[36462]: -- 172.21.15.103:0/386349614 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566d14fd0e0 con 0x5566d14db400 2024-09-12T12:16:20.838 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:20.631+0000 7f9d56103040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:20.838 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:20.689+0000 7f9d56103040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:20.838 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:20.838+0000 7f9d56103040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:20.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2139545077' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T12:16:20.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ignoring --setuser ceph since I am not root 2024-09-12T12:16:20.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ignoring --setgroup ceph since I am not root 2024-09-12T12:16:20.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:20.634+0000 7f4efc94c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T12:16:20.852 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:20.694+0000 7f4efc94c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:20.852 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:20.850+0000 7f4efc94c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T12:16:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:21.109 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:20.925+0000 7f4efc94c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:21.109 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:21.078+0000 7f4efc94c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:21.153 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:20.901+0000 7ffa3f156040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:21.153 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:21.046+0000 7ffa3f156040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:21.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:20.903+0000 7f9d56103040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T12:16:21.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:21.052+0000 7f9d56103040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 -- 172.21.15.81:0/992063172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c100e20 msgr2=0x7f3d8c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 --2- 172.21.15.81:0/992063172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c100e20 0x7f3d8c101200 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009900 tx=0x7f3d7c02a480 comp rx=0 tx=0).stop 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 -- 172.21.15.81:0/992063172 shutdown_connections 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 --2- 172.21.15.81:0/992063172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 --2- 172.21.15.81:0/992063172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d8c102570 0x7f3d8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 --2- 172.21.15.81:0/992063172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c100e20 0x7f3d8c101200 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 -- 172.21.15.81:0/992063172 >> 172.21.15.81:0/992063172 conn(0x7f3d8c0fc7d0 msgr2=0x7f3d8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 -- 172.21.15.81:0/992063172 shutdown_connections 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.386+0000 7f3d927fc640 1 -- 172.21.15.81:0/992063172 wait complete. 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 Processor -- start 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 -- start start 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d8c100e20 0x7f3d8c103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d8c102570 0x7f3d8c103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c1041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1110a0 con 0x7f3d8c102ef0 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c110f20 con 0x7f3d8c102570 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d927fc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c111220 con 0x7f3d8c100e20 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d90d99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c1041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d90d99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c1041d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51934/0 (socket says 172.21.15.81:51934) 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d90d99640 1 -- 172.21.15.81:0/3017704426 learned_addr learned my addr 172.21.15.81:0/3017704426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d8bfff640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d8c100e20 0x7f3d8c103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.387+0000 7f3d83fff640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d8c102570 0x7f3d8c103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d90d99640 1 -- 172.21.15.81:0/3017704426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d8c100e20 msgr2=0x7f3d8c103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d90d99640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d8c100e20 0x7f3d8c103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d90d99640 1 -- 172.21.15.81:0/3017704426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d8c102570 msgr2=0x7f3d8c103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d90d99640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d8c102570 0x7f3d8c103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d90d99640 1 -- 172.21.15.81:0/3017704426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c1a6a60 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d90d99640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c1041d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009fd0 tx=0x7f3d8400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84017070 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d84004020 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d840106c0 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c1a6d50 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.388+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1a7240 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.389+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8c101200 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.391+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f3d840041d0 con 0x7f3d8c102ef0 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.391+0000 7f3d89ffb640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 0x7f3d780a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.391+0000 7f3d8bfff640 1 -- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 msgr2=0x7f3d780a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:21.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.392+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f3d840cebe0 con 0x7f3d8c102ef0 2024-09-12T12:16:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.392+0000 7f3d8bfff640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 0x7f3d780a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:21.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.395+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d8409b590 con 0x7f3d8c102ef0 2024-09-12T12:16:21.480 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:21.234+0000 7f4efc94c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:21.481 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:21.194+0000 7f9d56103040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:21.481 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:21.187+0000 7ffa3f156040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T12:16:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.593+0000 7f3d8bfff640 1 -- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 msgr2=0x7f3d780a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.593+0000 7f3d8bfff640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 0x7f3d780a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.605+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3d8c1a7470 con 0x7f3d8c102ef0 2024-09-12T12:16:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.605+0000 7f3d89ffb640 1 -- 172.21.15.81:0/3017704426 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f3d8409f890 con 0x7f3d8c102ef0 2024-09-12T12:16:21.606 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 msgr2=0x7f3d780a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 0x7f3d780a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 msgr2=0x7f3d8c1041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c1041d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009fd0 tx=0x7f3d8400b260 comp rx=0 tx=0).stop 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 shutdown_connections 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f3d780a2bd0 0x7f3d780a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d8c102ef0 0x7f3d8c1041d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d8c102570 0x7f3d8c103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 --2- 172.21.15.81:0/3017704426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d8c100e20 0x7f3d8c103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.607+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 >> 172.21.15.81:0/3017704426 conn(0x7f3d8c0fc7d0 msgr2=0x7f3d8c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.608+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 shutdown_connections 2024-09-12T12:16:21.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:21.608+0000 7f3d927fc640 1 -- 172.21.15.81:0/3017704426 wait complete. 2024-09-12T12:16:21.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2139545077' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T12:16:21.741 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-mon[35326]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T12:16:21.741 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:21.499+0000 7ffa3f156040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:21.742 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:21.558+0000 7ffa3f156040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:21.742 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:21.741+0000 7ffa3f156040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:21.757 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2139545077' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T12:16:21.757 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-mon[35094]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T12:16:21.757 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:21.511+0000 7f9d56103040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:21.757 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:21.572+0000 7f9d56103040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:21.817 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2139545077' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T12:16:21.817 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-mon[30948]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-12T12:16:21.818 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:21.559+0000 7f4efc94c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T12:16:21.818 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:21.623+0000 7f4efc94c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T12:16:21.818 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:21.817+0000 7f4efc94c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:22.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:21.757+0000 7f9d56103040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T12:16:22.223 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T12:16:22.224 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T12:16:22.224 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-12T12:16:22.224 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T12:16:22.224 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:22.224 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T12:16:22.224 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T12:16:22.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T12:16:22.225 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:16:22.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:22.225 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-12T12:16:22.242 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42216sec preferred_lft 42216sec 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-12T12:16:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-12T12:16:22.244 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T12:16:22.244 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:16:22.244 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T12:16:22.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-12T12:16:22.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-12T12:16:22.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-12T12:16:22.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T12:16:22.245 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T12:16:22.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:22.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:22.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:22.451 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T12:16:22.475 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-12T12:16:22.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:22.476 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-12T12:16:22.552 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-12T12:16:22.552 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T12:16:22.552 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T12:16:22.552 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T12:16:22.552 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T12:16:22.553 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:16:22.553 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T12:16:22.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T12:16:22.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T12:16:22.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T12:16:22.553 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T12:16:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:22.748 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:22 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3017704426' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:16:22.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:22.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:22.851 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-12T12:16:22.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:22.869 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-12T12:16:22.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:22 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3017704426' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:16:22.904 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:22.617+0000 7ffa3f156040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:22.904 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:22.684+0000 7ffa3f156040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:22.925 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:16:22.925 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T12:16:22.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:16:22.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T12:16:22.925 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T12:16:22.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:22 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3017704426' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T12:16:22.938 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:22.642+0000 7f9d56103040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:22.938 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:22.710+0000 7f9d56103040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:23.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:23.022 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:22.747+0000 7f4efc94c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T12:16:23.022 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:22.819+0000 7f4efc94c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T12:16:23.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.044 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T12:16:23.044 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:16:23.044 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T12:16:23.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T12:16:23.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T12:16:23.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T12:16:23.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T12:16:23.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T12:16:23.045 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T12:16:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:23.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.170 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T12:16:23.170 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-12T12:16:23.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-12T12:16:23.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T12:16:23.170 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-12T12:16:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:23.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:16:23.249 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:23.264 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T12:16:23.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T12:16:23.265 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:23.320 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T12:16:23.320 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T12:16:23.320 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/e8e9a179-a1ef-4114-8e62-e75fa260ee80 2024-09-12T12:16:23.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:23.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/e8e9a179-a1ef-4114-8e62-e75fa260ee80 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T12:16:23.419 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T12:16:23.419 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T12:16:23.419 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-12T12:16:23.547 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-12T12:16:23.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-12T12:16:23.547 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-12T12:16:23.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.103:3300,172.21.15.173:3300" 2024-09-12T12:16:23.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:3300,172.21.15.103:3300,172.21.15.173:3300:/volumes/qa/sv_1/e8e9a179-a1ef-4114-8e62-e75fa260ee80 2024-09-12T12:16:23.548 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=595bfb7a-70ff-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T12:16:23.549 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T12:16:23.549 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-12T12:16:23.549 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T12:16:23.549 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T12:16:23.549 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T12:16:23.550 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T12:16:23.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:16:23.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:23.578 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:16:23.649 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.390+0000 7ffa3f156040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:23.649 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.505+0000 7ffa3f156040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:16:23.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.675 INFO:teuthology.orchestra.run.smithi081.stdout:client24827 2024-09-12T12:16:23.676 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:16:23.676 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:16:23.683 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:23.421+0000 7f9d56103040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:23.684 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:23.538+0000 7f9d56103040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:23.693 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:16:23.713 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:23.588+0000 7f4efc94c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T12:16:23.713 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:23.712+0000 7f4efc94c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T12:16:23.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:16:23.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.769 INFO:teuthology.orchestra.run.smithi081.stdout:client24827 2024-09-12T12:16:23.769 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T12:16:23.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T12:16:23.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.825 INFO:teuthology.orchestra.run.smithi081.stdout:client24827 2024-09-12T12:16:23.826 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968.client24827/status') 2024-09-12T12:16:23.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T12:16:23.885 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.24827 (3)172.21.15.81:0/3739049111 2024-09-12T12:16:23.885 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-12T12:16:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-12T12:16:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-12T12:16:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:71 bytes copied, 2.2762e-05 s, 3.1 MB/s 2024-09-12T12:16:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T12:16:23.893 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T12:16:23.902 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T12:16:23.902 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:16:23.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T12:16:23.903 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.648+0000 7ffa3f156040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:23.904 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.709+0000 7ffa3f156040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:23.904 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.856+0000 7ffa3f156040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:23.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:23.683+0000 7f9d56103040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:23.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:23.744+0000 7f9d56103040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:23.935 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:23.894+0000 7f9d56103040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:24.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 -- 172.21.15.81:0/682352948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408101c30 msgr2=0x7fc4081020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/682352948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408101c30 0x7fc4081020b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009900 tx=0x7fc3fc02a410 comp rx=0 tx=0).stop 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 -- 172.21.15.81:0/682352948 shutdown_connections 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/682352948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 0x7fc408108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/682352948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408101c30 0x7fc4081020b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/682352948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc408100a40 0x7fc408100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 -- 172.21.15.81:0/682352948 >> 172.21.15.81:0/682352948 conn(0x7fc4080fc1e0 msgr2=0x7fc4080fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 -- 172.21.15.81:0/682352948 shutdown_connections 2024-09-12T12:16:24.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.008+0000 7fc40cf6d640 1 -- 172.21.15.81:0/682352948 wait complete. 2024-09-12T12:16:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 Processor -- start 2024-09-12T12:16:24.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 -- start start 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 0x7fc408197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc408101c30 0x7fc408198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 0x7fc40819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc40810c820 con 0x7fc408100a40 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc40810c6a0 con 0x7fc4081025f0 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40cf6d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc40810c9a0 con 0x7fc408101c30 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 0x7fc408197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 0x7fc408197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54152/0 (socket says 172.21.15.81:54152) 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc40659c640 1 -- 172.21.15.81:0/1220237872 learned_addr learned my addr 172.21.15.81:0/1220237872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc406d9d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 0x7fc40819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.009+0000 7fc405d9b640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc408101c30 0x7fc408198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40659c640 1 -- 172.21.15.81:0/1220237872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc408101c30 msgr2=0x7fc408198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40659c640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc408101c30 0x7fc408198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40659c640 1 -- 172.21.15.81:0/1220237872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 msgr2=0x7fc40819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40659c640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 0x7fc40819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40659c640 1 -- 172.21.15.81:0/1220237872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40819fa70 con 0x7fc408100a40 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc406d9d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 0x7fc40819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40659c640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 0x7fc408197e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800d950 tx=0x7fc3f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8017020 con 0x7fc408100a40 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc3f8009c30 con 0x7fc408100a40 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40819fd60 con 0x7fc408100a40 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800f7b0 con 0x7fc408100a40 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.010+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4081a01d0 con 0x7fc408100a40 2024-09-12T12:16:24.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.011+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4081a0460 con 0x7fc408100a40 2024-09-12T12:16:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.012+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fc3f801a020 con 0x7fc408100a40 2024-09-12T12:16:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.013+0000 7fc3f77fe640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 0x7fc3f00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.013+0000 7fc405d9b640 1 -- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 msgr2=0x7fc3f00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.013+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fc3f80cf290 con 0x7fc408100a40 2024-09-12T12:16:24.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.013+0000 7fc405d9b640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 0x7fc3f00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:24.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.016+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3f8021020 con 0x7fc408100a40 2024-09-12T12:16:24.091 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:23.864+0000 7f4efc94c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T12:16:24.091 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:23.932+0000 7f4efc94c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T12:16:24.091 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.090+0000 7f4efc94c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T12:16:24.205 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.923+0000 7ffa3f156040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:24.205 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:23.982+0000 7ffa3f156040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:24.205 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:24.140+0000 7ffa3f156040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:24.205 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:24.204+0000 7ffa3f156040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.214+0000 7fc405d9b640 1 -- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 msgr2=0x7fc3f00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.214+0000 7fc405d9b640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 0x7fc3f00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:24.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.226+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fc4081a0630 con 0x7fc408100a40 2024-09-12T12:16:24.247 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:23.964+0000 7f9d56103040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:24.247 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.024+0000 7f9d56103040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:24.247 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.182+0000 7f9d56103040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:24.247 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.247+0000 7f9d56103040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:24.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.278+0000 7fc3f77fe640 1 -- 172.21.15.81:0/1220237872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7fc3f8009de0 con 0x7fc408100a40 2024-09-12T12:16:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 msgr2=0x7fc3f00a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 0x7fc3f00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 msgr2=0x7fc408197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 0x7fc408197e50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800d950 tx=0x7fc3f800de10 comp rx=0 tx=0).stop 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 shutdown_connections 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fc3f00a2c80 0x7fc3f00a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4081025f0 0x7fc40819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc408101c30 0x7fc408198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 --2- 172.21.15.81:0/1220237872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc408100a40 0x7fc408197e50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 >> 172.21.15.81:0/1220237872 conn(0x7fc4080fc1e0 msgr2=0x7fc4080fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 shutdown_connections 2024-09-12T12:16:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.280+0000 7fc40cf6d640 1 -- 172.21.15.81:0/1220237872 wait complete. 2024-09-12T12:16:24.293 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T12:16:24.307 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T12:16:24.320 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T12:16:24.321 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:16:24.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T12:16:24.342 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1220237872' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:16:24.343 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.161+0000 7f4efc94c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T12:16:24.343 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.223+0000 7f4efc94c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T12:16:24.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 -- 172.21.15.81:0/604426097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74101c30 msgr2=0x7fca741020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/604426097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74101c30 0x7fca741020b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca64009900 tx=0x7fca6402a410 comp rx=0 tx=0).stop 2024-09-12T12:16:24.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 -- 172.21.15.81:0/604426097 shutdown_connections 2024-09-12T12:16:24.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/604426097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca741025f0 0x7fca74108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/604426097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74101c30 0x7fca741020b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/604426097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca74100a40 0x7fca74100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 -- 172.21.15.81:0/604426097 >> 172.21.15.81:0/604426097 conn(0x7fca740fc1e0 msgr2=0x7fca740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 -- 172.21.15.81:0/604426097 shutdown_connections 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 -- 172.21.15.81:0/604426097 wait complete. 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.424+0000 7fca7c7e4640 1 Processor -- start 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 -- start start 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 0x7fca74196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca74101c30 0x7fca741972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca741025f0 0x7fca7419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca7410c820 con 0x7fca74100a40 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca7410c6a0 con 0x7fca741025f0 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7c7e4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca7410c9a0 con 0x7fca74101c30 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7a580640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 0x7fca74196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7a580640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 0x7fca74196d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54162/0 (socket says 172.21.15.81:54162) 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7a580640 1 -- 172.21.15.81:0/4222647582 learned_addr learned my addr 172.21.15.81:0/4222647582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca79d7f640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca74101c30 0x7fca741972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca741025f0 0x7fca7419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 -- 172.21.15.81:0/4222647582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca74101c30 msgr2=0x7fca741972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca74101c30 0x7fca741972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 -- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 msgr2=0x7fca74196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 0x7fca74196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 -- 172.21.15.81:0/4222647582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7419e990 con 0x7fca741025f0 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7a580640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 0x7fca74196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.425+0000 7fca7ad81640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca741025f0 0x7fca7419e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009fd0 tx=0x7fca6c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.426+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00ce20 con 0x7fca741025f0 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.426+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca6c004b20 con 0x7fca741025f0 2024-09-12T12:16:24.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.426+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7419ec80 con 0x7fca741025f0 2024-09-12T12:16:24.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.426+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c010790 con 0x7fca741025f0 2024-09-12T12:16:24.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.426+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7419f1a0 con 0x7fca741025f0 2024-09-12T12:16:24.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.427+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca74107d60 con 0x7fca741025f0 2024-09-12T12:16:24.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.428+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fca6c005020 con 0x7fca741025f0 2024-09-12T12:16:24.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.428+0000 7fca6b7fe640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca600a2c80 0x7fca600a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.428+0000 7fca7a580640 1 -- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca600a2c80 msgr2=0x7fca600a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:24.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.428+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fca6c0cf8a0 con 0x7fca741025f0 2024-09-12T12:16:24.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.428+0000 7fca7a580640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca600a2c80 0x7fca600a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.432+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca6c09c800 con 0x7fca741025f0 2024-09-12T12:16:24.476 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1220237872' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:16:24.476 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:24.271+0000 7ffa3f156040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:24.476 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:24.354+0000 7ffa3f156040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:24.476 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:24.415+0000 7ffa3f156040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:24.477 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:24.475+0000 7ffa3f156040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:24.521 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1220237872' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T12:16:24.521 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.316+0000 7f9d56103040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:24.521 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.399+0000 7f9d56103040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:24.521 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.461+0000 7f9d56103040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:24.521 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:24.521+0000 7f9d56103040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:24.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.606+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fca7402d7c0 con 0x7fca741025f0 2024-09-12T12:16:24.609 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.390+0000 7f4efc94c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T12:16:24.609 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.460+0000 7f4efc94c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T12:16:24.610 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.530+0000 7f4efc94c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T12:16:24.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.613+0000 7fca6b7fe640 1 -- 172.21.15.81:0/4222647582 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7fca6c09c100 con 0x7fca741025f0 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca600a2c80 msgr2=0x7fca600a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca600a2c80 0x7fca600a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca741025f0 msgr2=0x7fca7419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca741025f0 0x7fca7419e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009fd0 tx=0x7fca6c00ef10 comp rx=0 tx=0).stop 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 shutdown_connections 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fca600a2c80 0x7fca600a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca741025f0 0x7fca7419e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca74101c30 0x7fca741972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 --2- 172.21.15.81:0/4222647582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca74100a40 0x7fca74196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.615+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 >> 172.21.15.81:0/4222647582 conn(0x7fca740fc1e0 msgr2=0x7fca74104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.616+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 shutdown_connections 2024-09-12T12:16:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.616+0000 7fca7c7e4640 1 -- 172.21.15.81:0/4222647582 wait complete. 2024-09-12T12:16:24.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 -- 172.21.15.81:0/3755654880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e41025c0 msgr2=0x7f86e41049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 --2- 172.21.15.81:0/3755654880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e41025c0 0x7f86e41049b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009900 tx=0x7f86d402a410 comp rx=0 tx=0).stop 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 -- 172.21.15.81:0/3755654880 shutdown_connections 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 --2- 172.21.15.81:0/3755654880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4107820 0x7f86e4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 --2- 172.21.15.81:0/3755654880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 0x7f86e41072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 --2- 172.21.15.81:0/3755654880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e41025c0 0x7f86e41049b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 -- 172.21.15.81:0/3755654880 >> 172.21.15.81:0/3755654880 conn(0x7f86e40fc1e0 msgr2=0x7f86e40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 -- 172.21.15.81:0/3755654880 shutdown_connections 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.770+0000 7f86e9e65640 1 -- 172.21.15.81:0/3755654880 wait complete. 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 Processor -- start 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 -- start start 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 0x7f86e4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 0x7f86e4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e4107820 0x7f86e419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86e410d950 con 0x7f86e4107820 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f86e410d7d0 con 0x7f86e41025c0 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.771+0000 7f86e9e65640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86e410dad0 con 0x7f86e4104ef0 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e4107820 0x7f86e419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 0x7f86e4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 0x7f86e4197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:54894/0 (socket says 172.21.15.81:54894) 2024-09-12T12:16:24.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 -- 172.21.15.81:0/1215612537 learned_addr learned my addr 172.21.15.81:0/1215612537 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e4107820 0x7f86e419f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54188/0 (socket says 172.21.15.81:54188) 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e2ffd640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 0x7f86e4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 -- 172.21.15.81:0/1215612537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 msgr2=0x7f86e4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 0x7f86e4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 -- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e4107820 msgr2=0x7f86e419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e4107820 0x7f86e419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 -- 172.21.15.81:0/1215612537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e419fb40 con 0x7f86e41025c0 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e2ffd640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 0x7f86e4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e37fe640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 0x7f86e4197f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009a20 tx=0x7f86d40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d403f030 con 0x7f86e41025c0 2024-09-12T12:16:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e419fdd0 con 0x7f86e41025c0 2024-09-12T12:16:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86d4003d00 con 0x7f86e41025c0 2024-09-12T12:16:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4035070 con 0x7f86e41025c0 2024-09-12T12:16:24.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.772+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e41a0200 con 0x7f86e41025c0 2024-09-12T12:16:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.773+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e40fdcd0 con 0x7f86e41025c0 2024-09-12T12:16:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.774+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f86d4042030 con 0x7f86e41025c0 2024-09-12T12:16:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.775+0000 7f86e0ff9640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f86cc0a2c80 0x7f86cc0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.775+0000 7f86e2ffd640 1 -- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f86cc0a2c80 msgr2=0x7f86cc0a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.775+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7f86d40ef700 con 0x7f86e41025c0 2024-09-12T12:16:24.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.775+0000 7f86e2ffd640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f86cc0a2c80 0x7f86cc0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:24.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.778+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86d40bc660 con 0x7f86e41025c0 2024-09-12T12:16:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.950+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f86e402d7c0 con 0x7f86e41025c0 2024-09-12T12:16:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.957+0000 7f86e0ff9640 1 -- 172.21.15.81:0/1215612537 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f86d40bbf60 con 0x7f86e41025c0 2024-09-12T12:16:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f86cc0a2c80 msgr2=0x7f86cc0a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f86cc0a2c80 0x7f86cc0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 msgr2=0x7f86e4197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 0x7f86e4197f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009a20 tx=0x7f86d40042f0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 shutdown_connections 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7f86cc0a2c80 0x7f86cc0a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86e4107820 0x7f86e419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86e4104ef0 0x7f86e4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 --2- 172.21.15.81:0/1215612537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e41025c0 0x7f86e4197f20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 >> 172.21.15.81:0/1215612537 conn(0x7f86e40fc1e0 msgr2=0x7f86e4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 shutdown_connections 2024-09-12T12:16:24.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:24.960+0000 7f86e9e65640 1 -- 172.21.15.81:0/1215612537 wait complete. 2024-09-12T12:16:24.970 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.616+0000 7f4efc94c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T12:16:24.970 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.678+0000 7f4efc94c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T12:16:24.970 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:24.741+0000 7f4efc94c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T12:16:24.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T12:16:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 -- 172.21.15.81:0/3032867680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40100c70 msgr2=0x7fcd401010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 --2- 172.21.15.81:0/3032867680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40100c70 0x7fcd401010f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009900 tx=0x7fcd3402a480 comp rx=0 tx=0).stop 2024-09-12T12:16:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 -- 172.21.15.81:0/3032867680 shutdown_connections 2024-09-12T12:16:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 --2- 172.21.15.81:0/3032867680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd40101630 0x7fcd40108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 --2- 172.21.15.81:0/3032867680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40100c70 0x7fcd401010f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 --2- 172.21.15.81:0/3032867680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd40102020 0x7fcd40102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 -- 172.21.15.81:0/3032867680 >> 172.21.15.81:0/3032867680 conn(0x7fcd400fb930 msgr2=0x7fcd400fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 -- 172.21.15.81:0/3032867680 shutdown_connections 2024-09-12T12:16:25.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.071+0000 7fcd45d18640 1 -- 172.21.15.81:0/3032867680 wait complete. 2024-09-12T12:16:25.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 Processor -- start 2024-09-12T12:16:25.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 -- start start 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd40100c70 0x7fcd40196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 0x7fcd40197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd40102020 0x7fcd4019e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4010c830 con 0x7fcd40101630 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.072+0000 7fcd45d18640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4010c6b0 con 0x7fcd40102020 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd45d18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4010c9b0 con 0x7fcd40100c70 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 0x7fcd40197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 0x7fcd40197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54198/0 (socket says 172.21.15.81:54198) 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 -- 172.21.15.81:0/2072857973 learned_addr learned my addr 172.21.15.81:0/2072857973 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3f7fe640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd40100c70 0x7fcd40196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3ffff640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd40102020 0x7fcd4019e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 -- 172.21.15.81:0/2072857973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd40100c70 msgr2=0x7fcd40196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd40100c70 0x7fcd40196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 -- 172.21.15.81:0/2072857973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd40102020 msgr2=0x7fcd4019e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd40102020 0x7fcd4019e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 -- 172.21.15.81:0/2072857973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4019e9d0 con 0x7fcd40101630 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3effd640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 0x7fcd40197300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009a20 tx=0x7fcd34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3403f030 con 0x7fcd40101630 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcd34003d00 con 0x7fcd40101630 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4019ec60 con 0x7fcd40101630 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34035070 con 0x7fcd40101630 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.073+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4019f150 con 0x7fcd40101630 2024-09-12T12:16:25.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.074+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd40107db0 con 0x7fcd40101630 2024-09-12T12:16:25.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.076+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fcd34042030 con 0x7fcd40101630 2024-09-12T12:16:25.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.077+0000 7fcd3cff9640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcd280a2c80 0x7fcd280a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.077+0000 7fcd3f7fe640 1 -- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcd280a2c80 msgr2=0x7fcd280a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:25.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.077+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fcd340efb50 con 0x7fcd40101630 2024-09-12T12:16:25.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.077+0000 7fcd3f7fe640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcd280a2c80 0x7fcd280a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:25.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.080+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd340bc460 con 0x7fcd40101630 2024-09-12T12:16:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.247+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fcd40062e90 con 0x7fcd40101630 2024-09-12T12:16:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.251+0000 7fcd3cff9640 1 -- 172.21.15.81:0/2072857973 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7fcd340c0760 con 0x7fcd40101630 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcd280a2c80 msgr2=0x7fcd280a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcd280a2c80 0x7fcd280a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 msgr2=0x7fcd40197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 0x7fcd40197300 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009a20 tx=0x7fcd34004270 comp rx=0 tx=0).stop 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 shutdown_connections 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fcd280a2c80 0x7fcd280a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd40102020 0x7fcd4019e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd40101630 0x7fcd40197300 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 --2- 172.21.15.81:0/2072857973 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd40100c70 0x7fcd40196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.253+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 >> 172.21.15.81:0/2072857973 conn(0x7fcd400fb930 msgr2=0x7fcd40104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.254+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 shutdown_connections 2024-09-12T12:16:25.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.254+0000 7fcd45d18640 1 -- 172.21.15.81:0/2072857973 wait complete. 2024-09-12T12:16:25.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.369+0000 7fd11ccd0640 1 -- 172.21.15.81:0/337538849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 msgr2=0x7fd1181020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.369+0000 7fd11ccd0640 1 --2- 172.21.15.81:0/337538849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd1181020b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009860 tx=0x7fd10c02a340 comp rx=0 tx=0).stop 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 -- 172.21.15.81:0/337538849 shutdown_connections 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 --2- 172.21.15.81:0/337538849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1181025f0 0x7fd118108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 --2- 172.21.15.81:0/337538849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd1181020b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 --2- 172.21.15.81:0/337538849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd118100a40 0x7fd118100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 -- 172.21.15.81:0/337538849 >> 172.21.15.81:0/337538849 conn(0x7fd1180fc1e0 msgr2=0x7fd1180fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:25.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 -- 172.21.15.81:0/337538849 shutdown_connections 2024-09-12T12:16:25.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 -- 172.21.15.81:0/337538849 wait complete. 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 Processor -- start 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.370+0000 7fd11ccd0640 1 -- start start 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118100a40 0x7fd11810b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd118109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1181025f0 0x7fd118109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd11810d920 con 0x7fd118100a40 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd11810d7a0 con 0x7fd1181025f0 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd11810daa0 con 0x7fd118101c30 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd118109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118100a40 0x7fd11810b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd118109a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.81:44114/0 (socket says 172.21.15.81:44114) 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 -- 172.21.15.81:0/2568245383 learned_addr learned my addr 172.21.15.81:0/2568245383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd116d9d640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1181025f0 0x7fd118109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1181025f0 msgr2=0x7fd118109f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1181025f0 0x7fd118109f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118100a40 msgr2=0x7fd11810b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd118100a40 0x7fd11810b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 -- 172.21.15.81:0/2568245383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11810a7d0 con 0x7fd118101c30 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd115d9b640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd118109a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd10c005940 tx=0x7fd10c032670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c037050 con 0x7fd118101c30 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd10c043070 con 0x7fd118101c30 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1181a1f10 con 0x7fd118101c30 2024-09-12T12:16:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c003e50 con 0x7fd118101c30 2024-09-12T12:16:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.371+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1181a2380 con 0x7fd118101c30 2024-09-12T12:16:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.372+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd118107d60 con 0x7fd118101c30 2024-09-12T12:16:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.374+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fd10c0035f0 con 0x7fd118101c30 2024-09-12T12:16:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.374+0000 7fd1077fe640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 0x7fd1000a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.374+0000 7fd11659c640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 msgr2=0x7fd1000a5360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.374+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8153+0+0 (secure 0 0 0) 0x7fd10c0ef690 con 0x7fd118101c30 2024-09-12T12:16:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.374+0000 7fd11659c640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 0x7fd1000a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T12:16:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.377+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd10c04c020 con 0x7fd118101c30 2024-09-12T12:16:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.567+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 --> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fd118062630 con 0x7fd1000a2ea0 2024-09-12T12:16:25.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1220237872' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:16:25.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:16:25.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='client.? ' entity='client.admin' 2024-09-12T12:16:25.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='client.? ' entity='client.admin' 2024-09-12T12:16:25.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2072857973' entity='client.admin' 2024-09-12T12:16:25.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: Standby manager daemon z restarted 2024-09-12T12:16:25.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: Standby manager daemon z started 2024-09-12T12:16:25.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:16:25.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:25.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:16:25.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.575+0000 7fd11659c640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 msgr2=0x7fd1000a5360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4236049851 2024-09-12T12:16:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.575+0000 7fd11659c640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 0x7fd1000a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T12:16:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.581+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7fd10c0b8610 con 0x7fd118101c30 2024-09-12T12:16:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.581+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 msgr2=0x7fd1000a5360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T12:16:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:25.581+0000 7fd1077fe640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/4236049851,v1:172.21.15.81:6801/4236049851] conn(0x7fd1000a2ea0 0x7fd1000a5360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:25.653 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z[37126]: 2024-09-12T12:16:25.262+0000 7ffa3f156040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1220237872' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:16:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='client.? ' entity='client.admin' 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='client.? ' entity='client.admin' 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2072857973' entity='client.admin' 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: Standby manager daemon z restarted 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: Standby manager daemon z started 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:16:25.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:25 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:25.685 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y[36458]: 2024-09-12T12:16:25.317+0000 7f9d56103040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1220237872' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='client.? ' entity='client.admin' 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='client.? ' entity='client.admin' 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2072857973' entity='client.admin' 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: Standby manager daemon z restarted 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: Standby manager daemon z started 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:25.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T12:16:25.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:25 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.173:0/1730347381' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:25.850 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.568+0000 7f4efc94c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T12:16:25.850 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.803+0000 7f4e66a9e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.850 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.803+0000 7f4e66a9e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.803+0000 7f4e66a9e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.803+0000 7f4e66a9e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.803+0000 7f4e66a9e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.804+0000 7f4e64a9a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.804+0000 7f4e64a9a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.804+0000 7f4e64a9a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.851 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.804+0000 7f4e64a9a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:25.852 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:25.804+0000 7f4e64a9a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:16:26.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.586+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mon.1 v2:172.21.15.173:3300/0 8 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fd10c0ed210 con 0x7fd118101c30 2024-09-12T12:16:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.587+0000 7fd1077fe640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd100051950 0x7fd100051d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.587+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fd100041490 con 0x7fd100051950 2024-09-12T12:16:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.589+0000 7fd11659c640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd100051950 0x7fd100051d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.591+0000 7fd11659c640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd100051950 0x7fd100051d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd118101a90 tx=0x7fd108005f90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:26.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: Standby manager daemon y restarted 2024-09-12T12:16:26.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: Standby manager daemon y started 2024-09-12T12:16:26.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:16:26.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: Active manager daemon x restarted 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: Activating manager daemon x 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: mgrmap e20: x(active, starting, since 0.0120216s), standbys: z, y 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:16:26.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:16:26.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:16:26.613 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: Manager daemon x is now available 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:16:26.614 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:26 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:16:26.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: Standby manager daemon y restarted 2024-09-12T12:16:26.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: Standby manager daemon y started 2024-09-12T12:16:26.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:16:26.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: Active manager daemon x restarted 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: Activating manager daemon x 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: mgrmap e20: x(active, starting, since 0.0120216s), standbys: z, y 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:16:26.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:16:26.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:16:26.657 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:16:26.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:16:26.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: Manager daemon x is now available 2024-09-12T12:16:26.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:26.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:16:26.658 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:26 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:16:26.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.654+0000 7fd1077fe640 1 -- 172.21.15.81:0/2568245383 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd100041490 con 0x7fd100051950 2024-09-12T12:16:26.659 INFO:teuthology.orchestra.run.smithi081.stdout:Schedule set for path / 2024-09-12T12:16:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd100051950 msgr2=0x7fd100051d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd100051950 0x7fd100051d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd118101a90 tx=0x7fd108005f90 comp rx=0 tx=0).stop 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 msgr2=0x7fd118109a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 --2- 172.21.15.81:0/2568245383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd118101c30 0x7fd118109a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd10c005940 tx=0x7fd10c032670 comp rx=0 tx=0).stop 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd116d9d640 1 -- 172.21.15.81:0/2568245383 reap_dead start 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 shutdown_connections 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 >> 172.21.15.81:0/2568245383 conn(0x7fd1180fc1e0 msgr2=0x7fd118104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.656+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 shutdown_connections 2024-09-12T12:16:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.657+0000 7fd11ccd0640 1 -- 172.21.15.81:0/2568245383 wait complete. 2024-09-12T12:16:26.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: Standby manager daemon y restarted 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: Standby manager daemon y started 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.? 172.21.15.103:0/498896718' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: Active manager daemon x restarted 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: Activating manager daemon x 2024-09-12T12:16:26.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: mgrmap e20: x(active, starting, since 0.0120216s), standbys: z, y 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:16:26.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T12:16:26.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: Manager daemon x is now available 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T12:16:26.691 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:26 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T12:16:26.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 -- 172.21.15.81:0/1566064382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 msgr2=0x7f3a4c100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 --2- 172.21.15.81:0/1566064382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c100230 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c009900 tx=0x7f3a3c02a410 comp rx=0 tx=0).stop 2024-09-12T12:16:26.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 -- 172.21.15.81:0/1566064382 shutdown_connections 2024-09-12T12:16:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 --2- 172.21.15.81:0/1566064382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a4c103860 0x7f3a4c10a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 --2- 172.21.15.81:0/1566064382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a4c102ea0 0x7f3a4c103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 --2- 172.21.15.81:0/1566064382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c100230 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 -- 172.21.15.81:0/1566064382 >> 172.21.15.81:0/1566064382 conn(0x7f3a4c0fb970 msgr2=0x7f3a4c0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 -- 172.21.15.81:0/1566064382 shutdown_connections 2024-09-12T12:16:26.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.775+0000 7f3a51352640 1 -- 172.21.15.81:0/1566064382 wait complete. 2024-09-12T12:16:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 Processor -- start 2024-09-12T12:16:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 -- start start 2024-09-12T12:16:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a4c102ea0 0x7f3a4c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a4c103860 0x7f3a4c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c10d8f0 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c10d770 con 0x7f3a4c103860 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a51352640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c10da70 con 0x7f3a4c102ea0 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a4affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54336/0 (socket says 172.21.15.81:54336) 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a4affd640 1 -- 172.21.15.81:0/774814428 learned_addr learned my addr 172.21.15.81:0/774814428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a4b7fe640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a4c103860 0x7f3a4c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.776+0000 7f3a43fff640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a4c102ea0 0x7f3a4c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a4affd640 1 -- 172.21.15.81:0/774814428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a4c102ea0 msgr2=0x7f3a4c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a4affd640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a4c102ea0 0x7f3a4c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a4affd640 1 -- 172.21.15.81:0/774814428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a4c103860 msgr2=0x7f3a4c19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a4affd640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a4c103860 0x7f3a4c19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a4affd640 1 -- 172.21.15.81:0/774814428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c19fae0 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a4affd640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c197ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c005ab0 tx=0x7f3a3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:26.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c03f030 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4c19fd70 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a3c003d00 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c035070 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.777+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4c1a01f0 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.778+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4c108fd0 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.779+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f3a3c042030 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.780+0000 7f3a48ff9640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3a380a2a40 0x7f3a380a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:26.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.780+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f3a3c0ef250 con 0x7f3a4c0ffe30 2024-09-12T12:16:26.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.780+0000 7f3a43fff640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3a380a2a40 0x7f3a380a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:26.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.780+0000 7f3a43fff640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3a380a2a40 0x7f3a380a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c1993d0 tx=0x7f3a3400b390 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:26.784+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a3c0bbda0 con 0x7f3a4c0ffe30 2024-09-12T12:16:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.021+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f3a4c062790 con 0x7f3a380a2a40 2024-09-12T12:16:27.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.075+0000 7f3a48ff9640 1 -- 172.21.15.81:0/774814428 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f3a4c062790 con 0x7f3a380a2a40 2024-09-12T12:16:27.075 INFO:teuthology.orchestra.run.smithi081.stdout:Retention added to path / 2024-09-12T12:16:27.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3a380a2a40 msgr2=0x7f3a380a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3a380a2a40 0x7f3a380a4f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c1993d0 tx=0x7f3a3400b390 comp rx=0 tx=0).stop 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 msgr2=0x7f3a4c197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c197ec0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c005ab0 tx=0x7f3a3c0042f0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 shutdown_connections 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3a380a2a40 0x7f3a380a4f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a4c103860 0x7f3a4c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3a4c102ea0 0x7f3a4c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 --2- 172.21.15.81:0/774814428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c0ffe30 0x7f3a4c197ec0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 >> 172.21.15.81:0/774814428 conn(0x7f3a4c0fb970 msgr2=0x7f3a4c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 shutdown_connections 2024-09-12T12:16:27.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.077+0000 7f3a51352640 1 -- 172.21.15.81:0/774814428 wait complete. 2024-09-12T12:16:27.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T12:16:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 -- 172.21.15.81:0/168859378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c1025c0 msgr2=0x7ff81c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 --2- 172.21.15.81:0/168859378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c1025c0 0x7ff81c1049b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009900 tx=0x7ff80c02a410 comp rx=0 tx=0).stop 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 -- 172.21.15.81:0/168859378 shutdown_connections 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 --2- 172.21.15.81:0/168859378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff81c107820 0x7ff81c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 --2- 172.21.15.81:0/168859378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c104ef0 0x7ff81c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 --2- 172.21.15.81:0/168859378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c1025c0 0x7ff81c1049b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 -- 172.21.15.81:0/168859378 >> 172.21.15.81:0/168859378 conn(0x7ff81c0fc1e0 msgr2=0x7ff81c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 -- 172.21.15.81:0/168859378 shutdown_connections 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.191+0000 7ff821282640 1 -- 172.21.15.81:0/168859378 wait complete. 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 Processor -- start 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 -- start start 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff81c1025c0 0x7ff81c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 0x7ff81c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c107820 0x7ff81c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10d950 con 0x7ff81c104ef0 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10d7d0 con 0x7ff81c107820 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff821282640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c10dad0 con 0x7ff81c1025c0 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff81a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 0x7ff81c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff81a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 0x7ff81c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54356/0 (socket says 172.21.15.81:54356) 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff81a7fc640 1 -- 172.21.15.81:0/923644864 learned_addr learned my addr 172.21.15.81:0/923644864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff81b7fe640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c107820 0x7ff81c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.192+0000 7ff81affd640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff81c1025c0 0x7ff81c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81a7fc640 1 -- 172.21.15.81:0/923644864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff81c1025c0 msgr2=0x7ff81c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81a7fc640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff81c1025c0 0x7ff81c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81a7fc640 1 -- 172.21.15.81:0/923644864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c107820 msgr2=0x7ff81c19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81a7fc640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c107820 0x7ff81c19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81a7fc640 1 -- 172.21.15.81:0/923644864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c19fb10 con 0x7ff81c104ef0 2024-09-12T12:16:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81b7fe640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c107820 0x7ff81c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff81a7fc640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 0x7ff81c198430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e9a0 tx=0x7ff80400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80400cd80 con 0x7ff81c104ef0 2024-09-12T12:16:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff8040035f0 con 0x7ff81c104ef0 2024-09-12T12:16:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c19fe00 con 0x7ff81c104ef0 2024-09-12T12:16:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804010700 con 0x7ff81c104ef0 2024-09-12T12:16:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.193+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c1a0310 con 0x7ff81c104ef0 2024-09-12T12:16:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.194+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c0fdcd0 con 0x7ff81c104ef0 2024-09-12T12:16:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.195+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7ff8040037a0 con 0x7ff81c104ef0 2024-09-12T12:16:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.196+0000 7ff813fff640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff8080a2ac0 0x7ff8080a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.197+0000 7ff81affd640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff8080a2ac0 0x7ff8080a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.197+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7ff8040ceff0 con 0x7ff81c104ef0 2024-09-12T12:16:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.197+0000 7ff81affd640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff8080a2ac0 0x7ff8080a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff80c006010 tx=0x7ff80c031640 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.200+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff80409c220 con 0x7ff81c104ef0 2024-09-12T12:16:27.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.400+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7ff81c062630 con 0x7ff8080a2ac0 2024-09-12T12:16:27.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.407+0000 7ff813fff640 1 -- 172.21.15.81:0/923644864 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7ff81c062630 con 0x7ff8080a2ac0 2024-09-12T12:16:27.408 INFO:teuthology.orchestra.run.smithi081.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T12:16:26", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff8080a2ac0 msgr2=0x7ff8080a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff8080a2ac0 0x7ff8080a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff80c006010 tx=0x7ff80c031640 comp rx=0 tx=0).stop 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 msgr2=0x7ff81c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 0x7ff81c198430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff80400e9a0 tx=0x7ff80400ee60 comp rx=0 tx=0).stop 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 shutdown_connections 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff8080a2ac0 0x7ff8080a4f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff81c107820 0x7ff81c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81c104ef0 0x7ff81c198430 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 --2- 172.21.15.81:0/923644864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff81c1025c0 0x7ff81c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.410+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 >> 172.21.15.81:0/923644864 conn(0x7ff81c0fc1e0 msgr2=0x7ff81c102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.411+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 shutdown_connections 2024-09-12T12:16:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.411+0000 7ff821282640 1 -- 172.21.15.81:0/923644864 wait complete. 2024-09-12T12:16:27.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 -- 172.21.15.81:0/3593432523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28541025c0 msgr2=0x7f28541049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 --2- 172.21.15.81:0/3593432523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28541025c0 0x7f28541049b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2844009900 tx=0x7f284402a410 comp rx=0 tx=0).stop 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 -- 172.21.15.81:0/3593432523 shutdown_connections 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 --2- 172.21.15.81:0/3593432523 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854107820 0x7f2854109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 --2- 172.21.15.81:0/3593432523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2854104ef0 0x7f28541072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 --2- 172.21.15.81:0/3593432523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28541025c0 0x7f28541049b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 -- 172.21.15.81:0/3593432523 >> 172.21.15.81:0/3593432523 conn(0x7f28540fc1e0 msgr2=0x7f28540fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 -- 172.21.15.81:0/3593432523 shutdown_connections 2024-09-12T12:16:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.533+0000 7f285aa0e640 1 -- 172.21.15.81:0/3593432523 wait complete. 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 Processor -- start 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 -- start start 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28541025c0 0x7f2854101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854104ef0 0x7f2854100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2854107820 0x7f2854100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f285410d950 con 0x7f2854107820 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f285410d7d0 con 0x7f28541025c0 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f285aa0e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f285410dad0 con 0x7f2854104ef0 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f2858fab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2854107820 0x7f2854100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f28537fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854104ef0 0x7f2854100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f2858fab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2854107820 0x7f2854100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54364/0 (socket says 172.21.15.81:54364) 2024-09-12T12:16:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f2858fab640 1 -- 172.21.15.81:0/2706392643 learned_addr learned my addr 172.21.15.81:0/2706392643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.534+0000 7f2853fff640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28541025c0 0x7f2854101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28537fe640 1 -- 172.21.15.81:0/2706392643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28541025c0 msgr2=0x7f2854101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28537fe640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28541025c0 0x7f2854101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28537fe640 1 -- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2854107820 msgr2=0x7f2854100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28537fe640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2854107820 0x7f2854100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28537fe640 1 -- 172.21.15.81:0/2706392643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2854101340 con 0x7f2854104ef0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28537fe640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854104ef0 0x7f2854100570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f284800e9c0 tx=0x7f284800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284800cd80 con 0x7f2854104ef0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28541a1fc0 con 0x7f2854104ef0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f28480035f0 con 0x7f2854104ef0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28541a24d0 con 0x7f2854104ef0 2024-09-12T12:16:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.535+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848010670 con 0x7f2854104ef0 2024-09-12T12:16:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.537+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28541052d0 con 0x7f2854104ef0 2024-09-12T12:16:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.538+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f28480037a0 con 0x7f2854104ef0 2024-09-12T12:16:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.539+0000 7f28517fa640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f283c0a2ac0 0x7f283c0a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.539+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f28480cf090 con 0x7f2854104ef0 2024-09-12T12:16:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.539+0000 7f2853fff640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f283c0a2ac0 0x7f283c0a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.540+0000 7f2853fff640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f283c0a2ac0 0x7f283c0a4f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2844006010 tx=0x7f2844031640 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.543+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f284809c1f0 con 0x7f2854104ef0 2024-09-12T12:16:27.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.761+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2854062630 con 0x7f283c0a2ac0 2024-09-12T12:16:27.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.767+0000 7f28517fa640 1 -- 172.21.15.81:0/2706392643 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2854062630 con 0x7f283c0a2ac0 2024-09-12T12:16:27.768 INFO:teuthology.orchestra.run.smithi081.stdout:/ 1m 6m3h 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f283c0a2ac0 msgr2=0x7f283c0a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f283c0a2ac0 0x7f283c0a4f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2844006010 tx=0x7f2844031640 comp rx=0 tx=0).stop 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854104ef0 msgr2=0x7f2854100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854104ef0 0x7f2854100570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f284800e9c0 tx=0x7f284800ee80 comp rx=0 tx=0).stop 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 shutdown_connections 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f283c0a2ac0 0x7f283c0a4f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2854107820 0x7f2854100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2854104ef0 0x7f2854100570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 --2- 172.21.15.81:0/2706392643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28541025c0 0x7f2854101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 >> 172.21.15.81:0/2706392643 conn(0x7f28540fc1e0 msgr2=0x7f2854102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 shutdown_connections 2024-09-12T12:16:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:27.769+0000 7f285aa0e640 1 -- 172.21.15.81:0/2706392643 wait complete. 2024-09-12T12:16:27.779 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: mgrmap e21: x(active, since 1.01904s), standbys: z, y 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:16:27] ENGINE Bus STARTING 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:16:27] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:16:27] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: Traceback (most recent call last): 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._run(expiration_interval) 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:27.780 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: s = self.context.wrap_socket( 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: return self.sslsocket_class._create( 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: self.do_handshake() 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: self._sslobj.do_handshake() 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:16:27] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: [12/Sep/2024:12:16:27] ENGINE Bus STARTED 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.781 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:27.362+0000 7f4e501f7640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:12:16:27] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: Traceback (most recent call last): 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._connections.run(self.expiration_interval) 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._run(expiration_interval) 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:27.782 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: s = self.context.wrap_socket( 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: return self.sslsocket_class._create( 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self.do_handshake() 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: self._sslobj.do_handshake() 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:27.783 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:16:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:16:27.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T12:16:27.810 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T12:16:27.821 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-12T12:16:27.849 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:16:27.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-12T12:16:27.853 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-12T12:16:27.923 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T12:16:27.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: mgrmap e21: x(active, since 1.01904s), standbys: z, y 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: [12/Sep/2024:12:16:27] ENGINE Bus STARTING 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: [12/Sep/2024:12:16:27] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: [12/Sep/2024:12:16:27] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout: Traceback (most recent call last): 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:27.924 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._run(expiration_interval) 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: s = self.context.wrap_socket( 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: return self.sslsocket_class._create( 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: self.do_handshake() 2024-09-12T12:16:27.925 INFO:journalctl@ceph.mon.c.smithi173.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout: self._sslobj.do_handshake() 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: [12/Sep/2024:12:16:27] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: [12/Sep/2024:12:16:27] ENGINE Bus STARTED 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:27 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: mgrmap e21: x(active, since 1.01904s), standbys: z, y 2024-09-12T12:16:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: [12/Sep/2024:12:16:27] ENGINE Bus STARTING 2024-09-12T12:16:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: [12/Sep/2024:12:16:27] ENGINE Serving on https://172.21.15.81:7150 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: [12/Sep/2024:12:16:27] ENGINE Error in HTTPServer.serve 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: Traceback (most recent call last): 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: self._run(expiration_interval) 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T12:16:27.936 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: s = self.context.wrap_socket( 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: return self.sslsocket_class._create( 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: self.do_handshake() 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: self._sslobj.do_handshake() 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: [12/Sep/2024:12:16:27] ENGINE Serving on http://172.21.15.81:8765 2024-09-12T12:16:27.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: [12/Sep/2024:12:16:27] ENGINE Bus STARTED 2024-09-12T12:16:27.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:27.938 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:27 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.690+0000 7fdedbfd4640 1 -- 172.21.15.81:0/1578378099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded41009d0 msgr2=0x7fded4100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.690+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/1578378099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded41009d0 0x7fded4100db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fded0009900 tx=0x7fded002a410 comp rx=0 tx=0).stop 2024-09-12T12:16:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 -- 172.21.15.81:0/1578378099 shutdown_connections 2024-09-12T12:16:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/1578378099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fded410e4f0 0x7fded4110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/1578378099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4101380 0x7fded410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/1578378099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded41009d0 0x7fded4100db0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 -- 172.21.15.81:0/1578378099 >> 172.21.15.81:0/1578378099 conn(0x7fded40fc7d0 msgr2=0x7fded40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 -- 172.21.15.81:0/1578378099 shutdown_connections 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 -- 172.21.15.81:0/1578378099 wait complete. 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 Processor -- start 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.691+0000 7fdedbfd4640 1 -- start start 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdedbfd4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fded41009d0 0x7fded41a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdedbfd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4101380 0x7fded41a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdedbfd4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 0x7fded419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdedbfd4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fded41143d0 con 0x7fded410e4f0 2024-09-12T12:16:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdedbfd4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fded4114250 con 0x7fded4101380 2024-09-12T12:16:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdedbfd4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fded4114550 con 0x7fded41009d0 2024-09-12T12:16:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 0x7fded419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 0x7fded419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54406/0 (socket says 172.21.15.81:54406) 2024-09-12T12:16:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 -- 172.21.15.81:0/3139630852 learned_addr learned my addr 172.21.15.81:0/3139630852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fded956f640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4101380 0x7fded41a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fded9d70640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fded41009d0 0x7fded41a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 -- 172.21.15.81:0/3139630852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fded41009d0 msgr2=0x7fded41a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fded41009d0 0x7fded41a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 -- 172.21.15.81:0/3139630852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4101380 msgr2=0x7fded41a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4101380 0x7fded41a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 -- 172.21.15.81:0/3139630852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded419af30 con 0x7fded410e4f0 2024-09-12T12:16:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdeda571640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 0x7fded419a6c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00eb40 tx=0x7fdecc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc004b20 con 0x7fded410e4f0 2024-09-12T12:16:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.692+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdecc004cc0 con 0x7fded410e4f0 2024-09-12T12:16:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.693+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded419b220 con 0x7fded410e4f0 2024-09-12T12:16:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.693+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0108f0 con 0x7fded410e4f0 2024-09-12T12:16:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.693+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded41a73a0 con 0x7fded410e4f0 2024-09-12T12:16:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.694+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded406a7d0 con 0x7fded410e4f0 2024-09-12T12:16:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.695+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7fdecc005020 con 0x7fded410e4f0 2024-09-12T12:16:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.695+0000 7fdecaffd640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdec00a2cf0 0x7fdec00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.695+0000 7fded9d70640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdec00a2cf0 0x7fdec00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.695+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fdecc0cfb00 con 0x7fded410e4f0 2024-09-12T12:16:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.696+0000 7fded9d70640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdec00a2cf0 0x7fdec00a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fded0000c00 tx=0x7fded0005e80 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.700+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdecc09c790 con 0x7fded410e4f0 2024-09-12T12:16:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:16:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='client.24841 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:28.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Unable to set osd_memory_target on smithi103 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Unable to set osd_memory_target on smithi081 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:28.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:16:28.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:16:28.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:16:28.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:28 smithi081 ceph-mon[30948]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-09-12T12:16:28.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.872+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fded410f7b0 con 0x7fdec00a2cf0 2024-09-12T12:16:28.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.879+0000 7fdecaffd640 1 -- 172.21.15.81:0/3139630852 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257824 (secure 0 0 0) 0x7fded410f7b0 con 0x7fdec00a2cf0 2024-09-12T12:16:28.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:16:28.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdec00a2cf0 msgr2=0x7fdec00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdec00a2cf0 0x7fdec00a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fded0000c00 tx=0x7fded0005e80 comp rx=0 tx=0).stop 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 msgr2=0x7fded419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 0x7fded419a6c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00eb40 tx=0x7fdecc00c2d0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 shutdown_connections 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdec00a2cf0 0x7fdec00a51b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fded410e4f0 0x7fded419a6c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fded4101380 0x7fded41a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 --2- 172.21.15.81:0/3139630852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fded41009d0 0x7fded41a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 >> 172.21.15.81:0/3139630852 conn(0x7fded40fc7d0 msgr2=0x7fded40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 shutdown_connections 2024-09-12T12:16:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:28.882+0000 7fdedbfd4640 1 -- 172.21.15.81:0/3139630852 wait complete. 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='client.24841 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-12T12:16:29.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Unable to set osd_memory_target on smithi103 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Unable to set osd_memory_target on smithi081 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:16:29.156 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:28 smithi173 ceph-mon[35326]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-09-12T12:16:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='client.24841 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Unable to set osd_memory_target on smithi103 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.187 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Unable to set osd_memory_target on smithi081 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Updating smithi081:/etc/ceph/ceph.conf 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: Updating smithi173:/etc/ceph/ceph.conf 2024-09-12T12:16:29.188 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:28 smithi103 ceph-mon[35094]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-09-12T12:16:29.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-09-12T12:16:27.587683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191661,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1277,"num_read_kb":807,"num_write":560,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":942,"ondisk_log_size":942,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367112,"kb_used_data":13680,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574712,"statfs":{"total":1151940427776,"available":1151564505088,"internally_reserved":0,"allocated":14008320,"data_stored":8324220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.990233"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576604+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:16:25.576604+0000","last_peered":"2024-09-12T12:16:25.576604+0000","last_clean":"2024-09-12T12:16:25.576604+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:16:25.576604+0000","last_undegraded":"2024-09-12T12:16:25.576604+0000","last_fullsized":"2024-09-12T12:16:25.576604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814045+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:16:25.814045+0000","last_peered":"2024-09-12T12:16:25.814045+0000","last_clean":"2024-09-12T12:16:25.814045+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:16:25.814045+0000","last_undegraded":"2024-09-12T12:16:25.814045+0000","last_fullsized":"2024-09-12T12:16:25.814045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813839+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:16:25.813839+0000","last_peered":"2024-09-12T12:16:25.813839+0000","last_clean":"2024-09-12T12:16:25.813839+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:16:25.813839+0000","last_undegraded":"2024-09-12T12:16:25.813839+0000","last_fullsized":"2024-09-12T12:16:25.813839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651269+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:16:25.651269+0000","last_peered":"2024-09-12T12:16:25.651269+0000","last_clean":"2024-09-12T12:16:25.651269+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:16:25.651269+0000","last_undegraded":"2024-09-12T12:16:25.651269+0000","last_fullsized":"2024-09-12T12:16:25.651269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653470+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:16:25.653470+0000","last_peered":"2024-09-12T12:16:25.653470+0000","last_clean":"2024-09-12T12:16:25.653470+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:16:25.653470+0000","last_undegraded":"2024-09-12T12:16:25.653470+0000","last_fullsized":"2024-09-12T12:16:25.653470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578873+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:16:25.578873+0000","last_peered":"2024-09-12T12:16:25.578873+0000","last_clean":"2024-09-12T12:16:25.578873+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:16:25.578873+0000","last_undegraded":"2024-09-12T12:16:25.578873+0000","last_fullsized":"2024-09-12T12:16:25.578873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811861+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:16:25.811861+0000","last_peered":"2024-09-12T12:16:25.811861+0000","last_clean":"2024-09-12T12:16:25.811861+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:16:25.811861+0000","last_undegraded":"2024-09-12T12:16:25.811861+0000","last_fullsized":"2024-09-12T12:16:25.811861+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575366+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:16:25.575366+0000","last_peered":"2024-09-12T12:16:25.575366+0000","last_clean":"2024-09-12T12:16:25.575366+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:16:25.575366+0000","last_undegraded":"2024-09-12T12:16:25.575366+0000","last_fullsized":"2024-09-12T12:16:25.575366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811435+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:16:25.811435+0000","last_peered":"2024-09-12T12:16:25.811435+0000","last_clean":"2024-09-12T12:16:25.811435+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:16:25.811435+0000","last_undegraded":"2024-09-12T12:16:25.811435+0000","last_fullsized":"2024-09-12T12:16:25.811435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.579185+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:16:25.579185+0000","last_peered":"2024-09-12T12:16:25.579185+0000","last_clean":"2024-09-12T12:16:25.579185+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:16:25.579185+0000","last_undegraded":"2024-09-12T12:16:25.579185+0000","last_fullsized":"2024-09-12T12:16:25.579185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811577+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:16:25.811577+0000","last_peered":"2024-09-12T12:16:25.811577+0000","last_clean":"2024-09-12T12:16:25.811577+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:16:25.811577+0000","last_undegraded":"2024-09-12T12:16:25.811577+0000","last_fullsized":"2024-09-12T12:16:25.811577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813715+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:16:25.813715+0000","last_peered":"2024-09-12T12:16:25.813715+0000","last_clean":"2024-09-12T12:16:25.813715+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:16:25.813715+0000","last_undegraded":"2024-09-12T12:16:25.813715+0000","last_fullsized":"2024-09-12T12:16:25.813715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815228+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:16:25.815228+0000","last_peered":"2024-09-12T12:16:25.815228+0000","last_clean":"2024-09-12T12:16:25.815228+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:16:25.815228+0000","last_undegraded":"2024-09-12T12:16:25.815228+0000","last_fullsized":"2024-09-12T12:16:25.815228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814214+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:16:25.814214+0000","last_peered":"2024-09-12T12:16:25.814214+0000","last_clean":"2024-09-12T12:16:25.814214+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:16:25.814214+0000","last_undegraded":"2024-09-12T12:16:25.814214+0000","last_fullsized":"2024-09-12T12:16:25.814214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813620+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:16:25.813620+0000","last_peered":"2024-09-12T12:16:25.813620+0000","last_clean":"2024-09-12T12:16:25.813620+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:16:25.813620+0000","last_undegraded":"2024-09-12T12:16:25.813620+0000","last_fullsized":"2024-09-12T12:16:25.813620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811068+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:16:25.811068+0000","last_peered":"2024-09-12T12:16:25.811068+0000","last_clean":"2024-09-12T12:16:25.811068+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:16:25.811068+0000","last_undegraded":"2024-09-12T12:16:25.811068+0000","last_fullsized":"2024-09-12T12:16:25.811068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576664+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:16:25.576664+0000","last_peered":"2024-09-12T12:16:25.576664+0000","last_clean":"2024-09-12T12:16:25.576664+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:16:25.576664+0000","last_undegraded":"2024-09-12T12:16:25.576664+0000","last_fullsized":"2024-09-12T12:16:25.576664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651680+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:16:25.651680+0000","last_peered":"2024-09-12T12:16:25.651680+0000","last_clean":"2024-09-12T12:16:25.651680+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:16:25.651680+0000","last_undegraded":"2024-09-12T12:16:25.651680+0000","last_fullsized":"2024-09-12T12:16:25.651680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811279+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:16:25.811279+0000","last_peered":"2024-09-12T12:16:25.811279+0000","last_clean":"2024-09-12T12:16:25.811279+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:16:25.811279+0000","last_undegraded":"2024-09-12T12:16:25.811279+0000","last_fullsized":"2024-09-12T12:16:25.811279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576325+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:16:25.576325+0000","last_peered":"2024-09-12T12:16:25.576325+0000","last_clean":"2024-09-12T12:16:25.576325+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:16:25.576325+0000","last_undegraded":"2024-09-12T12:16:25.576325+0000","last_fullsized":"2024-09-12T12:16:25.576325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815351+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:16:25.815351+0000","last_peered":"2024-09-12T12:16:25.815351+0000","last_clean":"2024-09-12T12:16:25.815351+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:16:25.815351+0000","last_undegraded":"2024-09-12T12:16:25.815351+0000","last_fullsized":"2024-09-12T12:16:25.815351+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811331+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:16:25.811331+0000","last_peered":"2024-09-12T12:16:25.811331+0000","last_clean":"2024-09-12T12:16:25.811331+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:16:25.811331+0000","last_undegraded":"2024-09-12T12:16:25.811331+0000","last_fullsized":"2024-09-12T12:16:25.811331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575408+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:16:25.575408+0000","last_peered":"2024-09-12T12:16:25.575408+0000","last_clean":"2024-09-12T12:16:25.575408+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:16:25.575408+0000","last_undegraded":"2024-09-12T12:16:25.575408+0000","last_fullsized":"2024-09-12T12:16:25.575408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659608+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:16:25.659608+0000","last_peered":"2024-09-12T12:16:25.659608+0000","last_clean":"2024-09-12T12:16:25.659608+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:16:25.659608+0000","last_undegraded":"2024-09-12T12:16:25.659608+0000","last_fullsized":"2024-09-12T12:16:25.659608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575682+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:16:25.575682+0000","last_peered":"2024-09-12T12:16:25.575682+0000","last_clean":"2024-09-12T12:16:25.575682+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:16:25.575682+0000","last_undegraded":"2024-09-12T12:16:25.575682+0000","last_fullsized":"2024-09-12T12:16:25.575682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811600+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:16:25.811600+0000","last_peered":"2024-09-12T12:16:25.811600+0000","last_clean":"2024-09-12T12:16:25.811600+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:16:25.811600+0000","last_undegraded":"2024-09-12T12:16:25.811600+0000","last_fullsized":"2024-09-12T12:16:25.811600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576614+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:16:25.576614+0000","last_peered":"2024-09-12T12:16:25.576614+0000","last_clean":"2024-09-12T12:16:25.576614+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:16:25.576614+0000","last_undegraded":"2024-09-12T12:16:25.576614+0000","last_fullsized":"2024-09-12T12:16:25.576614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815419+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:16:25.815419+0000","last_peered":"2024-09-12T12:16:25.815419+0000","last_clean":"2024-09-12T12:16:25.815419+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:16:25.815419+0000","last_undegraded":"2024-09-12T12:16:25.815419+0000","last_fullsized":"2024-09-12T12:16:25.815419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813962+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:16:25.813962+0000","last_peered":"2024-09-12T12:16:25.813962+0000","last_clean":"2024-09-12T12:16:25.813962+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:16:25.813962+0000","last_undegraded":"2024-09-12T12:16:25.813962+0000","last_fullsized":"2024-09-12T12:16:25.813962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811101+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:16:25.811101+0000","last_peered":"2024-09-12T12:16:25.811101+0000","last_clean":"2024-09-12T12:16:25.811101+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:16:25.811101+0000","last_undegraded":"2024-09-12T12:16:25.811101+0000","last_fullsized":"2024-09-12T12:16:25.811101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811135+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:16:25.811135+0000","last_peered":"2024-09-12T12:16:25.811135+0000","last_clean":"2024-09-12T12:16:25.811135+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:16:25.811135+0000","last_undegraded":"2024-09-12T12:16:25.811135+0000","last_fullsized":"2024-09-12T12:16:25.811135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576241+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:16:25.576241+0000","last_peered":"2024-09-12T12:16:25.576241+0000","last_clean":"2024-09-12T12:16:25.576241+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:16:25.576241+0000","last_undegraded":"2024-09-12T12:16:25.576241+0000","last_fullsized":"2024-09-12T12:16:25.576241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653424+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:16:25.653424+0000","last_peered":"2024-09-12T12:16:25.653424+0000","last_clean":"2024-09-12T12:16:25.653424+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:16:25.653424+0000","last_undegraded":"2024-09-12T12:16:25.653424+0000","last_fullsized":"2024-09-12T12:16:25.653424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370611+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:16:26.370611+0000","last_peered":"2024-09-12T12:16:26.370611+0000","last_clean":"2024-09-12T12:16:26.370611+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:16:26.370611+0000","last_undegraded":"2024-09-12T12:16:26.370611+0000","last_fullsized":"2024-09-12T12:16:26.370611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659712+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:16:25.659712+0000","last_peered":"2024-09-12T12:16:25.659712+0000","last_clean":"2024-09-12T12:16:25.659712+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:16:25.659712+0000","last_undegraded":"2024-09-12T12:16:25.659712+0000","last_fullsized":"2024-09-12T12:16:25.659712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578905+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:16:25.578905+0000","last_peered":"2024-09-12T12:16:25.578905+0000","last_clean":"2024-09-12T12:16:25.578905+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:16:25.578905+0000","last_undegraded":"2024-09-12T12:16:25.578905+0000","last_fullsized":"2024-09-12T12:16:25.578905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813971+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:16:25.813971+0000","last_peered":"2024-09-12T12:16:25.813971+0000","last_clean":"2024-09-12T12:16:25.813971+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:16:25.813971+0000","last_undegraded":"2024-09-12T12:16:25.813971+0000","last_fullsized":"2024-09-12T12:16:25.813971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575421+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:16:25.575421+0000","last_peered":"2024-09-12T12:16:25.575421+0000","last_clean":"2024-09-12T12:16:25.575421+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:16:25.575421+0000","last_undegraded":"2024-09-12T12:16:25.575421+0000","last_fullsized":"2024-09-12T12:16:25.575421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659898+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:16:25.659898+0000","last_peered":"2024-09-12T12:16:25.659898+0000","last_clean":"2024-09-12T12:16:25.659898+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:16:25.659898+0000","last_undegraded":"2024-09-12T12:16:25.659898+0000","last_fullsized":"2024-09-12T12:16:25.659898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651138+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:16:25.651138+0000","last_peered":"2024-09-12T12:16:25.651138+0000","last_clean":"2024-09-12T12:16:25.651138+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:16:25.651138+0000","last_undegraded":"2024-09-12T12:16:25.651138+0000","last_fullsized":"2024-09-12T12:16:25.651138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'6","reported_seq":230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370090+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:16:26.370090+0000","last_peered":"2024-09-12T12:16:26.370090+0000","last_clean":"2024-09-12T12:16:26.370090+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:16:26.370090+0000","last_undegraded":"2024-09-12T12:16:26.370090+0000","last_fullsized":"2024-09-12T12:16:26.370090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811788+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:16:25.811788+0000","last_peered":"2024-09-12T12:16:25.811788+0000","last_clean":"2024-09-12T12:16:25.811788+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:16:25.811788+0000","last_undegraded":"2024-09-12T12:16:25.811788+0000","last_fullsized":"2024-09-12T12:16:25.811788+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811700+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:16:25.811700+0000","last_peered":"2024-09-12T12:16:25.811700+0000","last_clean":"2024-09-12T12:16:25.811700+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:16:25.811700+0000","last_undegraded":"2024-09-12T12:16:25.811700+0000","last_fullsized":"2024-09-12T12:16:25.811700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814445+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:16:25.814445+0000","last_peered":"2024-09-12T12:16:25.814445+0000","last_clean":"2024-09-12T12:16:25.814445+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:16:25.814445+0000","last_undegraded":"2024-09-12T12:16:25.814445+0000","last_fullsized":"2024-09-12T12:16:25.814445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.660028+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:16:25.660028+0000","last_peered":"2024-09-12T12:16:25.660028+0000","last_clean":"2024-09-12T12:16:25.660028+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:16:25.660028+0000","last_undegraded":"2024-09-12T12:16:25.660028+0000","last_fullsized":"2024-09-12T12:16:25.660028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811631+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:16:25.811631+0000","last_peered":"2024-09-12T12:16:25.811631+0000","last_clean":"2024-09-12T12:16:25.811631+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:16:25.811631+0000","last_undegraded":"2024-09-12T12:16:25.811631+0000","last_fullsized":"2024-09-12T12:16:25.811631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'37","reported_seq":273,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370491+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:16:26.370491+0000","last_peered":"2024-09-12T12:16:26.370491+0000","last_clean":"2024-09-12T12:16:26.370491+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:16:26.370491+0000","last_undegraded":"2024-09-12T12:16:26.370491+0000","last_fullsized":"2024-09-12T12:16:26.370491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":172,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653791+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:16:25.653791+0000","last_peered":"2024-09-12T12:16:25.653791+0000","last_clean":"2024-09-12T12:16:25.653791+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:16:25.653791+0000","last_undegraded":"2024-09-12T12:16:25.653791+0000","last_fullsized":"2024-09-12T12:16:25.653791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811304+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:16:25.811304+0000","last_peered":"2024-09-12T12:16:25.811304+0000","last_clean":"2024-09-12T12:16:25.811304+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:16:25.811304+0000","last_undegraded":"2024-09-12T12:16:25.811304+0000","last_fullsized":"2024-09-12T12:16:25.811304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814822+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:16:25.814822+0000","last_peered":"2024-09-12T12:16:25.814822+0000","last_clean":"2024-09-12T12:16:25.814822+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:16:25.814822+0000","last_undegraded":"2024-09-12T12:16:25.814822+0000","last_fullsized":"2024-09-12T12:16:25.814822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659718+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:16:25.659718+0000","last_peered":"2024-09-12T12:16:25.659718+0000","last_clean":"2024-09-12T12:16:25.659718+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:16:25.659718+0000","last_undegraded":"2024-09-12T12:16:25.659718+0000","last_fullsized":"2024-09-12T12:16:25.659718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811513+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:16:25.811513+0000","last_peered":"2024-09-12T12:16:25.811513+0000","last_clean":"2024-09-12T12:16:25.811513+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:16:25.811513+0000","last_undegraded":"2024-09-12T12:16:25.811513+0000","last_fullsized":"2024-09-12T12:16:25.811513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.387044+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:16:26.387044+0000","last_peered":"2024-09-12T12:16:26.387044+0000","last_clean":"2024-09-12T12:16:26.387044+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:16:26.387044+0000","last_undegraded":"2024-09-12T12:16:26.387044+0000","last_fullsized":"2024-09-12T12:16:26.387044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811102+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:16:25.811102+0000","last_peered":"2024-09-12T12:16:25.811102+0000","last_clean":"2024-09-12T12:16:25.811102+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:16:25.811102+0000","last_undegraded":"2024-09-12T12:16:25.811102+0000","last_fullsized":"2024-09-12T12:16:25.811102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653405+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:16:25.653405+0000","last_peered":"2024-09-12T12:16:25.653405+0000","last_clean":"2024-09-12T12:16:25.653405+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:16:25.653405+0000","last_undegraded":"2024-09-12T12:16:25.653405+0000","last_fullsized":"2024-09-12T12:16:25.653405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659683+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:16:25.659683+0000","last_peered":"2024-09-12T12:16:25.659683+0000","last_clean":"2024-09-12T12:16:25.659683+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:16:25.659683+0000","last_undegraded":"2024-09-12T12:16:25.659683+0000","last_fullsized":"2024-09-12T12:16:25.659683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653711+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:16:25.653711+0000","last_peered":"2024-09-12T12:16:25.653711+0000","last_clean":"2024-09-12T12:16:25.653711+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:16:25.653711+0000","last_undegraded":"2024-09-12T12:16:25.653711+0000","last_fullsized":"2024-09-12T12:16:25.653711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576477+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:16:25.576477+0000","last_peered":"2024-09-12T12:16:25.576477+0000","last_clean":"2024-09-12T12:16:25.576477+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:16:25.576477+0000","last_undegraded":"2024-09-12T12:16:25.576477+0000","last_fullsized":"2024-09-12T12:16:25.576477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815235+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:16:25.815235+0000","last_peered":"2024-09-12T12:16:25.815235+0000","last_clean":"2024-09-12T12:16:25.815235+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:16:25.815235+0000","last_undegraded":"2024-09-12T12:16:25.815235+0000","last_fullsized":"2024-09-12T12:16:25.815235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811637+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:16:25.811637+0000","last_peered":"2024-09-12T12:16:25.811637+0000","last_clean":"2024-09-12T12:16:25.811637+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:16:25.811637+0000","last_undegraded":"2024-09-12T12:16:25.811637+0000","last_fullsized":"2024-09-12T12:16:25.811637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'41","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.766366+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:16:25.766366+0000","last_peered":"2024-09-12T12:16:25.766366+0000","last_clean":"2024-09-12T12:16:25.766366+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:16:25.766366+0000","last_undegraded":"2024-09-12T12:16:25.766366+0000","last_fullsized":"2024-09-12T12:16:25.766366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811859+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:16:25.811859+0000","last_peered":"2024-09-12T12:16:25.811859+0000","last_clean":"2024-09-12T12:16:25.811859+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:16:25.811859+0000","last_undegraded":"2024-09-12T12:16:25.811859+0000","last_fullsized":"2024-09-12T12:16:25.811859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.395287+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:16:26.395287+0000","last_peered":"2024-09-12T12:16:26.395287+0000","last_clean":"2024-09-12T12:16:26.395287+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:16:26.395287+0000","last_undegraded":"2024-09-12T12:16:26.395287+0000","last_fullsized":"2024-09-12T12:16:26.395287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811703+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:16:25.811703+0000","last_peered":"2024-09-12T12:16:25.811703+0000","last_clean":"2024-09-12T12:16:25.811703+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:16:25.811703+0000","last_undegraded":"2024-09-12T12:16:25.811703+0000","last_fullsized":"2024-09-12T12:16:25.811703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811434+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:16:25.811434+0000","last_peered":"2024-09-12T12:16:25.811434+0000","last_clean":"2024-09-12T12:16:25.811434+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:16:25.811434+0000","last_undegraded":"2024-09-12T12:16:25.811434+0000","last_fullsized":"2024-09-12T12:16:25.811434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813491+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:16:25.813491+0000","last_peered":"2024-09-12T12:16:25.813491+0000","last_clean":"2024-09-12T12:16:25.813491+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:16:25.813491+0000","last_undegraded":"2024-09-12T12:16:25.813491+0000","last_fullsized":"2024-09-12T12:16:25.813491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651199+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:16:25.651199+0000","last_peered":"2024-09-12T12:16:25.651199+0000","last_clean":"2024-09-12T12:16:25.651199+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:16:25.651199+0000","last_undegraded":"2024-09-12T12:16:25.651199+0000","last_fullsized":"2024-09-12T12:16:25.651199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811305+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:16:25.811305+0000","last_peered":"2024-09-12T12:16:25.811305+0000","last_clean":"2024-09-12T12:16:25.811305+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:16:25.811305+0000","last_undegraded":"2024-09-12T12:16:25.811305+0000","last_fullsized":"2024-09-12T12:16:25.811305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813833+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:16:25.813833+0000","last_peered":"2024-09-12T12:16:25.813833+0000","last_clean":"2024-09-12T12:16:25.813833+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:16:25.813833+0000","last_undegraded":"2024-09-12T12:16:25.813833+0000","last_fullsized":"2024-09-12T12:16:25.813833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.816575+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:16:25.816575+0000","last_peered":"2024-09-12T12:16:25.816575+0000","last_clean":"2024-09-12T12:16:25.816575+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:16:25.816575+0000","last_undegraded":"2024-09-12T12:16:25.816575+0000","last_fullsized":"2024-09-12T12:16:25.816575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659672+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:16:25.659672+0000","last_peered":"2024-09-12T12:16:25.659672+0000","last_clean":"2024-09-12T12:16:25.659672+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:16:25.659672+0000","last_undegraded":"2024-09-12T12:16:25.659672+0000","last_fullsized":"2024-09-12T12:16:25.659672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'9","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370629+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:16:26.370629+0000","last_peered":"2024-09-12T12:16:26.370629+0000","last_clean":"2024-09-12T12:16:26.370629+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:16:26.370629+0000","last_undegraded":"2024-09-12T12:16:26.370629+0000","last_fullsized":"2024-09-12T12:16:26.370629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578900+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:16:25.578900+0000","last_peered":"2024-09-12T12:16:25.578900+0000","last_clean":"2024-09-12T12:16:25.578900+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:16:25.578900+0000","last_undegraded":"2024-09-12T12:16:25.578900+0000","last_fullsized":"2024-09-12T12:16:25.578900+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651372+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:16:25.651372+0000","last_peered":"2024-09-12T12:16:25.651372+0000","last_clean":"2024-09-12T12:16:25.651372+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:16:25.651372+0000","last_undegraded":"2024-09-12T12:16:25.651372+0000","last_fullsized":"2024-09-12T12:16:25.651372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578995+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:16:25.578995+0000","last_peered":"2024-09-12T12:16:25.578995+0000","last_clean":"2024-09-12T12:16:25.578995+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:16:25.578995+0000","last_undegraded":"2024-09-12T12:16:25.578995+0000","last_fullsized":"2024-09-12T12:16:25.578995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653785+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:16:25.653785+0000","last_peered":"2024-09-12T12:16:25.653785+0000","last_clean":"2024-09-12T12:16:25.653785+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:16:25.653785+0000","last_undegraded":"2024-09-12T12:16:25.653785+0000","last_fullsized":"2024-09-12T12:16:25.653785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815468+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:16:25.815468+0000","last_peered":"2024-09-12T12:16:25.815468+0000","last_clean":"2024-09-12T12:16:25.815468+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:16:25.815468+0000","last_undegraded":"2024-09-12T12:16:25.815468+0000","last_fullsized":"2024-09-12T12:16:25.815468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'51","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.771636+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:16:25.771636+0000","last_peered":"2024-09-12T12:16:25.771636+0000","last_clean":"2024-09-12T12:16:25.771636+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:16:25.771636+0000","last_undegraded":"2024-09-12T12:16:25.771636+0000","last_fullsized":"2024-09-12T12:16:25.771636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575751+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:16:25.575751+0000","last_peered":"2024-09-12T12:16:25.575751+0000","last_clean":"2024-09-12T12:16:25.575751+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:16:25.575751+0000","last_undegraded":"2024-09-12T12:16:25.575751+0000","last_fullsized":"2024-09-12T12:16:25.575751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813681+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:16:25.813681+0000","last_peered":"2024-09-12T12:16:25.813681+0000","last_clean":"2024-09-12T12:16:25.813681+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:16:25.813681+0000","last_undegraded":"2024-09-12T12:16:25.813681+0000","last_fullsized":"2024-09-12T12:16:25.813681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814073+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:16:25.814073+0000","last_peered":"2024-09-12T12:16:25.814073+0000","last_clean":"2024-09-12T12:16:25.814073+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:16:25.814073+0000","last_undegraded":"2024-09-12T12:16:25.814073+0000","last_fullsized":"2024-09-12T12:16:25.814073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811290+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:16:25.811290+0000","last_peered":"2024-09-12T12:16:25.811290+0000","last_clean":"2024-09-12T12:16:25.811290+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:16:25.811290+0000","last_undegraded":"2024-09-12T12:16:25.811290+0000","last_fullsized":"2024-09-12T12:16:25.811290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653400+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:16:25.653400+0000","last_peered":"2024-09-12T12:16:25.653400+0000","last_clean":"2024-09-12T12:16:25.653400+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:16:25.653400+0000","last_undegraded":"2024-09-12T12:16:25.653400+0000","last_fullsized":"2024-09-12T12:16:25.653400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575545+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:16:25.575545+0000","last_peered":"2024-09-12T12:16:25.575545+0000","last_clean":"2024-09-12T12:16:25.575545+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:16:25.575545+0000","last_undegraded":"2024-09-12T12:16:25.575545+0000","last_fullsized":"2024-09-12T12:16:25.575545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576327+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:16:25.576327+0000","last_peered":"2024-09-12T12:16:25.576327+0000","last_clean":"2024-09-12T12:16:25.576327+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:16:25.576327+0000","last_undegraded":"2024-09-12T12:16:25.576327+0000","last_fullsized":"2024-09-12T12:16:25.576327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811273+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:16:25.811273+0000","last_peered":"2024-09-12T12:16:25.811273+0000","last_clean":"2024-09-12T12:16:25.811273+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:16:25.811273+0000","last_undegraded":"2024-09-12T12:16:25.811273+0000","last_fullsized":"2024-09-12T12:16:25.811273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575689+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:16:25.575689+0000","last_peered":"2024-09-12T12:16:25.575689+0000","last_clean":"2024-09-12T12:16:25.575689+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:16:25.575689+0000","last_undegraded":"2024-09-12T12:16:25.575689+0000","last_fullsized":"2024-09-12T12:16:25.575689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653576+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:16:25.653576+0000","last_peered":"2024-09-12T12:16:25.653576+0000","last_clean":"2024-09-12T12:16:25.653576+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:16:25.653576+0000","last_undegraded":"2024-09-12T12:16:25.653576+0000","last_fullsized":"2024-09-12T12:16:25.653576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.812075+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:16:25.812075+0000","last_peered":"2024-09-12T12:16:25.812075+0000","last_clean":"2024-09-12T12:16:25.812075+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:16:25.812075+0000","last_undegraded":"2024-09-12T12:16:25.812075+0000","last_fullsized":"2024-09-12T12:16:25.812075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651379+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:16:25.651379+0000","last_peered":"2024-09-12T12:16:25.651379+0000","last_clean":"2024-09-12T12:16:25.651379+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:16:25.651379+0000","last_undegraded":"2024-09-12T12:16:25.651379+0000","last_fullsized":"2024-09-12T12:16:25.651379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653704+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:16:25.653704+0000","last_peered":"2024-09-12T12:16:25.653704+0000","last_clean":"2024-09-12T12:16:25.653704+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:16:25.653704+0000","last_undegraded":"2024-09-12T12:16:25.653704+0000","last_fullsized":"2024-09-12T12:16:25.653704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811479+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:16:25.811479+0000","last_peered":"2024-09-12T12:16:25.811479+0000","last_clean":"2024-09-12T12:16:25.811479+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:16:25.811479+0000","last_undegraded":"2024-09-12T12:16:25.811479+0000","last_fullsized":"2024-09-12T12:16:25.811479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'13","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576415+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:16:25.576415+0000","last_peered":"2024-09-12T12:16:25.576415+0000","last_clean":"2024-09-12T12:16:25.576415+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:16:25.576415+0000","last_undegraded":"2024-09-12T12:16:25.576415+0000","last_fullsized":"2024-09-12T12:16:25.576415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814378+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:16:25.814378+0000","last_peered":"2024-09-12T12:16:25.814378+0000","last_clean":"2024-09-12T12:16:25.814378+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:16:25.814378+0000","last_undegraded":"2024-09-12T12:16:25.814378+0000","last_fullsized":"2024-09-12T12:16:25.814378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575782+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:16:25.575782+0000","last_peered":"2024-09-12T12:16:25.575782+0000","last_clean":"2024-09-12T12:16:25.575782+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:16:25.575782+0000","last_undegraded":"2024-09-12T12:16:25.575782+0000","last_fullsized":"2024-09-12T12:16:25.575782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575667+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:16:25.575667+0000","last_peered":"2024-09-12T12:16:25.575667+0000","last_clean":"2024-09-12T12:16:25.575667+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:16:25.575667+0000","last_undegraded":"2024-09-12T12:16:25.575667+0000","last_fullsized":"2024-09-12T12:16:25.575667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'14","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651889+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:16:25.651889+0000","last_peered":"2024-09-12T12:16:25.651889+0000","last_clean":"2024-09-12T12:16:25.651889+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:16:25.651889+0000","last_undegraded":"2024-09-12T12:16:25.651889+0000","last_fullsized":"2024-09-12T12:16:25.651889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601059,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1141,"num_read_kb":688,"num_write":377,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1803177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678051,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":432078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1221973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070509,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":423139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1298432,"data_stored":825602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528374,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1027461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":432960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1156718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":956366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":500658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":500353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":424195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":135347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":200602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:29.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:16:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.391+0000 7f273f577640 1 -- 172.21.15.81:0/1448214049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738101450 msgr2=0x7f2738105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.391+0000 7f273f577640 1 --2- 172.21.15.81:0/1448214049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738101450 0x7f2738105920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2728009900 tx=0x7f272802a470 comp rx=0 tx=0).stop 2024-09-12T12:16:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 -- 172.21.15.81:0/1448214049 shutdown_connections 2024-09-12T12:16:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 --2- 172.21.15.81:0/1448214049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2738105f40 0x7f27381063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 --2- 172.21.15.81:0/1448214049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738101450 0x7f2738105920 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 --2- 172.21.15.81:0/1448214049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2738100b30 0x7f2738100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 -- 172.21.15.81:0/1448214049 >> 172.21.15.81:0/1448214049 conn(0x7f27380fc7a0 msgr2=0x7f27380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 -- 172.21.15.81:0/1448214049 shutdown_connections 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 -- 172.21.15.81:0/1448214049 wait complete. 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 Processor -- start 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.392+0000 7f273f577640 1 -- start start 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2738100b30 0x7f27381a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2738101450 0x7f27381a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 0x7f273819e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27381186a0 con 0x7f2738105f40 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2738118520 con 0x7f2738100b30 2024-09-12T12:16:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2738118820 con 0x7f2738101450 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 0x7f273819e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 0x7f273819e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54414/0 (socket says 172.21.15.81:54414) 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 -- 172.21.15.81:0/3319935460 learned_addr learned my addr 172.21.15.81:0/3319935460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273d313640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2738100b30 0x7f27381a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273cb12640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2738101450 0x7f27381a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 -- 172.21.15.81:0/3319935460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2738101450 msgr2=0x7f27381a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2738101450 0x7f27381a4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 -- 172.21.15.81:0/3319935460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2738100b30 msgr2=0x7f27381a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2738100b30 0x7f27381a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 -- 172.21.15.81:0/3319935460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273819f100 con 0x7f2738105f40 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273db14640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 0x7f273819e9d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f273000eaa0 tx=0x7f273000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273000cdb0 con 0x7f2738105f40 2024-09-12T12:16:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2730004b20 con 0x7f2738105f40 2024-09-12T12:16:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273819f3f0 con 0x7f2738105f40 2024-09-12T12:16:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.393+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730011760 con 0x7f2738105f40 2024-09-12T12:16:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.394+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27381ab6e0 con 0x7f2738105f40 2024-09-12T12:16:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.395+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2738105920 con 0x7f2738105f40 2024-09-12T12:16:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.396+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7f2730004cd0 con 0x7f2738105f40 2024-09-12T12:16:30.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.396+0000 7f272e7fc640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f27240a2cf0 0x7f27240a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.397+0000 7f273d313640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f27240a2cf0 0x7f27240a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.397+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f27300cf690 con 0x7f2738105f40 2024-09-12T12:16:30.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.397+0000 7f273d313640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f27240a2cf0 0x7f27240a51b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2734005fd0 tx=0x7f2734005e40 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.401+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2730016030 con 0x7f2738105f40 2024-09-12T12:16:30.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.564+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2738104fe0 con 0x7f27240a2cf0 2024-09-12T12:16:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.572+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257824 (secure 0 0 0) 0x7f2738104fe0 con 0x7f27240a2cf0 2024-09-12T12:16:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:16:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.577+0000 7f272e7fc640 1 -- 172.21.15.81:0/3319935460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f27300cd0d0 con 0x7f2738105f40 2024-09-12T12:16:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.577+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f27240a2cf0 msgr2=0x7f27240a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.577+0000 7f273f577640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f27240a2cf0 0x7f27240a51b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2734005fd0 tx=0x7f2734005e40 comp rx=0 tx=0).stop 2024-09-12T12:16:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 msgr2=0x7f273819e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 0x7f273819e9d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f273000eaa0 tx=0x7f273000ef60 comp rx=0 tx=0).stop 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 shutdown_connections 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f27240a2cf0 0x7f27240a51b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2738105f40 0x7f273819e9d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2738101450 0x7f27381a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 --2- 172.21.15.81:0/3319935460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2738100b30 0x7f27381a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:30.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 >> 172.21.15.81:0/3319935460 conn(0x7f27380fc7a0 msgr2=0x7f27381038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 shutdown_connections 2024-09-12T12:16:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:30.578+0000 7f273f577640 1 -- 172.21.15.81:0/3319935460 wait complete. 2024-09-12T12:16:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.862 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:30.863 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:30.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.906 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:30.906 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:30.906 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:30.906 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: Updating smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:16:30.937 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:16:31.416 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-12T12:16:29.588004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191661,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1277,"num_read_kb":807,"num_write":560,"num_write_kb":4406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":942,"ondisk_log_size":942,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367112,"kb_used_data":13680,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574712,"statfs":{"total":1151940427776,"available":1151564505088,"internally_reserved":0,"allocated":14008320,"data_stored":8324220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990554"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576604+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:16:25.576604+0000","last_peered":"2024-09-12T12:16:25.576604+0000","last_clean":"2024-09-12T12:16:25.576604+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:16:25.576604+0000","last_undegraded":"2024-09-12T12:16:25.576604+0000","last_fullsized":"2024-09-12T12:16:25.576604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814045+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:16:25.814045+0000","last_peered":"2024-09-12T12:16:25.814045+0000","last_clean":"2024-09-12T12:16:25.814045+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:16:25.814045+0000","last_undegraded":"2024-09-12T12:16:25.814045+0000","last_fullsized":"2024-09-12T12:16:25.814045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813839+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:16:25.813839+0000","last_peered":"2024-09-12T12:16:25.813839+0000","last_clean":"2024-09-12T12:16:25.813839+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:16:25.813839+0000","last_undegraded":"2024-09-12T12:16:25.813839+0000","last_fullsized":"2024-09-12T12:16:25.813839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651269+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:16:25.651269+0000","last_peered":"2024-09-12T12:16:25.651269+0000","last_clean":"2024-09-12T12:16:25.651269+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:16:25.651269+0000","last_undegraded":"2024-09-12T12:16:25.651269+0000","last_fullsized":"2024-09-12T12:16:25.651269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653470+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:16:25.653470+0000","last_peered":"2024-09-12T12:16:25.653470+0000","last_clean":"2024-09-12T12:16:25.653470+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:16:25.653470+0000","last_undegraded":"2024-09-12T12:16:25.653470+0000","last_fullsized":"2024-09-12T12:16:25.653470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578873+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:16:25.578873+0000","last_peered":"2024-09-12T12:16:25.578873+0000","last_clean":"2024-09-12T12:16:25.578873+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:16:25.578873+0000","last_undegraded":"2024-09-12T12:16:25.578873+0000","last_fullsized":"2024-09-12T12:16:25.578873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811861+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:16:25.811861+0000","last_peered":"2024-09-12T12:16:25.811861+0000","last_clean":"2024-09-12T12:16:25.811861+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:16:25.811861+0000","last_undegraded":"2024-09-12T12:16:25.811861+0000","last_fullsized":"2024-09-12T12:16:25.811861+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575366+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:16:25.575366+0000","last_peered":"2024-09-12T12:16:25.575366+0000","last_clean":"2024-09-12T12:16:25.575366+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:16:25.575366+0000","last_undegraded":"2024-09-12T12:16:25.575366+0000","last_fullsized":"2024-09-12T12:16:25.575366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811435+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:16:25.811435+0000","last_peered":"2024-09-12T12:16:25.811435+0000","last_clean":"2024-09-12T12:16:25.811435+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:16:25.811435+0000","last_undegraded":"2024-09-12T12:16:25.811435+0000","last_fullsized":"2024-09-12T12:16:25.811435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.579185+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:16:25.579185+0000","last_peered":"2024-09-12T12:16:25.579185+0000","last_clean":"2024-09-12T12:16:25.579185+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:16:25.579185+0000","last_undegraded":"2024-09-12T12:16:25.579185+0000","last_fullsized":"2024-09-12T12:16:25.579185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811577+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:16:25.811577+0000","last_peered":"2024-09-12T12:16:25.811577+0000","last_clean":"2024-09-12T12:16:25.811577+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:16:25.811577+0000","last_undegraded":"2024-09-12T12:16:25.811577+0000","last_fullsized":"2024-09-12T12:16:25.811577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813715+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:16:25.813715+0000","last_peered":"2024-09-12T12:16:25.813715+0000","last_clean":"2024-09-12T12:16:25.813715+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:16:25.813715+0000","last_undegraded":"2024-09-12T12:16:25.813715+0000","last_fullsized":"2024-09-12T12:16:25.813715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815228+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:16:25.815228+0000","last_peered":"2024-09-12T12:16:25.815228+0000","last_clean":"2024-09-12T12:16:25.815228+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:16:25.815228+0000","last_undegraded":"2024-09-12T12:16:25.815228+0000","last_fullsized":"2024-09-12T12:16:25.815228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814214+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:16:25.814214+0000","last_peered":"2024-09-12T12:16:25.814214+0000","last_clean":"2024-09-12T12:16:25.814214+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:16:25.814214+0000","last_undegraded":"2024-09-12T12:16:25.814214+0000","last_fullsized":"2024-09-12T12:16:25.814214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813620+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:16:25.813620+0000","last_peered":"2024-09-12T12:16:25.813620+0000","last_clean":"2024-09-12T12:16:25.813620+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:16:25.813620+0000","last_undegraded":"2024-09-12T12:16:25.813620+0000","last_fullsized":"2024-09-12T12:16:25.813620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811068+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:16:25.811068+0000","last_peered":"2024-09-12T12:16:25.811068+0000","last_clean":"2024-09-12T12:16:25.811068+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:16:25.811068+0000","last_undegraded":"2024-09-12T12:16:25.811068+0000","last_fullsized":"2024-09-12T12:16:25.811068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576664+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:16:25.576664+0000","last_peered":"2024-09-12T12:16:25.576664+0000","last_clean":"2024-09-12T12:16:25.576664+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:16:25.576664+0000","last_undegraded":"2024-09-12T12:16:25.576664+0000","last_fullsized":"2024-09-12T12:16:25.576664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651680+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:16:25.651680+0000","last_peered":"2024-09-12T12:16:25.651680+0000","last_clean":"2024-09-12T12:16:25.651680+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:16:25.651680+0000","last_undegraded":"2024-09-12T12:16:25.651680+0000","last_fullsized":"2024-09-12T12:16:25.651680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811279+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:16:25.811279+0000","last_peered":"2024-09-12T12:16:25.811279+0000","last_clean":"2024-09-12T12:16:25.811279+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:16:25.811279+0000","last_undegraded":"2024-09-12T12:16:25.811279+0000","last_fullsized":"2024-09-12T12:16:25.811279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576325+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:16:25.576325+0000","last_peered":"2024-09-12T12:16:25.576325+0000","last_clean":"2024-09-12T12:16:25.576325+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:16:25.576325+0000","last_undegraded":"2024-09-12T12:16:25.576325+0000","last_fullsized":"2024-09-12T12:16:25.576325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815351+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:16:25.815351+0000","last_peered":"2024-09-12T12:16:25.815351+0000","last_clean":"2024-09-12T12:16:25.815351+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:16:25.815351+0000","last_undegraded":"2024-09-12T12:16:25.815351+0000","last_fullsized":"2024-09-12T12:16:25.815351+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811331+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:16:25.811331+0000","last_peered":"2024-09-12T12:16:25.811331+0000","last_clean":"2024-09-12T12:16:25.811331+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:16:25.811331+0000","last_undegraded":"2024-09-12T12:16:25.811331+0000","last_fullsized":"2024-09-12T12:16:25.811331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575408+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:16:25.575408+0000","last_peered":"2024-09-12T12:16:25.575408+0000","last_clean":"2024-09-12T12:16:25.575408+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:16:25.575408+0000","last_undegraded":"2024-09-12T12:16:25.575408+0000","last_fullsized":"2024-09-12T12:16:25.575408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659608+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:16:25.659608+0000","last_peered":"2024-09-12T12:16:25.659608+0000","last_clean":"2024-09-12T12:16:25.659608+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:16:25.659608+0000","last_undegraded":"2024-09-12T12:16:25.659608+0000","last_fullsized":"2024-09-12T12:16:25.659608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575682+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:16:25.575682+0000","last_peered":"2024-09-12T12:16:25.575682+0000","last_clean":"2024-09-12T12:16:25.575682+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:16:25.575682+0000","last_undegraded":"2024-09-12T12:16:25.575682+0000","last_fullsized":"2024-09-12T12:16:25.575682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811600+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:16:25.811600+0000","last_peered":"2024-09-12T12:16:25.811600+0000","last_clean":"2024-09-12T12:16:25.811600+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:16:25.811600+0000","last_undegraded":"2024-09-12T12:16:25.811600+0000","last_fullsized":"2024-09-12T12:16:25.811600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576614+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:16:25.576614+0000","last_peered":"2024-09-12T12:16:25.576614+0000","last_clean":"2024-09-12T12:16:25.576614+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:16:25.576614+0000","last_undegraded":"2024-09-12T12:16:25.576614+0000","last_fullsized":"2024-09-12T12:16:25.576614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815419+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:16:25.815419+0000","last_peered":"2024-09-12T12:16:25.815419+0000","last_clean":"2024-09-12T12:16:25.815419+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:16:25.815419+0000","last_undegraded":"2024-09-12T12:16:25.815419+0000","last_fullsized":"2024-09-12T12:16:25.815419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813962+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:16:25.813962+0000","last_peered":"2024-09-12T12:16:25.813962+0000","last_clean":"2024-09-12T12:16:25.813962+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:16:25.813962+0000","last_undegraded":"2024-09-12T12:16:25.813962+0000","last_fullsized":"2024-09-12T12:16:25.813962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811101+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:16:25.811101+0000","last_peered":"2024-09-12T12:16:25.811101+0000","last_clean":"2024-09-12T12:16:25.811101+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:16:25.811101+0000","last_undegraded":"2024-09-12T12:16:25.811101+0000","last_fullsized":"2024-09-12T12:16:25.811101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811135+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:16:25.811135+0000","last_peered":"2024-09-12T12:16:25.811135+0000","last_clean":"2024-09-12T12:16:25.811135+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:16:25.811135+0000","last_undegraded":"2024-09-12T12:16:25.811135+0000","last_fullsized":"2024-09-12T12:16:25.811135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576241+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:16:25.576241+0000","last_peered":"2024-09-12T12:16:25.576241+0000","last_clean":"2024-09-12T12:16:25.576241+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:16:25.576241+0000","last_undegraded":"2024-09-12T12:16:25.576241+0000","last_fullsized":"2024-09-12T12:16:25.576241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653424+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:16:25.653424+0000","last_peered":"2024-09-12T12:16:25.653424+0000","last_clean":"2024-09-12T12:16:25.653424+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:16:25.653424+0000","last_undegraded":"2024-09-12T12:16:25.653424+0000","last_fullsized":"2024-09-12T12:16:25.653424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370611+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:16:26.370611+0000","last_peered":"2024-09-12T12:16:26.370611+0000","last_clean":"2024-09-12T12:16:26.370611+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:16:26.370611+0000","last_undegraded":"2024-09-12T12:16:26.370611+0000","last_fullsized":"2024-09-12T12:16:26.370611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659712+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:16:25.659712+0000","last_peered":"2024-09-12T12:16:25.659712+0000","last_clean":"2024-09-12T12:16:25.659712+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:16:25.659712+0000","last_undegraded":"2024-09-12T12:16:25.659712+0000","last_fullsized":"2024-09-12T12:16:25.659712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578905+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:16:25.578905+0000","last_peered":"2024-09-12T12:16:25.578905+0000","last_clean":"2024-09-12T12:16:25.578905+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:16:25.578905+0000","last_undegraded":"2024-09-12T12:16:25.578905+0000","last_fullsized":"2024-09-12T12:16:25.578905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813971+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:16:25.813971+0000","last_peered":"2024-09-12T12:16:25.813971+0000","last_clean":"2024-09-12T12:16:25.813971+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:16:25.813971+0000","last_undegraded":"2024-09-12T12:16:25.813971+0000","last_fullsized":"2024-09-12T12:16:25.813971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575421+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:16:25.575421+0000","last_peered":"2024-09-12T12:16:25.575421+0000","last_clean":"2024-09-12T12:16:25.575421+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:16:25.575421+0000","last_undegraded":"2024-09-12T12:16:25.575421+0000","last_fullsized":"2024-09-12T12:16:25.575421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659898+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:16:25.659898+0000","last_peered":"2024-09-12T12:16:25.659898+0000","last_clean":"2024-09-12T12:16:25.659898+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:16:25.659898+0000","last_undegraded":"2024-09-12T12:16:25.659898+0000","last_fullsized":"2024-09-12T12:16:25.659898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651138+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:16:25.651138+0000","last_peered":"2024-09-12T12:16:25.651138+0000","last_clean":"2024-09-12T12:16:25.651138+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:16:25.651138+0000","last_undegraded":"2024-09-12T12:16:25.651138+0000","last_fullsized":"2024-09-12T12:16:25.651138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'6","reported_seq":230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370090+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:16:26.370090+0000","last_peered":"2024-09-12T12:16:26.370090+0000","last_clean":"2024-09-12T12:16:26.370090+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:16:26.370090+0000","last_undegraded":"2024-09-12T12:16:26.370090+0000","last_fullsized":"2024-09-12T12:16:26.370090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811788+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:16:25.811788+0000","last_peered":"2024-09-12T12:16:25.811788+0000","last_clean":"2024-09-12T12:16:25.811788+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:16:25.811788+0000","last_undegraded":"2024-09-12T12:16:25.811788+0000","last_fullsized":"2024-09-12T12:16:25.811788+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811700+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:16:25.811700+0000","last_peered":"2024-09-12T12:16:25.811700+0000","last_clean":"2024-09-12T12:16:25.811700+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:16:25.811700+0000","last_undegraded":"2024-09-12T12:16:25.811700+0000","last_fullsized":"2024-09-12T12:16:25.811700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814445+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:16:25.814445+0000","last_peered":"2024-09-12T12:16:25.814445+0000","last_clean":"2024-09-12T12:16:25.814445+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:16:25.814445+0000","last_undegraded":"2024-09-12T12:16:25.814445+0000","last_fullsized":"2024-09-12T12:16:25.814445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.660028+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:16:25.660028+0000","last_peered":"2024-09-12T12:16:25.660028+0000","last_clean":"2024-09-12T12:16:25.660028+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:16:25.660028+0000","last_undegraded":"2024-09-12T12:16:25.660028+0000","last_fullsized":"2024-09-12T12:16:25.660028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811631+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:16:25.811631+0000","last_peered":"2024-09-12T12:16:25.811631+0000","last_clean":"2024-09-12T12:16:25.811631+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:16:25.811631+0000","last_undegraded":"2024-09-12T12:16:25.811631+0000","last_fullsized":"2024-09-12T12:16:25.811631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'37","reported_seq":273,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370491+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:16:26.370491+0000","last_peered":"2024-09-12T12:16:26.370491+0000","last_clean":"2024-09-12T12:16:26.370491+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:16:26.370491+0000","last_undegraded":"2024-09-12T12:16:26.370491+0000","last_fullsized":"2024-09-12T12:16:26.370491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":172,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653791+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:16:25.653791+0000","last_peered":"2024-09-12T12:16:25.653791+0000","last_clean":"2024-09-12T12:16:25.653791+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:16:25.653791+0000","last_undegraded":"2024-09-12T12:16:25.653791+0000","last_fullsized":"2024-09-12T12:16:25.653791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811304+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:16:25.811304+0000","last_peered":"2024-09-12T12:16:25.811304+0000","last_clean":"2024-09-12T12:16:25.811304+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:16:25.811304+0000","last_undegraded":"2024-09-12T12:16:25.811304+0000","last_fullsized":"2024-09-12T12:16:25.811304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814822+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:16:25.814822+0000","last_peered":"2024-09-12T12:16:25.814822+0000","last_clean":"2024-09-12T12:16:25.814822+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:16:25.814822+0000","last_undegraded":"2024-09-12T12:16:25.814822+0000","last_fullsized":"2024-09-12T12:16:25.814822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659718+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:16:25.659718+0000","last_peered":"2024-09-12T12:16:25.659718+0000","last_clean":"2024-09-12T12:16:25.659718+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:16:25.659718+0000","last_undegraded":"2024-09-12T12:16:25.659718+0000","last_fullsized":"2024-09-12T12:16:25.659718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811513+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:16:25.811513+0000","last_peered":"2024-09-12T12:16:25.811513+0000","last_clean":"2024-09-12T12:16:25.811513+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:16:25.811513+0000","last_undegraded":"2024-09-12T12:16:25.811513+0000","last_fullsized":"2024-09-12T12:16:25.811513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.387044+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:16:26.387044+0000","last_peered":"2024-09-12T12:16:26.387044+0000","last_clean":"2024-09-12T12:16:26.387044+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:16:26.387044+0000","last_undegraded":"2024-09-12T12:16:26.387044+0000","last_fullsized":"2024-09-12T12:16:26.387044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811102+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:16:25.811102+0000","last_peered":"2024-09-12T12:16:25.811102+0000","last_clean":"2024-09-12T12:16:25.811102+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:16:25.811102+0000","last_undegraded":"2024-09-12T12:16:25.811102+0000","last_fullsized":"2024-09-12T12:16:25.811102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653405+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:16:25.653405+0000","last_peered":"2024-09-12T12:16:25.653405+0000","last_clean":"2024-09-12T12:16:25.653405+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:16:25.653405+0000","last_undegraded":"2024-09-12T12:16:25.653405+0000","last_fullsized":"2024-09-12T12:16:25.653405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659683+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:16:25.659683+0000","last_peered":"2024-09-12T12:16:25.659683+0000","last_clean":"2024-09-12T12:16:25.659683+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:16:25.659683+0000","last_undegraded":"2024-09-12T12:16:25.659683+0000","last_fullsized":"2024-09-12T12:16:25.659683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653711+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:16:25.653711+0000","last_peered":"2024-09-12T12:16:25.653711+0000","last_clean":"2024-09-12T12:16:25.653711+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:16:25.653711+0000","last_undegraded":"2024-09-12T12:16:25.653711+0000","last_fullsized":"2024-09-12T12:16:25.653711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576477+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:16:25.576477+0000","last_peered":"2024-09-12T12:16:25.576477+0000","last_clean":"2024-09-12T12:16:25.576477+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:16:25.576477+0000","last_undegraded":"2024-09-12T12:16:25.576477+0000","last_fullsized":"2024-09-12T12:16:25.576477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815235+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:16:25.815235+0000","last_peered":"2024-09-12T12:16:25.815235+0000","last_clean":"2024-09-12T12:16:25.815235+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:16:25.815235+0000","last_undegraded":"2024-09-12T12:16:25.815235+0000","last_fullsized":"2024-09-12T12:16:25.815235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811637+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:16:25.811637+0000","last_peered":"2024-09-12T12:16:25.811637+0000","last_clean":"2024-09-12T12:16:25.811637+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:16:25.811637+0000","last_undegraded":"2024-09-12T12:16:25.811637+0000","last_fullsized":"2024-09-12T12:16:25.811637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'41","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.766366+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:16:25.766366+0000","last_peered":"2024-09-12T12:16:25.766366+0000","last_clean":"2024-09-12T12:16:25.766366+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:16:25.766366+0000","last_undegraded":"2024-09-12T12:16:25.766366+0000","last_fullsized":"2024-09-12T12:16:25.766366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811859+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:16:25.811859+0000","last_peered":"2024-09-12T12:16:25.811859+0000","last_clean":"2024-09-12T12:16:25.811859+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:16:25.811859+0000","last_undegraded":"2024-09-12T12:16:25.811859+0000","last_fullsized":"2024-09-12T12:16:25.811859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.395287+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:16:26.395287+0000","last_peered":"2024-09-12T12:16:26.395287+0000","last_clean":"2024-09-12T12:16:26.395287+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:16:26.395287+0000","last_undegraded":"2024-09-12T12:16:26.395287+0000","last_fullsized":"2024-09-12T12:16:26.395287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811703+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:16:25.811703+0000","last_peered":"2024-09-12T12:16:25.811703+0000","last_clean":"2024-09-12T12:16:25.811703+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:16:25.811703+0000","last_undegraded":"2024-09-12T12:16:25.811703+0000","last_fullsized":"2024-09-12T12:16:25.811703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811434+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:16:25.811434+0000","last_peered":"2024-09-12T12:16:25.811434+0000","last_clean":"2024-09-12T12:16:25.811434+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:16:25.811434+0000","last_undegraded":"2024-09-12T12:16:25.811434+0000","last_fullsized":"2024-09-12T12:16:25.811434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813491+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:16:25.813491+0000","last_peered":"2024-09-12T12:16:25.813491+0000","last_clean":"2024-09-12T12:16:25.813491+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:16:25.813491+0000","last_undegraded":"2024-09-12T12:16:25.813491+0000","last_fullsized":"2024-09-12T12:16:25.813491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651199+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:16:25.651199+0000","last_peered":"2024-09-12T12:16:25.651199+0000","last_clean":"2024-09-12T12:16:25.651199+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:16:25.651199+0000","last_undegraded":"2024-09-12T12:16:25.651199+0000","last_fullsized":"2024-09-12T12:16:25.651199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811305+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:16:25.811305+0000","last_peered":"2024-09-12T12:16:25.811305+0000","last_clean":"2024-09-12T12:16:25.811305+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:16:25.811305+0000","last_undegraded":"2024-09-12T12:16:25.811305+0000","last_fullsized":"2024-09-12T12:16:25.811305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813833+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:16:25.813833+0000","last_peered":"2024-09-12T12:16:25.813833+0000","last_clean":"2024-09-12T12:16:25.813833+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:16:25.813833+0000","last_undegraded":"2024-09-12T12:16:25.813833+0000","last_fullsized":"2024-09-12T12:16:25.813833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":131,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.816575+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:16:25.816575+0000","last_peered":"2024-09-12T12:16:25.816575+0000","last_clean":"2024-09-12T12:16:25.816575+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:16:25.816575+0000","last_undegraded":"2024-09-12T12:16:25.816575+0000","last_fullsized":"2024-09-12T12:16:25.816575+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659672+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:16:25.659672+0000","last_peered":"2024-09-12T12:16:25.659672+0000","last_clean":"2024-09-12T12:16:25.659672+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:16:25.659672+0000","last_undegraded":"2024-09-12T12:16:25.659672+0000","last_fullsized":"2024-09-12T12:16:25.659672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'9","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370629+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:16:26.370629+0000","last_peered":"2024-09-12T12:16:26.370629+0000","last_clean":"2024-09-12T12:16:26.370629+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:16:26.370629+0000","last_undegraded":"2024-09-12T12:16:26.370629+0000","last_fullsized":"2024-09-12T12:16:26.370629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578900+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:16:25.578900+0000","last_peered":"2024-09-12T12:16:25.578900+0000","last_clean":"2024-09-12T12:16:25.578900+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:16:25.578900+0000","last_undegraded":"2024-09-12T12:16:25.578900+0000","last_fullsized":"2024-09-12T12:16:25.578900+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651372+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:16:25.651372+0000","last_peered":"2024-09-12T12:16:25.651372+0000","last_clean":"2024-09-12T12:16:25.651372+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:16:25.651372+0000","last_undegraded":"2024-09-12T12:16:25.651372+0000","last_fullsized":"2024-09-12T12:16:25.651372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578995+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:16:25.578995+0000","last_peered":"2024-09-12T12:16:25.578995+0000","last_clean":"2024-09-12T12:16:25.578995+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:16:25.578995+0000","last_undegraded":"2024-09-12T12:16:25.578995+0000","last_fullsized":"2024-09-12T12:16:25.578995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653785+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:16:25.653785+0000","last_peered":"2024-09-12T12:16:25.653785+0000","last_clean":"2024-09-12T12:16:25.653785+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:16:25.653785+0000","last_undegraded":"2024-09-12T12:16:25.653785+0000","last_fullsized":"2024-09-12T12:16:25.653785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815468+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:16:25.815468+0000","last_peered":"2024-09-12T12:16:25.815468+0000","last_clean":"2024-09-12T12:16:25.815468+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:16:25.815468+0000","last_undegraded":"2024-09-12T12:16:25.815468+0000","last_fullsized":"2024-09-12T12:16:25.815468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'51","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.771636+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:16:25.771636+0000","last_peered":"2024-09-12T12:16:25.771636+0000","last_clean":"2024-09-12T12:16:25.771636+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:16:25.771636+0000","last_undegraded":"2024-09-12T12:16:25.771636+0000","last_fullsized":"2024-09-12T12:16:25.771636+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575751+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:16:25.575751+0000","last_peered":"2024-09-12T12:16:25.575751+0000","last_clean":"2024-09-12T12:16:25.575751+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:16:25.575751+0000","last_undegraded":"2024-09-12T12:16:25.575751+0000","last_fullsized":"2024-09-12T12:16:25.575751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813681+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:16:25.813681+0000","last_peered":"2024-09-12T12:16:25.813681+0000","last_clean":"2024-09-12T12:16:25.813681+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:16:25.813681+0000","last_undegraded":"2024-09-12T12:16:25.813681+0000","last_fullsized":"2024-09-12T12:16:25.813681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814073+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:16:25.814073+0000","last_peered":"2024-09-12T12:16:25.814073+0000","last_clean":"2024-09-12T12:16:25.814073+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:16:25.814073+0000","last_undegraded":"2024-09-12T12:16:25.814073+0000","last_fullsized":"2024-09-12T12:16:25.814073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811290+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:16:25.811290+0000","last_peered":"2024-09-12T12:16:25.811290+0000","last_clean":"2024-09-12T12:16:25.811290+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:16:25.811290+0000","last_undegraded":"2024-09-12T12:16:25.811290+0000","last_fullsized":"2024-09-12T12:16:25.811290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653400+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:16:25.653400+0000","last_peered":"2024-09-12T12:16:25.653400+0000","last_clean":"2024-09-12T12:16:25.653400+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:16:25.653400+0000","last_undegraded":"2024-09-12T12:16:25.653400+0000","last_fullsized":"2024-09-12T12:16:25.653400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575545+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:16:25.575545+0000","last_peered":"2024-09-12T12:16:25.575545+0000","last_clean":"2024-09-12T12:16:25.575545+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:16:25.575545+0000","last_undegraded":"2024-09-12T12:16:25.575545+0000","last_fullsized":"2024-09-12T12:16:25.575545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576327+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:16:25.576327+0000","last_peered":"2024-09-12T12:16:25.576327+0000","last_clean":"2024-09-12T12:16:25.576327+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:16:25.576327+0000","last_undegraded":"2024-09-12T12:16:25.576327+0000","last_fullsized":"2024-09-12T12:16:25.576327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811273+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:16:25.811273+0000","last_peered":"2024-09-12T12:16:25.811273+0000","last_clean":"2024-09-12T12:16:25.811273+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:16:25.811273+0000","last_undegraded":"2024-09-12T12:16:25.811273+0000","last_fullsized":"2024-09-12T12:16:25.811273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575689+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:16:25.575689+0000","last_peered":"2024-09-12T12:16:25.575689+0000","last_clean":"2024-09-12T12:16:25.575689+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:16:25.575689+0000","last_undegraded":"2024-09-12T12:16:25.575689+0000","last_fullsized":"2024-09-12T12:16:25.575689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653576+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:16:25.653576+0000","last_peered":"2024-09-12T12:16:25.653576+0000","last_clean":"2024-09-12T12:16:25.653576+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:16:25.653576+0000","last_undegraded":"2024-09-12T12:16:25.653576+0000","last_fullsized":"2024-09-12T12:16:25.653576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.812075+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:16:25.812075+0000","last_peered":"2024-09-12T12:16:25.812075+0000","last_clean":"2024-09-12T12:16:25.812075+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:16:25.812075+0000","last_undegraded":"2024-09-12T12:16:25.812075+0000","last_fullsized":"2024-09-12T12:16:25.812075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651379+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:16:25.651379+0000","last_peered":"2024-09-12T12:16:25.651379+0000","last_clean":"2024-09-12T12:16:25.651379+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:16:25.651379+0000","last_undegraded":"2024-09-12T12:16:25.651379+0000","last_fullsized":"2024-09-12T12:16:25.651379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653704+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:16:25.653704+0000","last_peered":"2024-09-12T12:16:25.653704+0000","last_clean":"2024-09-12T12:16:25.653704+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:16:25.653704+0000","last_undegraded":"2024-09-12T12:16:25.653704+0000","last_fullsized":"2024-09-12T12:16:25.653704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811479+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:16:25.811479+0000","last_peered":"2024-09-12T12:16:25.811479+0000","last_clean":"2024-09-12T12:16:25.811479+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:16:25.811479+0000","last_undegraded":"2024-09-12T12:16:25.811479+0000","last_fullsized":"2024-09-12T12:16:25.811479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'13","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576415+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:16:25.576415+0000","last_peered":"2024-09-12T12:16:25.576415+0000","last_clean":"2024-09-12T12:16:25.576415+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:16:25.576415+0000","last_undegraded":"2024-09-12T12:16:25.576415+0000","last_fullsized":"2024-09-12T12:16:25.576415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814378+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:16:25.814378+0000","last_peered":"2024-09-12T12:16:25.814378+0000","last_clean":"2024-09-12T12:16:25.814378+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:16:25.814378+0000","last_undegraded":"2024-09-12T12:16:25.814378+0000","last_fullsized":"2024-09-12T12:16:25.814378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575782+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:16:25.575782+0000","last_peered":"2024-09-12T12:16:25.575782+0000","last_clean":"2024-09-12T12:16:25.575782+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:16:25.575782+0000","last_undegraded":"2024-09-12T12:16:25.575782+0000","last_fullsized":"2024-09-12T12:16:25.575782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575667+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:16:25.575667+0000","last_peered":"2024-09-12T12:16:25.575667+0000","last_clean":"2024-09-12T12:16:25.575667+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:16:25.575667+0000","last_undegraded":"2024-09-12T12:16:25.575667+0000","last_fullsized":"2024-09-12T12:16:25.575667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'14","reported_seq":139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651889+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:16:25.651889+0000","last_peered":"2024-09-12T12:16:25.651889+0000","last_clean":"2024-09-12T12:16:25.651889+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:16:25.651889+0000","last_undegraded":"2024-09-12T12:16:25.651889+0000","last_fullsized":"2024-09-12T12:16:25.651889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601059,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1141,"num_read_kb":688,"num_write":377,"num_write_kb":1466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1803177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678051,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":432078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1221973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070509,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":423139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1298432,"data_stored":825602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528374,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1027461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":432960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1156718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1437696,"data_stored":956366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":500658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":500353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":424195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":135347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":200602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:31.420 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T12:16:31.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T12:16:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:31.785 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:31 smithi081 ceph-mon[30948]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:16:31.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:31 smithi081 ceph-mon[30948]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-12T12:16:31.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:31 smithi173 ceph-mon[35326]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:16:31.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:31 smithi173 ceph-mon[35326]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-12T12:16:31.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:31 smithi103 ceph-mon[35094]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:16:31.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:31 smithi103 ceph-mon[35094]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-09-12T12:16:32.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 -- 172.21.15.81:0/3740983115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84101420 msgr2=0x7fec8410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 --2- 172.21.15.81:0/3740983115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84101420 0x7fec8410d950 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009cd0 tx=0x7fec7c02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 -- 172.21.15.81:0/3740983115 shutdown_connections 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 --2- 172.21.15.81:0/3740983115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84101420 0x7fec8410d950 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 --2- 172.21.15.81:0/3740983115 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec84100a80 0x7fec84100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 --2- 172.21.15.81:0/3740983115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec84106a80 0x7fec84106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 -- 172.21.15.81:0/3740983115 >> 172.21.15.81:0/3740983115 conn(0x7fec840fc7a0 msgr2=0x7fec840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 -- 172.21.15.81:0/3740983115 shutdown_connections 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.115+0000 7fec8ae95640 1 -- 172.21.15.81:0/3740983115 wait complete. 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 Processor -- start 2024-09-12T12:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 -- start start 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 0x7fec84198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec84101420 0x7fec84198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec84106a80 0x7fec8419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec841120c0 con 0x7fec84100a80 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec84111f40 con 0x7fec84101420 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec8ae95640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fec84112240 con 0x7fec84106a80 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec88c31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 0x7fec84198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec88c31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 0x7fec84198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54444/0 (socket says 172.21.15.81:54444) 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec88c31640 1 -- 172.21.15.81:0/1816919104 learned_addr learned my addr 172.21.15.81:0/1816919104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec83fff640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec84101420 0x7fec84198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.116+0000 7fec89432640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec84106a80 0x7fec8419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec88c31640 1 -- 172.21.15.81:0/1816919104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec84106a80 msgr2=0x7fec8419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec88c31640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec84106a80 0x7fec8419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec88c31640 1 -- 172.21.15.81:0/1816919104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec84101420 msgr2=0x7fec84198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec88c31640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec84101420 0x7fec84198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec88c31640 1 -- 172.21.15.81:0/1816919104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8419d4d0 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec88c31640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 0x7fec84198520 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d950 tx=0x7fec7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74017030 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8419d7c0 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec74004020 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74004a00 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.117+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec841a50a0 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.118+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec84100ee0 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.119+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fec740041d0 con 0x7fec84100a80 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.120+0000 7fec81ffb640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fec6c0a2d80 0x7fec6c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.120+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fec740cee60 con 0x7fec84100a80 2024-09-12T12:16:32.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.120+0000 7fec83fff640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fec6c0a2d80 0x7fec6c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:32.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.120+0000 7fec83fff640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fec6c0a2d80 0x7fec6c0a5240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fec840fecd0 tx=0x7fec7800b390 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:32.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.124+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec7409b980 con 0x7fec84100a80 2024-09-12T12:16:32.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.287+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec840fd5a0 con 0x7fec6c0a2d80 2024-09-12T12:16:32.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.296+0000 7fec81ffb640 1 -- 172.21.15.81:0/1816919104 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257843 (secure 0 0 0) 0x7fec840fd5a0 con 0x7fec6c0a2d80 2024-09-12T12:16:32.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:32.299 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-12T12:16:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fec6c0a2d80 msgr2=0x7fec6c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fec6c0a2d80 0x7fec6c0a5240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fec840fecd0 tx=0x7fec7800b390 comp rx=0 tx=0).stop 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 msgr2=0x7fec84198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 0x7fec84198520 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec7400d950 tx=0x7fec7400de10 comp rx=0 tx=0).stop 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 shutdown_connections 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fec6c0a2d80 0x7fec6c0a5240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec84106a80 0x7fec8419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec84101420 0x7fec84198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 --2- 172.21.15.81:0/1816919104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec84100a80 0x7fec84198520 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 >> 172.21.15.81:0/1816919104 conn(0x7fec840fc7a0 msgr2=0x7fec840fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 shutdown_connections 2024-09-12T12:16:32.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:32.300+0000 7fec8ae95640 1 -- 172.21.15.81:0/1816919104 wait complete. 2024-09-12T12:16:32.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:32 smithi081 ceph-mon[30948]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:32 smithi081 ceph-mon[30948]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-09-12T12:16:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:32 smithi081 ceph-mon[30948]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:32 smithi173 ceph-mon[35326]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:32 smithi173 ceph-mon[35326]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-09-12T12:16:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:32 smithi173 ceph-mon[35326]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:32.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:32 smithi103 ceph-mon[35094]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:32.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:32 smithi103 ceph-mon[35094]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 90 KiB/s wr, 67 op/s 2024-09-12T12:16:32.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:32 smithi103 ceph-mon[35094]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T12:16:33.038 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-12T12:16:31.588309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191661,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1517,"num_read_kb":1024,"num_write":659,"num_write_kb":4854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":995,"ondisk_log_size":995,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367844,"kb_used_data":14288,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124573980,"statfs":{"total":1151940427776,"available":1151563755520,"internally_reserved":0,"allocated":14630912,"data_stored":8932199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":217,"num_write":99,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.990859"},"pg_stats":[{"pgid":"3.3f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576604+0000","last_change":"2024-09-12T12:14:35.376314+0000","last_active":"2024-09-12T12:16:25.576604+0000","last_peered":"2024-09-12T12:16:25.576604+0000","last_clean":"2024-09-12T12:16:25.576604+0000","last_became_active":"2024-09-12T12:14:35.375959+0000","last_became_peered":"2024-09-12T12:14:35.375959+0000","last_unstale":"2024-09-12T12:16:25.576604+0000","last_undegraded":"2024-09-12T12:16:25.576604+0000","last_fullsized":"2024-09-12T12:16:25.576604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:14:12.083528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814045+0000","last_change":"2024-09-12T12:14:35.365407+0000","last_active":"2024-09-12T12:16:25.814045+0000","last_peered":"2024-09-12T12:16:25.814045+0000","last_clean":"2024-09-12T12:16:25.814045+0000","last_became_active":"2024-09-12T12:14:35.364688+0000","last_became_peered":"2024-09-12T12:14:35.364688+0000","last_unstale":"2024-09-12T12:16:25.814045+0000","last_undegraded":"2024-09-12T12:16:25.814045+0000","last_fullsized":"2024-09-12T12:16:25.814045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:12.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813839+0000","last_change":"2024-09-12T12:14:35.363261+0000","last_active":"2024-09-12T12:16:25.813839+0000","last_peered":"2024-09-12T12:16:25.813839+0000","last_clean":"2024-09-12T12:16:25.813839+0000","last_became_active":"2024-09-12T12:14:35.362844+0000","last_became_peered":"2024-09-12T12:14:35.362844+0000","last_unstale":"2024-09-12T12:16:25.813839+0000","last_undegraded":"2024-09-12T12:16:25.813839+0000","last_fullsized":"2024-09-12T12:16:25.813839+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:18:44.847025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651269+0000","last_change":"2024-09-12T12:14:50.229316+0000","last_active":"2024-09-12T12:16:25.651269+0000","last_peered":"2024-09-12T12:16:25.651269+0000","last_clean":"2024-09-12T12:16:25.651269+0000","last_became_active":"2024-09-12T12:14:50.228899+0000","last_became_peered":"2024-09-12T12:14:50.228899+0000","last_unstale":"2024-09-12T12:16:25.651269+0000","last_undegraded":"2024-09-12T12:16:25.651269+0000","last_fullsized":"2024-09-12T12:16:25.651269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:44.852446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653470+0000","last_change":"2024-09-12T12:14:35.359077+0000","last_active":"2024-09-12T12:16:25.653470+0000","last_peered":"2024-09-12T12:16:25.653470+0000","last_clean":"2024-09-12T12:16:25.653470+0000","last_became_active":"2024-09-12T12:14:35.358731+0000","last_became_peered":"2024-09-12T12:14:35.358731+0000","last_unstale":"2024-09-12T12:16:25.653470+0000","last_undegraded":"2024-09-12T12:16:25.653470+0000","last_fullsized":"2024-09-12T12:16:25.653470+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:54:54.138743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578873+0000","last_change":"2024-09-12T12:14:35.367013+0000","last_active":"2024-09-12T12:16:25.578873+0000","last_peered":"2024-09-12T12:16:25.578873+0000","last_clean":"2024-09-12T12:16:25.578873+0000","last_became_active":"2024-09-12T12:14:35.366633+0000","last_became_peered":"2024-09-12T12:14:35.366633+0000","last_unstale":"2024-09-12T12:16:25.578873+0000","last_undegraded":"2024-09-12T12:16:25.578873+0000","last_fullsized":"2024-09-12T12:16:25.578873+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:52.449551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811861+0000","last_change":"2024-09-12T12:14:35.366505+0000","last_active":"2024-09-12T12:16:25.811861+0000","last_peered":"2024-09-12T12:16:25.811861+0000","last_clean":"2024-09-12T12:16:25.811861+0000","last_became_active":"2024-09-12T12:14:35.366107+0000","last_became_peered":"2024-09-12T12:14:35.366107+0000","last_unstale":"2024-09-12T12:16:25.811861+0000","last_undegraded":"2024-09-12T12:16:25.811861+0000","last_fullsized":"2024-09-12T12:16:25.811861+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:29:51.530146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575366+0000","last_change":"2024-09-12T12:14:35.363781+0000","last_active":"2024-09-12T12:16:25.575366+0000","last_peered":"2024-09-12T12:16:25.575366+0000","last_clean":"2024-09-12T12:16:25.575366+0000","last_became_active":"2024-09-12T12:14:35.363505+0000","last_became_peered":"2024-09-12T12:14:35.363505+0000","last_unstale":"2024-09-12T12:16:25.575366+0000","last_undegraded":"2024-09-12T12:16:25.575366+0000","last_fullsized":"2024-09-12T12:16:25.575366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:12.872540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811435+0000","last_change":"2024-09-12T12:14:35.371487+0000","last_active":"2024-09-12T12:16:25.811435+0000","last_peered":"2024-09-12T12:16:25.811435+0000","last_clean":"2024-09-12T12:16:25.811435+0000","last_became_active":"2024-09-12T12:14:35.371193+0000","last_became_peered":"2024-09-12T12:14:35.371193+0000","last_unstale":"2024-09-12T12:16:25.811435+0000","last_undegraded":"2024-09-12T12:16:25.811435+0000","last_fullsized":"2024-09-12T12:16:25.811435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:15.323020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"79'16","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.579185+0000","last_change":"2024-09-12T12:14:35.368959+0000","last_active":"2024-09-12T12:16:25.579185+0000","last_peered":"2024-09-12T12:16:25.579185+0000","last_clean":"2024-09-12T12:16:25.579185+0000","last_became_active":"2024-09-12T12:14:35.368013+0000","last_became_peered":"2024-09-12T12:14:35.368013+0000","last_unstale":"2024-09-12T12:16:25.579185+0000","last_undegraded":"2024-09-12T12:16:25.579185+0000","last_fullsized":"2024-09-12T12:16:25.579185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:31.057051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811577+0000","last_change":"2024-09-12T12:14:35.376224+0000","last_active":"2024-09-12T12:16:25.811577+0000","last_peered":"2024-09-12T12:16:25.811577+0000","last_clean":"2024-09-12T12:16:25.811577+0000","last_became_active":"2024-09-12T12:14:35.375900+0000","last_became_peered":"2024-09-12T12:14:35.375900+0000","last_unstale":"2024-09-12T12:16:25.811577+0000","last_undegraded":"2024-09-12T12:16:25.811577+0000","last_fullsized":"2024-09-12T12:16:25.811577+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:08.782754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813715+0000","last_change":"2024-09-12T12:14:35.361206+0000","last_active":"2024-09-12T12:16:25.813715+0000","last_peered":"2024-09-12T12:16:25.813715+0000","last_clean":"2024-09-12T12:16:25.813715+0000","last_became_active":"2024-09-12T12:14:35.360877+0000","last_became_peered":"2024-09-12T12:14:35.360877+0000","last_unstale":"2024-09-12T12:16:25.813715+0000","last_undegraded":"2024-09-12T12:16:25.813715+0000","last_fullsized":"2024-09-12T12:16:25.813715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:52.805671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815228+0000","last_change":"2024-09-12T12:14:35.364402+0000","last_active":"2024-09-12T12:16:25.815228+0000","last_peered":"2024-09-12T12:16:25.815228+0000","last_clean":"2024-09-12T12:16:25.815228+0000","last_became_active":"2024-09-12T12:14:35.364073+0000","last_became_peered":"2024-09-12T12:14:35.364073+0000","last_unstale":"2024-09-12T12:16:25.815228+0000","last_undegraded":"2024-09-12T12:16:25.815228+0000","last_fullsized":"2024-09-12T12:16:25.815228+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:57.000111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814214+0000","last_change":"2024-09-12T12:14:35.367215+0000","last_active":"2024-09-12T12:16:25.814214+0000","last_peered":"2024-09-12T12:16:25.814214+0000","last_clean":"2024-09-12T12:16:25.814214+0000","last_became_active":"2024-09-12T12:14:35.366887+0000","last_became_peered":"2024-09-12T12:14:35.366887+0000","last_unstale":"2024-09-12T12:16:25.814214+0000","last_undegraded":"2024-09-12T12:16:25.814214+0000","last_fullsized":"2024-09-12T12:16:25.814214+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:24:45.318206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813620+0000","last_change":"2024-09-12T12:14:35.367233+0000","last_active":"2024-09-12T12:16:25.813620+0000","last_peered":"2024-09-12T12:16:25.813620+0000","last_clean":"2024-09-12T12:16:25.813620+0000","last_became_active":"2024-09-12T12:14:35.366932+0000","last_became_peered":"2024-09-12T12:14:35.366932+0000","last_unstale":"2024-09-12T12:16:25.813620+0000","last_undegraded":"2024-09-12T12:16:25.813620+0000","last_fullsized":"2024-09-12T12:16:25.813620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:22.757614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811068+0000","last_change":"2024-09-12T12:14:35.374101+0000","last_active":"2024-09-12T12:16:25.811068+0000","last_peered":"2024-09-12T12:16:25.811068+0000","last_clean":"2024-09-12T12:16:25.811068+0000","last_became_active":"2024-09-12T12:14:35.373633+0000","last_became_peered":"2024-09-12T12:14:35.373633+0000","last_unstale":"2024-09-12T12:16:25.811068+0000","last_undegraded":"2024-09-12T12:16:25.811068+0000","last_fullsized":"2024-09-12T12:16:25.811068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:12.743022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576664+0000","last_change":"2024-09-12T12:14:35.376727+0000","last_active":"2024-09-12T12:16:25.576664+0000","last_peered":"2024-09-12T12:16:25.576664+0000","last_clean":"2024-09-12T12:16:25.576664+0000","last_became_active":"2024-09-12T12:14:35.376149+0000","last_became_peered":"2024-09-12T12:14:35.376149+0000","last_unstale":"2024-09-12T12:16:25.576664+0000","last_undegraded":"2024-09-12T12:16:25.576664+0000","last_fullsized":"2024-09-12T12:16:25.576664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:10.582224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651680+0000","last_change":"2024-09-12T12:14:35.362906+0000","last_active":"2024-09-12T12:16:25.651680+0000","last_peered":"2024-09-12T12:16:25.651680+0000","last_clean":"2024-09-12T12:16:25.651680+0000","last_became_active":"2024-09-12T12:14:35.362560+0000","last_became_peered":"2024-09-12T12:14:35.362560+0000","last_unstale":"2024-09-12T12:16:25.651680+0000","last_undegraded":"2024-09-12T12:16:25.651680+0000","last_fullsized":"2024-09-12T12:16:25.651680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.541108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811279+0000","last_change":"2024-09-12T12:14:35.363438+0000","last_active":"2024-09-12T12:16:25.811279+0000","last_peered":"2024-09-12T12:16:25.811279+0000","last_clean":"2024-09-12T12:16:25.811279+0000","last_became_active":"2024-09-12T12:14:35.362547+0000","last_became_peered":"2024-09-12T12:14:35.362547+0000","last_unstale":"2024-09-12T12:16:25.811279+0000","last_undegraded":"2024-09-12T12:16:25.811279+0000","last_fullsized":"2024-09-12T12:16:25.811279+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:48:41.392051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576325+0000","last_change":"2024-09-12T12:14:35.367682+0000","last_active":"2024-09-12T12:16:25.576325+0000","last_peered":"2024-09-12T12:16:25.576325+0000","last_clean":"2024-09-12T12:16:25.576325+0000","last_became_active":"2024-09-12T12:14:35.366840+0000","last_became_peered":"2024-09-12T12:14:35.366840+0000","last_unstale":"2024-09-12T12:16:25.576325+0000","last_undegraded":"2024-09-12T12:16:25.576325+0000","last_fullsized":"2024-09-12T12:16:25.576325+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:02.492095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815351+0000","last_change":"2024-09-12T12:14:35.373486+0000","last_active":"2024-09-12T12:16:25.815351+0000","last_peered":"2024-09-12T12:16:25.815351+0000","last_clean":"2024-09-12T12:16:25.815351+0000","last_became_active":"2024-09-12T12:14:35.372898+0000","last_became_peered":"2024-09-12T12:14:35.372898+0000","last_unstale":"2024-09-12T12:16:25.815351+0000","last_undegraded":"2024-09-12T12:16:25.815351+0000","last_fullsized":"2024-09-12T12:16:25.815351+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:42.593638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811331+0000","last_change":"2024-09-12T12:14:35.373346+0000","last_active":"2024-09-12T12:16:25.811331+0000","last_peered":"2024-09-12T12:16:25.811331+0000","last_clean":"2024-09-12T12:16:25.811331+0000","last_became_active":"2024-09-12T12:14:35.372957+0000","last_became_peered":"2024-09-12T12:14:35.372957+0000","last_unstale":"2024-09-12T12:16:25.811331+0000","last_undegraded":"2024-09-12T12:16:25.811331+0000","last_fullsized":"2024-09-12T12:16:25.811331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:03.757502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575408+0000","last_change":"2024-09-12T12:14:35.365151+0000","last_active":"2024-09-12T12:16:25.575408+0000","last_peered":"2024-09-12T12:16:25.575408+0000","last_clean":"2024-09-12T12:16:25.575408+0000","last_became_active":"2024-09-12T12:14:35.364860+0000","last_became_peered":"2024-09-12T12:14:35.364860+0000","last_unstale":"2024-09-12T12:16:25.575408+0000","last_undegraded":"2024-09-12T12:16:25.575408+0000","last_fullsized":"2024-09-12T12:16:25.575408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:28.125092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659608+0000","last_change":"2024-09-12T12:14:35.361631+0000","last_active":"2024-09-12T12:16:25.659608+0000","last_peered":"2024-09-12T12:16:25.659608+0000","last_clean":"2024-09-12T12:16:25.659608+0000","last_became_active":"2024-09-12T12:14:35.361313+0000","last_became_peered":"2024-09-12T12:14:35.361313+0000","last_unstale":"2024-09-12T12:16:25.659608+0000","last_undegraded":"2024-09-12T12:16:25.659608+0000","last_fullsized":"2024-09-12T12:16:25.659608+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:36.132069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575682+0000","last_change":"2024-09-12T12:14:35.360027+0000","last_active":"2024-09-12T12:16:25.575682+0000","last_peered":"2024-09-12T12:16:25.575682+0000","last_clean":"2024-09-12T12:16:25.575682+0000","last_became_active":"2024-09-12T12:14:35.359162+0000","last_became_peered":"2024-09-12T12:14:35.359162+0000","last_unstale":"2024-09-12T12:16:25.575682+0000","last_undegraded":"2024-09-12T12:16:25.575682+0000","last_fullsized":"2024-09-12T12:16:25.575682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:15.504028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811600+0000","last_change":"2024-09-12T12:14:35.363997+0000","last_active":"2024-09-12T12:16:25.811600+0000","last_peered":"2024-09-12T12:16:25.811600+0000","last_clean":"2024-09-12T12:16:25.811600+0000","last_became_active":"2024-09-12T12:14:35.363605+0000","last_became_peered":"2024-09-12T12:14:35.363605+0000","last_unstale":"2024-09-12T12:16:25.811600+0000","last_undegraded":"2024-09-12T12:16:25.811600+0000","last_fullsized":"2024-09-12T12:16:25.811600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:24.534338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576614+0000","last_change":"2024-09-12T12:14:35.369122+0000","last_active":"2024-09-12T12:16:25.576614+0000","last_peered":"2024-09-12T12:16:25.576614+0000","last_clean":"2024-09-12T12:16:25.576614+0000","last_became_active":"2024-09-12T12:14:35.368364+0000","last_became_peered":"2024-09-12T12:14:35.368364+0000","last_unstale":"2024-09-12T12:16:25.576614+0000","last_undegraded":"2024-09-12T12:16:25.576614+0000","last_fullsized":"2024-09-12T12:16:25.576614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:05.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"79'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815419+0000","last_change":"2024-09-12T12:14:35.358926+0000","last_active":"2024-09-12T12:16:25.815419+0000","last_peered":"2024-09-12T12:16:25.815419+0000","last_clean":"2024-09-12T12:16:25.815419+0000","last_became_active":"2024-09-12T12:14:35.358624+0000","last_became_peered":"2024-09-12T12:14:35.358624+0000","last_unstale":"2024-09-12T12:16:25.815419+0000","last_undegraded":"2024-09-12T12:16:25.815419+0000","last_fullsized":"2024-09-12T12:16:25.815419+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.268851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813962+0000","last_change":"2024-09-12T12:14:35.360375+0000","last_active":"2024-09-12T12:16:25.813962+0000","last_peered":"2024-09-12T12:16:25.813962+0000","last_clean":"2024-09-12T12:16:25.813962+0000","last_became_active":"2024-09-12T12:14:35.359646+0000","last_became_peered":"2024-09-12T12:14:35.359646+0000","last_unstale":"2024-09-12T12:16:25.813962+0000","last_undegraded":"2024-09-12T12:16:25.813962+0000","last_fullsized":"2024-09-12T12:16:25.813962+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:51:02.605727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811101+0000","last_change":"2024-09-12T12:14:35.361382+0000","last_active":"2024-09-12T12:16:25.811101+0000","last_peered":"2024-09-12T12:16:25.811101+0000","last_clean":"2024-09-12T12:16:25.811101+0000","last_became_active":"2024-09-12T12:14:35.361028+0000","last_became_peered":"2024-09-12T12:14:35.361028+0000","last_unstale":"2024-09-12T12:16:25.811101+0000","last_undegraded":"2024-09-12T12:16:25.811101+0000","last_fullsized":"2024-09-12T12:16:25.811101+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:19.268975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"79'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811135+0000","last_change":"2024-09-12T12:14:35.370744+0000","last_active":"2024-09-12T12:16:25.811135+0000","last_peered":"2024-09-12T12:16:25.811135+0000","last_clean":"2024-09-12T12:16:25.811135+0000","last_became_active":"2024-09-12T12:14:35.370326+0000","last_became_peered":"2024-09-12T12:14:35.370326+0000","last_unstale":"2024-09-12T12:16:25.811135+0000","last_undegraded":"2024-09-12T12:16:25.811135+0000","last_fullsized":"2024-09-12T12:16:25.811135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:07:08.471583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576241+0000","last_change":"2024-09-12T12:14:35.369354+0000","last_active":"2024-09-12T12:16:25.576241+0000","last_peered":"2024-09-12T12:16:25.576241+0000","last_clean":"2024-09-12T12:16:25.576241+0000","last_became_active":"2024-09-12T12:14:35.368969+0000","last_became_peered":"2024-09-12T12:14:35.368969+0000","last_unstale":"2024-09-12T12:16:25.576241+0000","last_undegraded":"2024-09-12T12:16:25.576241+0000","last_fullsized":"2024-09-12T12:16:25.576241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:03.762634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653424+0000","last_change":"2024-09-12T12:14:35.372318+0000","last_active":"2024-09-12T12:16:25.653424+0000","last_peered":"2024-09-12T12:16:25.653424+0000","last_clean":"2024-09-12T12:16:25.653424+0000","last_became_active":"2024-09-12T12:14:35.371489+0000","last_became_peered":"2024-09-12T12:14:35.371489+0000","last_unstale":"2024-09-12T12:16:25.653424+0000","last_undegraded":"2024-09-12T12:16:25.653424+0000","last_fullsized":"2024-09-12T12:16:25.653424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:35.634210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'8","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370611+0000","last_change":"2024-09-12T12:14:33.368378+0000","last_active":"2024-09-12T12:16:26.370611+0000","last_peered":"2024-09-12T12:16:26.370611+0000","last_clean":"2024-09-12T12:16:26.370611+0000","last_became_active":"2024-09-12T12:14:33.367930+0000","last_became_peered":"2024-09-12T12:14:33.367930+0000","last_unstale":"2024-09-12T12:16:26.370611+0000","last_undegraded":"2024-09-12T12:16:26.370611+0000","last_fullsized":"2024-09-12T12:16:26.370611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:00.713601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1549,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659712+0000","last_change":"2024-09-12T12:14:35.364743+0000","last_active":"2024-09-12T12:16:25.659712+0000","last_peered":"2024-09-12T12:16:25.659712+0000","last_clean":"2024-09-12T12:16:25.659712+0000","last_became_active":"2024-09-12T12:14:35.364384+0000","last_became_peered":"2024-09-12T12:14:35.364384+0000","last_unstale":"2024-09-12T12:16:25.659712+0000","last_undegraded":"2024-09-12T12:16:25.659712+0000","last_fullsized":"2024-09-12T12:16:25.659712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:34:30.442794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578905+0000","last_change":"2024-09-12T12:14:33.362271+0000","last_active":"2024-09-12T12:16:25.578905+0000","last_peered":"2024-09-12T12:16:25.578905+0000","last_clean":"2024-09-12T12:16:25.578905+0000","last_became_active":"2024-09-12T12:14:33.361899+0000","last_became_peered":"2024-09-12T12:14:33.361899+0000","last_unstale":"2024-09-12T12:16:25.578905+0000","last_undegraded":"2024-09-12T12:16:25.578905+0000","last_fullsized":"2024-09-12T12:16:25.578905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:48.292984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813971+0000","last_change":"2024-09-12T12:14:33.367272+0000","last_active":"2024-09-12T12:16:25.813971+0000","last_peered":"2024-09-12T12:16:25.813971+0000","last_clean":"2024-09-12T12:16:25.813971+0000","last_became_active":"2024-09-12T12:14:33.366910+0000","last_became_peered":"2024-09-12T12:14:33.366910+0000","last_unstale":"2024-09-12T12:16:25.813971+0000","last_undegraded":"2024-09-12T12:16:25.813971+0000","last_fullsized":"2024-09-12T12:16:25.813971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:03.531738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575421+0000","last_change":"2024-09-12T12:14:35.366101+0000","last_active":"2024-09-12T12:16:25.575421+0000","last_peered":"2024-09-12T12:16:25.575421+0000","last_clean":"2024-09-12T12:16:25.575421+0000","last_became_active":"2024-09-12T12:14:35.365797+0000","last_became_peered":"2024-09-12T12:14:35.365797+0000","last_unstale":"2024-09-12T12:16:25.575421+0000","last_undegraded":"2024-09-12T12:16:25.575421+0000","last_fullsized":"2024-09-12T12:16:25.575421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:58.333337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'3","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659898+0000","last_change":"2024-09-12T12:14:33.364800+0000","last_active":"2024-09-12T12:16:25.659898+0000","last_peered":"2024-09-12T12:16:25.659898+0000","last_clean":"2024-09-12T12:16:25.659898+0000","last_became_active":"2024-09-12T12:14:33.364521+0000","last_became_peered":"2024-09-12T12:14:33.364521+0000","last_unstale":"2024-09-12T12:16:25.659898+0000","last_undegraded":"2024-09-12T12:16:25.659898+0000","last_fullsized":"2024-09-12T12:16:25.659898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:55.871355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"79'11","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651138+0000","last_change":"2024-09-12T12:14:35.364599+0000","last_active":"2024-09-12T12:16:25.651138+0000","last_peered":"2024-09-12T12:16:25.651138+0000","last_clean":"2024-09-12T12:16:25.651138+0000","last_became_active":"2024-09-12T12:14:35.364284+0000","last_became_peered":"2024-09-12T12:14:35.364284+0000","last_unstale":"2024-09-12T12:16:25.651138+0000","last_undegraded":"2024-09-12T12:16:25.651138+0000","last_fullsized":"2024-09-12T12:16:25.651138+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.345435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'6","reported_seq":230,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370090+0000","last_change":"2024-09-12T12:14:33.361402+0000","last_active":"2024-09-12T12:16:26.370090+0000","last_peered":"2024-09-12T12:16:26.370090+0000","last_clean":"2024-09-12T12:16:26.370090+0000","last_became_active":"2024-09-12T12:14:33.360964+0000","last_became_peered":"2024-09-12T12:14:33.360964+0000","last_unstale":"2024-09-12T12:16:26.370090+0000","last_undegraded":"2024-09-12T12:16:26.370090+0000","last_fullsized":"2024-09-12T12:16:26.370090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:18:10.215869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"79'10","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811788+0000","last_change":"2024-09-12T12:14:35.371982+0000","last_active":"2024-09-12T12:16:25.811788+0000","last_peered":"2024-09-12T12:16:25.811788+0000","last_clean":"2024-09-12T12:16:25.811788+0000","last_became_active":"2024-09-12T12:14:35.371447+0000","last_became_peered":"2024-09-12T12:14:35.371447+0000","last_unstale":"2024-09-12T12:16:25.811788+0000","last_undegraded":"2024-09-12T12:16:25.811788+0000","last_fullsized":"2024-09-12T12:16:25.811788+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:49.129612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811700+0000","last_change":"2024-09-12T12:14:33.367695+0000","last_active":"2024-09-12T12:16:25.811700+0000","last_peered":"2024-09-12T12:16:25.811700+0000","last_clean":"2024-09-12T12:16:25.811700+0000","last_became_active":"2024-09-12T12:14:33.367322+0000","last_became_peered":"2024-09-12T12:14:33.367322+0000","last_unstale":"2024-09-12T12:16:25.811700+0000","last_undegraded":"2024-09-12T12:16:25.811700+0000","last_fullsized":"2024-09-12T12:16:25.811700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:08.785107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814445+0000","last_change":"2024-09-12T12:14:35.367252+0000","last_active":"2024-09-12T12:16:25.814445+0000","last_peered":"2024-09-12T12:16:25.814445+0000","last_clean":"2024-09-12T12:16:25.814445+0000","last_became_active":"2024-09-12T12:14:35.366850+0000","last_became_peered":"2024-09-12T12:14:35.366850+0000","last_unstale":"2024-09-12T12:16:25.814445+0000","last_undegraded":"2024-09-12T12:16:25.814445+0000","last_fullsized":"2024-09-12T12:16:25.814445+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:18.875618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.660028+0000","last_change":"2024-09-12T12:14:33.430471+0000","last_active":"2024-09-12T12:16:25.660028+0000","last_peered":"2024-09-12T12:16:25.660028+0000","last_clean":"2024-09-12T12:16:25.660028+0000","last_became_active":"2024-09-12T12:14:33.429989+0000","last_became_peered":"2024-09-12T12:14:33.429989+0000","last_unstale":"2024-09-12T12:16:25.660028+0000","last_undegraded":"2024-09-12T12:16:25.660028+0000","last_fullsized":"2024-09-12T12:16:25.660028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:48.040283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"79'11","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811631+0000","last_change":"2024-09-12T12:14:50.228850+0000","last_active":"2024-09-12T12:16:25.811631+0000","last_peered":"2024-09-12T12:16:25.811631+0000","last_clean":"2024-09-12T12:16:25.811631+0000","last_became_active":"2024-09-12T12:14:50.228499+0000","last_became_peered":"2024-09-12T12:14:50.228499+0000","last_unstale":"2024-09-12T12:16:25.811631+0000","last_undegraded":"2024-09-12T12:16:25.811631+0000","last_fullsized":"2024-09-12T12:16:25.811631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:37.551174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'37","reported_seq":273,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370491+0000","last_change":"2024-09-12T12:14:33.363728+0000","last_active":"2024-09-12T12:16:26.370491+0000","last_peered":"2024-09-12T12:16:26.370491+0000","last_clean":"2024-09-12T12:16:26.370491+0000","last_became_active":"2024-09-12T12:14:33.363184+0000","last_became_peered":"2024-09-12T12:14:33.363184+0000","last_unstale":"2024-09-12T12:16:26.370491+0000","last_undegraded":"2024-09-12T12:16:26.370491+0000","last_fullsized":"2024-09-12T12:16:26.370491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:30.547163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":172,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653791+0000","last_change":"2024-09-12T12:14:35.365346+0000","last_active":"2024-09-12T12:16:25.653791+0000","last_peered":"2024-09-12T12:16:25.653791+0000","last_clean":"2024-09-12T12:16:25.653791+0000","last_became_active":"2024-09-12T12:14:35.364772+0000","last_became_peered":"2024-09-12T12:14:35.364772+0000","last_unstale":"2024-09-12T12:16:25.653791+0000","last_undegraded":"2024-09-12T12:16:25.653791+0000","last_fullsized":"2024-09-12T12:16:25.653791+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:55.138086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'9","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811304+0000","last_change":"2024-09-12T12:14:33.357194+0000","last_active":"2024-09-12T12:16:25.811304+0000","last_peered":"2024-09-12T12:16:25.811304+0000","last_clean":"2024-09-12T12:16:25.811304+0000","last_became_active":"2024-09-12T12:14:33.356693+0000","last_became_peered":"2024-09-12T12:14:33.356693+0000","last_unstale":"2024-09-12T12:16:25.811304+0000","last_undegraded":"2024-09-12T12:16:25.811304+0000","last_fullsized":"2024-09-12T12:16:25.811304+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:22.929823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814822+0000","last_change":"2024-09-12T12:14:35.373265+0000","last_active":"2024-09-12T12:16:25.814822+0000","last_peered":"2024-09-12T12:16:25.814822+0000","last_clean":"2024-09-12T12:16:25.814822+0000","last_became_active":"2024-09-12T12:14:35.372919+0000","last_became_peered":"2024-09-12T12:14:35.372919+0000","last_unstale":"2024-09-12T12:16:25.814822+0000","last_undegraded":"2024-09-12T12:16:25.814822+0000","last_fullsized":"2024-09-12T12:16:25.814822+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:15.394179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659718+0000","last_change":"2024-09-12T12:14:33.366757+0000","last_active":"2024-09-12T12:16:25.659718+0000","last_peered":"2024-09-12T12:16:25.659718+0000","last_clean":"2024-09-12T12:16:25.659718+0000","last_became_active":"2024-09-12T12:14:33.366318+0000","last_became_peered":"2024-09-12T12:14:33.366318+0000","last_unstale":"2024-09-12T12:16:25.659718+0000","last_undegraded":"2024-09-12T12:16:25.659718+0000","last_fullsized":"2024-09-12T12:16:25.659718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:09.778387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"79'15","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811513+0000","last_change":"2024-09-12T12:14:35.366589+0000","last_active":"2024-09-12T12:16:25.811513+0000","last_peered":"2024-09-12T12:16:25.811513+0000","last_clean":"2024-09-12T12:16:25.811513+0000","last_became_active":"2024-09-12T12:14:35.366224+0000","last_became_peered":"2024-09-12T12:14:35.366224+0000","last_unstale":"2024-09-12T12:16:25.811513+0000","last_undegraded":"2024-09-12T12:16:25.811513+0000","last_fullsized":"2024-09-12T12:16:25.811513+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:12.123752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'7","reported_seq":134,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.387044+0000","last_change":"2024-09-12T12:14:33.367261+0000","last_active":"2024-09-12T12:16:26.387044+0000","last_peered":"2024-09-12T12:16:26.387044+0000","last_clean":"2024-09-12T12:16:26.387044+0000","last_became_active":"2024-09-12T12:14:33.366725+0000","last_became_peered":"2024-09-12T12:14:33.366725+0000","last_unstale":"2024-09-12T12:16:26.387044+0000","last_undegraded":"2024-09-12T12:16:26.387044+0000","last_fullsized":"2024-09-12T12:16:26.387044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:42.619564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811102+0000","last_change":"2024-09-12T12:14:35.367040+0000","last_active":"2024-09-12T12:16:25.811102+0000","last_peered":"2024-09-12T12:16:25.811102+0000","last_clean":"2024-09-12T12:16:25.811102+0000","last_became_active":"2024-09-12T12:14:35.366707+0000","last_became_peered":"2024-09-12T12:14:35.366707+0000","last_unstale":"2024-09-12T12:16:25.811102+0000","last_undegraded":"2024-09-12T12:16:25.811102+0000","last_fullsized":"2024-09-12T12:16:25.811102+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:03:36.529082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'17","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653405+0000","last_change":"2024-09-12T12:14:33.430574+0000","last_active":"2024-09-12T12:16:25.653405+0000","last_peered":"2024-09-12T12:16:25.653405+0000","last_clean":"2024-09-12T12:16:25.653405+0000","last_became_active":"2024-09-12T12:14:33.429663+0000","last_became_peered":"2024-09-12T12:14:33.429663+0000","last_unstale":"2024-09-12T12:16:25.653405+0000","last_undegraded":"2024-09-12T12:16:25.653405+0000","last_fullsized":"2024-09-12T12:16:25.653405+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:48:31.942915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659683+0000","last_change":"2024-09-12T12:14:35.374319+0000","last_active":"2024-09-12T12:16:25.659683+0000","last_peered":"2024-09-12T12:16:25.659683+0000","last_clean":"2024-09-12T12:16:25.659683+0000","last_became_active":"2024-09-12T12:14:35.373964+0000","last_became_peered":"2024-09-12T12:14:35.373964+0000","last_unstale":"2024-09-12T12:16:25.659683+0000","last_undegraded":"2024-09-12T12:16:25.659683+0000","last_fullsized":"2024-09-12T12:16:25.659683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:14.133329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653711+0000","last_change":"2024-09-12T12:14:33.367133+0000","last_active":"2024-09-12T12:16:25.653711+0000","last_peered":"2024-09-12T12:16:25.653711+0000","last_clean":"2024-09-12T12:16:25.653711+0000","last_became_active":"2024-09-12T12:14:33.366739+0000","last_became_peered":"2024-09-12T12:14:33.366739+0000","last_unstale":"2024-09-12T12:16:25.653711+0000","last_undegraded":"2024-09-12T12:16:25.653711+0000","last_fullsized":"2024-09-12T12:16:25.653711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:51.952673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576477+0000","last_change":"2024-09-12T12:14:35.368890+0000","last_active":"2024-09-12T12:16:25.576477+0000","last_peered":"2024-09-12T12:16:25.576477+0000","last_clean":"2024-09-12T12:16:25.576477+0000","last_became_active":"2024-09-12T12:14:35.368518+0000","last_became_peered":"2024-09-12T12:14:35.368518+0000","last_unstale":"2024-09-12T12:16:25.576477+0000","last_undegraded":"2024-09-12T12:16:25.576477+0000","last_fullsized":"2024-09-12T12:16:25.576477+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:34.468737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'5","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815235+0000","last_change":"2024-09-12T12:14:33.356800+0000","last_active":"2024-09-12T12:16:25.815235+0000","last_peered":"2024-09-12T12:16:25.815235+0000","last_clean":"2024-09-12T12:16:25.815235+0000","last_became_active":"2024-09-12T12:14:33.356426+0000","last_became_peered":"2024-09-12T12:14:33.356426+0000","last_unstale":"2024-09-12T12:16:25.815235+0000","last_undegraded":"2024-09-12T12:16:25.815235+0000","last_fullsized":"2024-09-12T12:16:25.815235+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:16.241210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811637+0000","last_change":"2024-09-12T12:14:35.368527+0000","last_active":"2024-09-12T12:16:25.811637+0000","last_peered":"2024-09-12T12:16:25.811637+0000","last_clean":"2024-09-12T12:16:25.811637+0000","last_became_active":"2024-09-12T12:14:35.368172+0000","last_became_peered":"2024-09-12T12:14:35.368172+0000","last_unstale":"2024-09-12T12:16:25.811637+0000","last_undegraded":"2024-09-12T12:16:25.811637+0000","last_fullsized":"2024-09-12T12:16:25.811637+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:33.447255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'41","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.766366+0000","last_change":"2024-09-12T12:14:33.358475+0000","last_active":"2024-09-12T12:16:25.766366+0000","last_peered":"2024-09-12T12:16:25.766366+0000","last_clean":"2024-09-12T12:16:25.766366+0000","last_became_active":"2024-09-12T12:14:33.357941+0000","last_became_peered":"2024-09-12T12:14:33.357941+0000","last_unstale":"2024-09-12T12:16:25.766366+0000","last_undegraded":"2024-09-12T12:16:25.766366+0000","last_fullsized":"2024-09-12T12:16:25.766366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:03:22.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811859+0000","last_change":"2024-09-12T12:14:35.367314+0000","last_active":"2024-09-12T12:16:25.811859+0000","last_peered":"2024-09-12T12:16:25.811859+0000","last_clean":"2024-09-12T12:16:25.811859+0000","last_became_active":"2024-09-12T12:14:35.366969+0000","last_became_peered":"2024-09-12T12:14:35.366969+0000","last_unstale":"2024-09-12T12:16:25.811859+0000","last_undegraded":"2024-09-12T12:16:25.811859+0000","last_fullsized":"2024-09-12T12:16:25.811859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:33.584205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":133,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.395287+0000","last_change":"2024-09-12T12:14:33.430353+0000","last_active":"2024-09-12T12:16:26.395287+0000","last_peered":"2024-09-12T12:16:26.395287+0000","last_clean":"2024-09-12T12:16:26.395287+0000","last_became_active":"2024-09-12T12:14:33.430021+0000","last_became_peered":"2024-09-12T12:14:33.430021+0000","last_unstale":"2024-09-12T12:16:26.395287+0000","last_undegraded":"2024-09-12T12:16:26.395287+0000","last_fullsized":"2024-09-12T12:16:26.395287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:34.833378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811703+0000","last_change":"2024-09-12T12:14:35.377241+0000","last_active":"2024-09-12T12:16:25.811703+0000","last_peered":"2024-09-12T12:16:25.811703+0000","last_clean":"2024-09-12T12:16:25.811703+0000","last_became_active":"2024-09-12T12:14:35.376901+0000","last_became_peered":"2024-09-12T12:14:35.376901+0000","last_unstale":"2024-09-12T12:16:25.811703+0000","last_undegraded":"2024-09-12T12:16:25.811703+0000","last_fullsized":"2024-09-12T12:16:25.811703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:43.456965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":344,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811434+0000","last_change":"2024-09-12T12:13:23.685541+0000","last_active":"2024-09-12T12:16:25.811434+0000","last_peered":"2024-09-12T12:16:25.811434+0000","last_clean":"2024-09-12T12:16:25.811434+0000","last_became_active":"2024-09-12T12:13:23.685003+0000","last_became_peered":"2024-09-12T12:13:23.685003+0000","last_unstale":"2024-09-12T12:16:25.811434+0000","last_undegraded":"2024-09-12T12:16:25.811434+0000","last_fullsized":"2024-09-12T12:16:25.811434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:10:05.234145+0000","last_clean_scrub_stamp":"2024-09-12T12:10:05.234145+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:43.316664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813491+0000","last_change":"2024-09-12T12:14:33.363469+0000","last_active":"2024-09-12T12:16:25.813491+0000","last_peered":"2024-09-12T12:16:25.813491+0000","last_clean":"2024-09-12T12:16:25.813491+0000","last_became_active":"2024-09-12T12:14:33.363046+0000","last_became_peered":"2024-09-12T12:14:33.363046+0000","last_unstale":"2024-09-12T12:16:25.813491+0000","last_undegraded":"2024-09-12T12:16:25.813491+0000","last_fullsized":"2024-09-12T12:16:25.813491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:36.849024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"79'8","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651199+0000","last_change":"2024-09-12T12:14:50.222039+0000","last_active":"2024-09-12T12:16:25.651199+0000","last_peered":"2024-09-12T12:16:25.651199+0000","last_clean":"2024-09-12T12:16:25.651199+0000","last_became_active":"2024-09-12T12:14:50.221671+0000","last_became_peered":"2024-09-12T12:14:50.221671+0000","last_unstale":"2024-09-12T12:16:25.651199+0000","last_undegraded":"2024-09-12T12:16:25.651199+0000","last_fullsized":"2024-09-12T12:16:25.651199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.818700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"77'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811305+0000","last_change":"2024-09-12T12:14:33.366025+0000","last_active":"2024-09-12T12:16:25.811305+0000","last_peered":"2024-09-12T12:16:25.811305+0000","last_clean":"2024-09-12T12:16:25.811305+0000","last_became_active":"2024-09-12T12:14:33.365572+0000","last_became_peered":"2024-09-12T12:14:33.365572+0000","last_unstale":"2024-09-12T12:16:25.811305+0000","last_undegraded":"2024-09-12T12:16:25.811305+0000","last_fullsized":"2024-09-12T12:16:25.811305+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:47.583031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813833+0000","last_change":"2024-09-12T12:14:35.365087+0000","last_active":"2024-09-12T12:16:25.813833+0000","last_peered":"2024-09-12T12:16:25.813833+0000","last_clean":"2024-09-12T12:16:25.813833+0000","last_became_active":"2024-09-12T12:14:35.364787+0000","last_became_peered":"2024-09-12T12:14:35.364787+0000","last_unstale":"2024-09-12T12:16:25.813833+0000","last_undegraded":"2024-09-12T12:16:25.813833+0000","last_fullsized":"2024-09-12T12:16:25.813833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:30:18.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'6","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:30.392373+0000","last_change":"2024-09-12T12:14:33.430002+0000","last_active":"2024-09-12T12:16:30.392373+0000","last_peered":"2024-09-12T12:16:30.392373+0000","last_clean":"2024-09-12T12:16:30.392373+0000","last_became_active":"2024-09-12T12:14:33.429665+0000","last_became_peered":"2024-09-12T12:14:33.429665+0000","last_unstale":"2024-09-12T12:16:30.392373+0000","last_undegraded":"2024-09-12T12:16:30.392373+0000","last_fullsized":"2024-09-12T12:16:30.392373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:41.381848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.659672+0000","last_change":"2024-09-12T12:14:35.365958+0000","last_active":"2024-09-12T12:16:25.659672+0000","last_peered":"2024-09-12T12:16:25.659672+0000","last_clean":"2024-09-12T12:16:25.659672+0000","last_became_active":"2024-09-12T12:14:35.365570+0000","last_became_peered":"2024-09-12T12:14:35.365570+0000","last_unstale":"2024-09-12T12:16:25.659672+0000","last_undegraded":"2024-09-12T12:16:25.659672+0000","last_fullsized":"2024-09-12T12:16:25.659672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T16:09:12.386943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'9","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:26.370629+0000","last_change":"2024-09-12T12:14:33.364449+0000","last_active":"2024-09-12T12:16:26.370629+0000","last_peered":"2024-09-12T12:16:26.370629+0000","last_clean":"2024-09-12T12:16:26.370629+0000","last_became_active":"2024-09-12T12:14:33.364109+0000","last_became_peered":"2024-09-12T12:14:33.364109+0000","last_unstale":"2024-09-12T12:16:26.370629+0000","last_undegraded":"2024-09-12T12:16:26.370629+0000","last_fullsized":"2024-09-12T12:16:26.370629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:36.282275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578900+0000","last_change":"2024-09-12T12:14:35.365957+0000","last_active":"2024-09-12T12:16:25.578900+0000","last_peered":"2024-09-12T12:16:25.578900+0000","last_clean":"2024-09-12T12:16:25.578900+0000","last_became_active":"2024-09-12T12:14:35.365410+0000","last_became_peered":"2024-09-12T12:14:35.365410+0000","last_unstale":"2024-09-12T12:16:25.578900+0000","last_undegraded":"2024-09-12T12:16:25.578900+0000","last_fullsized":"2024-09-12T12:16:25.578900+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:48.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"77'1","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651372+0000","last_change":"2024-09-12T12:14:50.225099+0000","last_active":"2024-09-12T12:16:25.651372+0000","last_peered":"2024-09-12T12:16:25.651372+0000","last_clean":"2024-09-12T12:16:25.651372+0000","last_became_active":"2024-09-12T12:14:50.224682+0000","last_became_peered":"2024-09-12T12:14:50.224682+0000","last_unstale":"2024-09-12T12:16:25.651372+0000","last_undegraded":"2024-09-12T12:16:25.651372+0000","last_fullsized":"2024-09-12T12:16:25.651372+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:54:37.024528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.578995+0000","last_change":"2024-09-12T12:14:35.360419+0000","last_active":"2024-09-12T12:16:25.578995+0000","last_peered":"2024-09-12T12:16:25.578995+0000","last_clean":"2024-09-12T12:16:25.578995+0000","last_became_active":"2024-09-12T12:14:35.360044+0000","last_became_peered":"2024-09-12T12:14:35.360044+0000","last_unstale":"2024-09-12T12:16:25.578995+0000","last_undegraded":"2024-09-12T12:16:25.578995+0000","last_fullsized":"2024-09-12T12:16:25.578995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:04.239720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653785+0000","last_change":"2024-09-12T12:14:33.430828+0000","last_active":"2024-09-12T12:16:25.653785+0000","last_peered":"2024-09-12T12:16:25.653785+0000","last_clean":"2024-09-12T12:16:25.653785+0000","last_became_active":"2024-09-12T12:14:33.430162+0000","last_became_peered":"2024-09-12T12:14:33.430162+0000","last_unstale":"2024-09-12T12:16:25.653785+0000","last_undegraded":"2024-09-12T12:16:25.653785+0000","last_fullsized":"2024-09-12T12:16:25.653785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:50.740632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.815468+0000","last_change":"2024-09-12T12:14:35.363331+0000","last_active":"2024-09-12T12:16:25.815468+0000","last_peered":"2024-09-12T12:16:25.815468+0000","last_clean":"2024-09-12T12:16:25.815468+0000","last_became_active":"2024-09-12T12:14:35.363017+0000","last_became_peered":"2024-09-12T12:14:35.363017+0000","last_unstale":"2024-09-12T12:16:25.815468+0000","last_undegraded":"2024-09-12T12:16:25.815468+0000","last_fullsized":"2024-09-12T12:16:25.815468+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:23.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'104","reported_seq":220,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:27.766629+0000","last_change":"2024-09-12T12:14:33.356988+0000","last_active":"2024-09-12T12:16:27.766629+0000","last_peered":"2024-09-12T12:16:27.766629+0000","last_clean":"2024-09-12T12:16:27.766629+0000","last_became_active":"2024-09-12T12:14:33.356481+0000","last_became_peered":"2024-09-12T12:14:33.356481+0000","last_unstale":"2024-09-12T12:16:27.766629+0000","last_undegraded":"2024-09-12T12:16:27.766629+0000","last_fullsized":"2024-09-12T12:16:27.766629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:57.137221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":190,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575751+0000","last_change":"2024-09-12T12:14:35.366973+0000","last_active":"2024-09-12T12:16:25.575751+0000","last_peered":"2024-09-12T12:16:25.575751+0000","last_clean":"2024-09-12T12:16:25.575751+0000","last_became_active":"2024-09-12T12:14:35.366678+0000","last_became_peered":"2024-09-12T12:14:35.366678+0000","last_unstale":"2024-09-12T12:16:25.575751+0000","last_undegraded":"2024-09-12T12:16:25.575751+0000","last_fullsized":"2024-09-12T12:16:25.575751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:49.013375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.813681+0000","last_change":"2024-09-12T12:14:33.365917+0000","last_active":"2024-09-12T12:16:25.813681+0000","last_peered":"2024-09-12T12:16:25.813681+0000","last_clean":"2024-09-12T12:16:25.813681+0000","last_became_active":"2024-09-12T12:14:33.365614+0000","last_became_peered":"2024-09-12T12:14:33.365614+0000","last_unstale":"2024-09-12T12:16:25.813681+0000","last_undegraded":"2024-09-12T12:16:25.813681+0000","last_fullsized":"2024-09-12T12:16:25.813681+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:09.954969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"79'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814073+0000","last_change":"2024-09-12T12:14:35.365649+0000","last_active":"2024-09-12T12:16:25.814073+0000","last_peered":"2024-09-12T12:16:25.814073+0000","last_clean":"2024-09-12T12:16:25.814073+0000","last_became_active":"2024-09-12T12:14:35.365120+0000","last_became_peered":"2024-09-12T12:14:35.365120+0000","last_unstale":"2024-09-12T12:16:25.814073+0000","last_undegraded":"2024-09-12T12:16:25.814073+0000","last_fullsized":"2024-09-12T12:16:25.814073+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:49.776765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811290+0000","last_change":"2024-09-12T12:14:33.429957+0000","last_active":"2024-09-12T12:16:25.811290+0000","last_peered":"2024-09-12T12:16:25.811290+0000","last_clean":"2024-09-12T12:16:25.811290+0000","last_became_active":"2024-09-12T12:14:33.429644+0000","last_became_peered":"2024-09-12T12:14:33.429644+0000","last_unstale":"2024-09-12T12:16:25.811290+0000","last_undegraded":"2024-09-12T12:16:25.811290+0000","last_fullsized":"2024-09-12T12:16:25.811290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:44.226131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"79'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653400+0000","last_change":"2024-09-12T12:14:35.363677+0000","last_active":"2024-09-12T12:16:25.653400+0000","last_peered":"2024-09-12T12:16:25.653400+0000","last_clean":"2024-09-12T12:16:25.653400+0000","last_became_active":"2024-09-12T12:14:35.363338+0000","last_became_peered":"2024-09-12T12:14:35.363338+0000","last_unstale":"2024-09-12T12:16:25.653400+0000","last_undegraded":"2024-09-12T12:16:25.653400+0000","last_fullsized":"2024-09-12T12:16:25.653400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:36.496667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575545+0000","last_change":"2024-09-12T12:14:33.355884+0000","last_active":"2024-09-12T12:16:25.575545+0000","last_peered":"2024-09-12T12:16:25.575545+0000","last_clean":"2024-09-12T12:16:25.575545+0000","last_became_active":"2024-09-12T12:14:33.355495+0000","last_became_peered":"2024-09-12T12:14:33.355495+0000","last_unstale":"2024-09-12T12:16:25.575545+0000","last_undegraded":"2024-09-12T12:16:25.575545+0000","last_fullsized":"2024-09-12T12:16:25.575545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:25.128437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576327+0000","last_change":"2024-09-12T12:14:35.371926+0000","last_active":"2024-09-12T12:16:25.576327+0000","last_peered":"2024-09-12T12:16:25.576327+0000","last_clean":"2024-09-12T12:16:25.576327+0000","last_became_active":"2024-09-12T12:14:35.371235+0000","last_became_peered":"2024-09-12T12:14:35.371235+0000","last_unstale":"2024-09-12T12:16:25.576327+0000","last_undegraded":"2024-09-12T12:16:25.576327+0000","last_fullsized":"2024-09-12T12:16:25.576327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.641096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811273+0000","last_change":"2024-09-12T12:14:33.357506+0000","last_active":"2024-09-12T12:16:25.811273+0000","last_peered":"2024-09-12T12:16:25.811273+0000","last_clean":"2024-09-12T12:16:25.811273+0000","last_became_active":"2024-09-12T12:14:33.356631+0000","last_became_peered":"2024-09-12T12:14:33.356631+0000","last_unstale":"2024-09-12T12:16:25.811273+0000","last_undegraded":"2024-09-12T12:16:25.811273+0000","last_fullsized":"2024-09-12T12:16:25.811273+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:36.629266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"79'8","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575689+0000","last_change":"2024-09-12T12:14:35.361828+0000","last_active":"2024-09-12T12:16:25.575689+0000","last_peered":"2024-09-12T12:16:25.575689+0000","last_clean":"2024-09-12T12:16:25.575689+0000","last_became_active":"2024-09-12T12:14:35.361519+0000","last_became_peered":"2024-09-12T12:14:35.361519+0000","last_unstale":"2024-09-12T12:16:25.575689+0000","last_undegraded":"2024-09-12T12:16:25.575689+0000","last_fullsized":"2024-09-12T12:16:25.575689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:07.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653576+0000","last_change":"2024-09-12T12:14:33.365549+0000","last_active":"2024-09-12T12:16:25.653576+0000","last_peered":"2024-09-12T12:16:25.653576+0000","last_clean":"2024-09-12T12:16:25.653576+0000","last_became_active":"2024-09-12T12:14:33.365236+0000","last_became_peered":"2024-09-12T12:14:33.365236+0000","last_unstale":"2024-09-12T12:16:25.653576+0000","last_undegraded":"2024-09-12T12:16:25.653576+0000","last_fullsized":"2024-09-12T12:16:25.653576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:48.595195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.812075+0000","last_change":"2024-09-12T12:14:35.377365+0000","last_active":"2024-09-12T12:16:25.812075+0000","last_peered":"2024-09-12T12:16:25.812075+0000","last_clean":"2024-09-12T12:16:25.812075+0000","last_became_active":"2024-09-12T12:14:35.377002+0000","last_became_peered":"2024-09-12T12:14:35.377002+0000","last_unstale":"2024-09-12T12:16:25.812075+0000","last_undegraded":"2024-09-12T12:16:25.812075+0000","last_fullsized":"2024-09-12T12:16:25.812075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:23:00.664237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"79'15","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.651379+0000","last_change":"2024-09-12T12:14:50.231889+0000","last_active":"2024-09-12T12:16:25.651379+0000","last_peered":"2024-09-12T12:16:25.651379+0000","last_clean":"2024-09-12T12:16:25.651379+0000","last_became_active":"2024-09-12T12:14:50.231533+0000","last_became_peered":"2024-09-12T12:14:50.231533+0000","last_unstale":"2024-09-12T12:16:25.651379+0000","last_undegraded":"2024-09-12T12:16:25.651379+0000","last_fullsized":"2024-09-12T12:16:25.651379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:04.192012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"77'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.653704+0000","last_change":"2024-09-12T12:14:33.363313+0000","last_active":"2024-09-12T12:16:25.653704+0000","last_peered":"2024-09-12T12:16:25.653704+0000","last_clean":"2024-09-12T12:16:25.653704+0000","last_became_active":"2024-09-12T12:14:33.362804+0000","last_became_peered":"2024-09-12T12:14:33.362804+0000","last_unstale":"2024-09-12T12:16:25.653704+0000","last_undegraded":"2024-09-12T12:16:25.653704+0000","last_fullsized":"2024-09-12T12:16:25.653704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:07.551328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"79'9","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.811479+0000","last_change":"2024-09-12T12:14:35.371040+0000","last_active":"2024-09-12T12:16:25.811479+0000","last_peered":"2024-09-12T12:16:25.811479+0000","last_clean":"2024-09-12T12:16:25.811479+0000","last_became_active":"2024-09-12T12:14:35.370659+0000","last_became_peered":"2024-09-12T12:14:35.370659+0000","last_unstale":"2024-09-12T12:16:25.811479+0000","last_undegraded":"2024-09-12T12:16:25.811479+0000","last_fullsized":"2024-09-12T12:16:25.811479+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:20.910268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'13","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.576415+0000","last_change":"2024-09-12T12:14:50.241069+0000","last_active":"2024-09-12T12:16:25.576415+0000","last_peered":"2024-09-12T12:16:25.576415+0000","last_clean":"2024-09-12T12:16:25.576415+0000","last_became_active":"2024-09-12T12:14:50.229369+0000","last_became_peered":"2024-09-12T12:14:50.229369+0000","last_unstale":"2024-09-12T12:16:25.576415+0000","last_undegraded":"2024-09-12T12:16:25.576415+0000","last_fullsized":"2024-09-12T12:16:25.576415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:24:14.966387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"79'6","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.814378+0000","last_change":"2024-09-12T12:14:35.366417+0000","last_active":"2024-09-12T12:16:25.814378+0000","last_peered":"2024-09-12T12:16:25.814378+0000","last_clean":"2024-09-12T12:16:25.814378+0000","last_became_active":"2024-09-12T12:14:35.364653+0000","last_became_peered":"2024-09-12T12:14:35.364653+0000","last_unstale":"2024-09-12T12:16:25.814378+0000","last_undegraded":"2024-09-12T12:16:25.814378+0000","last_fullsized":"2024-09-12T12:16:25.814378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.774134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575782+0000","last_change":"2024-09-12T12:14:33.430023+0000","last_active":"2024-09-12T12:16:25.575782+0000","last_peered":"2024-09-12T12:16:25.575782+0000","last_clean":"2024-09-12T12:16:25.575782+0000","last_became_active":"2024-09-12T12:14:33.429649+0000","last_became_peered":"2024-09-12T12:14:33.429649+0000","last_unstale":"2024-09-12T12:16:25.575782+0000","last_undegraded":"2024-09-12T12:16:25.575782+0000","last_fullsized":"2024-09-12T12:16:25.575782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:10:51.608270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"79'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:25.575667+0000","last_change":"2024-09-12T12:14:35.363673+0000","last_active":"2024-09-12T12:16:25.575667+0000","last_peered":"2024-09-12T12:16:25.575667+0000","last_clean":"2024-09-12T12:16:25.575667+0000","last_became_active":"2024-09-12T12:14:35.363374+0000","last_became_peered":"2024-09-12T12:14:35.363374+0000","last_unstale":"2024-09-12T12:16:25.575667+0000","last_undegraded":"2024-09-12T12:16:25.575667+0000","last_fullsized":"2024-09-12T12:16:25.575667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:34.343683+0000","last_clean_scrub_stamp":"2024-09-12T12:14:34.343683+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:26.979898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"79'14","reported_seq":144,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T12:16:30.375010+0000","last_change":"2024-09-12T12:14:33.367763+0000","last_active":"2024-09-12T12:16:30.375010+0000","last_peered":"2024-09-12T12:16:30.375010+0000","last_clean":"2024-09-12T12:16:30.375010+0000","last_became_active":"2024-09-12T12:14:33.367426+0000","last_became_peered":"2024-09-12T12:14:33.367426+0000","last_unstale":"2024-09-12T12:16:30.375010+0000","last_undegraded":"2024-09-12T12:16:30.375010+0000","last_fullsized":"2024-09-12T12:16:30.375010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T12:14:32.334225+0000","last_clean_scrub_stamp":"2024-09-12T12:14:32.334225+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:13.574302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601059,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1381,"num_read_kb":905,"num_write":476,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2371584,"data_stored":1999809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678051,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":884736,"data_stored":432078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1221973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1302528,"data_stored":825224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1298432,"data_stored":825602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528374,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712496,"statfs":{"total":95995035648,"available":95961595904,"internally_reserved":0,"allocated":1503232,"data_stored":1027461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":432960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1156718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":422717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28740,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716412,"statfs":{"total":95995035648,"available":95965605888,"internally_reserved":0,"allocated":1634304,"data_stored":1152998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":983040,"data_stored":500658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":962560,"data_stored":500353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":913408,"data_stored":433457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":753664,"data_stored":721878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":135347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":200602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T12:16:33.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:16:33.290 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:33.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 -- 172.21.15.81:0/2002504371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 msgr2=0x7f5a4c100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 --2- 172.21.15.81:0/2002504371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c100730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009930 tx=0x7f5a4002a420 comp rx=0 tx=0).stop 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 -- 172.21.15.81:0/2002504371 shutdown_connections 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 --2- 172.21.15.81:0/2002504371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 0x7f5a4c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 --2- 172.21.15.81:0/2002504371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 0x7f5a4c106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 --2- 172.21.15.81:0/2002504371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c100730 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 -- 172.21.15.81:0/2002504371 >> 172.21.15.81:0/2002504371 conn(0x7f5a4c077210 msgr2=0x7f5a4c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 -- 172.21.15.81:0/2002504371 shutdown_connections 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 -- 172.21.15.81:0/2002504371 wait complete. 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 Processor -- start 2024-09-12T12:16:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.752+0000 7f5a5331a640 1 -- start start 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 0x7f5a4c198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 0x7f5a4c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c1121c0 con 0x7f5a4c100350 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c112040 con 0x7f5a4c106f50 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c112340 con 0x7f5a4c100d00 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55348/0 (socket says 172.21.15.81:55348) 2024-09-12T12:16:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 -- 172.21.15.81:0/1960191762 learned_addr learned my addr 172.21.15.81:0/1960191762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a508b5640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 0x7f5a4c198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a518b7640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 0x7f5a4c19cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 -- 172.21.15.81:0/1960191762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 msgr2=0x7f5a4c198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 0x7f5a4c198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 -- 172.21.15.81:0/1960191762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 msgr2=0x7f5a4c19cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 0x7f5a4c19cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 -- 172.21.15.81:0/1960191762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c19d6c0 con 0x7f5a4c100350 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a518b7640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 0x7f5a4c19cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a508b5640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 0x7f5a4c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a510b6640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c198710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009a50 tx=0x7f5a40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4003f030 con 0x7f5a4c100350 2024-09-12T12:16:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5a40003af0 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c19d950 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a40035070 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.753+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c1a5290 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.754+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c103410 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.756+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f5a40042030 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.757+0000 7f5a3e7fc640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a380a2d80 0x7f5a380a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.757+0000 7f5a508b5640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a380a2d80 0x7f5a380a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.757+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f5a400f0360 con 0x7f5a4c100350 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.757+0000 7f5a508b5640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a380a2d80 0x7f5a380a5240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0ff860 tx=0x7f5a48008040 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.760+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a400bce80 con 0x7f5a4c100350 2024-09-12T12:16:33.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.961+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a4c1007b0 con 0x7f5a4c100350 2024-09-12T12:16:33.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.961+0000 7f5a3e7fc640 1 -- 172.21.15.81:0/1960191762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11982 (secure 0 0 0) 0x7f5a400bc780 con 0x7f5a4c100350 2024-09-12T12:16:33.962 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:33.962 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T12:16:24:277939+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:16:24.227728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:16:33.962 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T12:16:33.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a380a2d80 msgr2=0x7f5a380a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a380a2d80 0x7f5a380a5240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0ff860 tx=0x7f5a48008040 comp rx=0 tx=0).stop 2024-09-12T12:16:33.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 msgr2=0x7f5a4c198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c198710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009a50 tx=0x7f5a40004270 comp rx=0 tx=0).stop 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 shutdown_connections 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a380a2d80 0x7f5a380a5240 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a4c106f50 0x7f5a4c19cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a4c100d00 0x7f5a4c198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 --2- 172.21.15.81:0/1960191762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a4c100350 0x7f5a4c198710 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:33.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 >> 172.21.15.81:0/1960191762 conn(0x7f5a4c077210 msgr2=0x7f5a4c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 shutdown_connections 2024-09-12T12:16:33.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:33.964+0000 7f5a5331a640 1 -- 172.21.15.81:0/1960191762 wait complete. 2024-09-12T12:16:34.693 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:34 smithi081 ceph-mon[30948]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 131 KiB/s wr, 78 op/s 2024-09-12T12:16:34.693 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:34 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1960191762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:34.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:16:34.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:34 smithi173 ceph-mon[35326]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 131 KiB/s wr, 78 op/s 2024-09-12T12:16:34.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:34 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1960191762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:34.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:34 smithi103 ceph-mon[35094]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 131 KiB/s wr, 78 op/s 2024-09-12T12:16:34.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:34 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1960191762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 -- 172.21.15.81:0/3522022193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 msgr2=0x7f17e410bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 --2- 172.21.15.81:0/3522022193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e410bc20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009900 tx=0x7f17d802a480 comp rx=0 tx=0).stop 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 -- 172.21.15.81:0/3522022193 shutdown_connections 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 --2- 172.21.15.81:0/3522022193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e410c1b0 0x7f17e410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 --2- 172.21.15.81:0/3522022193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e410bc20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 --2- 172.21.15.81:0/3522022193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e4102e10 0x7f17e41031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 -- 172.21.15.81:0/3522022193 >> 172.21.15.81:0/3522022193 conn(0x7f17e40fc7d0 msgr2=0x7f17e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 -- 172.21.15.81:0/3522022193 shutdown_connections 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 -- 172.21.15.81:0/3522022193 wait complete. 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.402+0000 7f17e9547640 1 Processor -- start 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 -- start start 2024-09-12T12:16:35.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e4102e10 0x7f17e4100a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e4100fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e410c1b0 0x7f17e41014f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17e4112120 con 0x7f17e4103730 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17e4111fa0 con 0x7f17e4102e10 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e9547640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41122a0 con 0x7f17e410c1b0 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e4100fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e4100fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55360/0 (socket says 172.21.15.81:55360) 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 -- 172.21.15.81:0/4026488726 learned_addr learned my addr 172.21.15.81:0/4026488726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e2ffd640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e4102e10 0x7f17e4100a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e37fe640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e410c1b0 0x7f17e41014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 -- 172.21.15.81:0/4026488726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e410c1b0 msgr2=0x7f17e41014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e410c1b0 0x7f17e41014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 -- 172.21.15.81:0/4026488726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e4102e10 msgr2=0x7f17e4100a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e4102e10 0x7f17e4100a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 -- 172.21.15.81:0/4026488726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e41a6a80 con 0x7f17e4103730 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e37fe640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e410c1b0 0x7f17e41014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.403+0000 7f17e27fc640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e4100fb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17d8006010 tx=0x7f17d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.404+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d803f030 con 0x7f17e4103730 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.404+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17d8003d00 con 0x7f17e4103730 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.404+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e41a6d10 con 0x7f17e4103730 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.404+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d8035070 con 0x7f17e4103730 2024-09-12T12:16:35.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.404+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e41a71a0 con 0x7f17e4103730 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.405+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e41031f0 con 0x7f17e4103730 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.406+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f17d8042030 con 0x7f17e4103730 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.407+0000 7f17cbfff640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17cc0a2d80 0x7f17cc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.407+0000 7f17e2ffd640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17cc0a2d80 0x7f17cc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.407+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f17d80efab0 con 0x7f17e4103730 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.407+0000 7f17e2ffd640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17cc0a2d80 0x7f17cc0a5240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005fd0 tx=0x7f17d400b390 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:35.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.411+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17d80bc690 con 0x7f17e4103730 2024-09-12T12:16:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.611+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17e402d7c0 con 0x7f17e4103730 2024-09-12T12:16:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.611+0000 7f17cbfff640 1 -- 172.21.15.81:0/4026488726 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11982 (secure 0 0 0) 0x7f17d80bbf90 con 0x7f17e4103730 2024-09-12T12:16:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:35.613 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T12:16:24:277939+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:16:24.227728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17cc0a2d80 msgr2=0x7f17cc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17cc0a2d80 0x7f17cc0a5240 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005fd0 tx=0x7f17d400b390 comp rx=0 tx=0).stop 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 msgr2=0x7f17e4100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e4100fb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17d8006010 tx=0x7f17d80042f0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 shutdown_connections 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17cc0a2d80 0x7f17cc0a5240 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17e410c1b0 0x7f17e41014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e4103730 0x7f17e4100fb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 --2- 172.21.15.81:0/4026488726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e4102e10 0x7f17e4100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 >> 172.21.15.81:0/4026488726 conn(0x7f17e40fc7d0 msgr2=0x7f17e40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 shutdown_connections 2024-09-12T12:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:35.614+0000 7f17e9547640 1 -- 172.21.15.81:0/4026488726 wait complete. 2024-09-12T12:16:35.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:35 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/4026488726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:35 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/4026488726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:35 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/4026488726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:36.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:16:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:36.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:36 smithi173 ceph-mon[35326]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-09-12T12:16:36.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:36 smithi103 ceph-mon[35094]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-09-12T12:16:36.980 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:36 smithi081 ceph-mon[30948]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 102 KiB/s wr, 61 op/s 2024-09-12T12:16:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/3657524703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec10c180 msgr2=0x7fa6ec10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/3657524703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec10c180 0x7fa6ec10e610 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009ca0 tx=0x7fa6e402a950 comp rx=0 tx=0).stop 2024-09-12T12:16:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/3657524703 shutdown_connections 2024-09-12T12:16:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/3657524703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec10c180 0x7fa6ec10e610 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/3657524703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec103700 0x7fa6ec10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/3657524703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6ec102de0 0x7fa6ec1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/3657524703 >> 172.21.15.81:0/3657524703 conn(0x7fa6ec0fc7a0 msgr2=0x7fa6ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/3657524703 shutdown_connections 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.057+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/3657524703 wait complete. 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 Processor -- start 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 -- start start 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6ec102de0 0x7fa6ec198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 0x7fa6ec198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec10c180 0x7fa6ec19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec1120f0 con 0x7fa6ec103700 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec111f70 con 0x7fa6ec102de0 2024-09-12T12:16:37.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6f1c1a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ec112270 con 0x7fa6ec10c180 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 0x7fa6ec198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 0x7fa6ec198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55380/0 (socket says 172.21.15.81:55380) 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.058+0000 7fa6eaffd640 1 -- 172.21.15.81:0/1340431213 learned_addr learned my addr 172.21.15.81:0/1340431213 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eb7fe640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6ec102de0 0x7fa6ec198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6ebfff640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec10c180 0x7fa6ec19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eaffd640 1 -- 172.21.15.81:0/1340431213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec10c180 msgr2=0x7fa6ec19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eaffd640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec10c180 0x7fa6ec19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eaffd640 1 -- 172.21.15.81:0/1340431213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6ec102de0 msgr2=0x7fa6ec198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eaffd640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6ec102de0 0x7fa6ec198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eaffd640 1 -- 172.21.15.81:0/1340431213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ec19d5c0 con 0x7fa6ec103700 2024-09-12T12:16:37.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6eaffd640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 0x7fa6ec198b50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000b4a0 tx=0x7fa6e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0014070 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa6e0010b10 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ec19d8b0 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0017d60 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.059+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ec1a5190 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.060+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ec1031c0 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.061+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fa6e0017070 con 0x7fa6ec103700 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.062+0000 7fa6e8ff9640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa6d40a2d80 0x7fa6d40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.062+0000 7fa6eb7fe640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa6d40a2d80 0x7fa6d40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:37.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.062+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa6e00ce760 con 0x7fa6ec103700 2024-09-12T12:16:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.063+0000 7fa6eb7fe640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa6d40a2d80 0x7fa6d40a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009bd0 tx=0x7fa6dc005f90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:37.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.066+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6e009ad40 con 0x7fa6ec103700 2024-09-12T12:16:37.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.236+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6ec107270 con 0x7fa6ec103700 2024-09-12T12:16:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.238+0000 7fa6e8ff9640 1 -- 172.21.15.81:0/1340431213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+23019 (secure 0 0 0) 0x7fa6e009f040 con 0x7fa6ec103700 2024-09-12T12:16:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:37.238 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:16:25.570424+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/4236049851":"2024-09-13T12:16:25.570397+0000","172.21.15.81:6800/4236049851":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/22849456":"2024-09-13T12:16:25.570397+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2649443491":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/4279243684":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/1340615058":"2024-09-13T12:16:25.570397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa6d40a2d80 msgr2=0x7fa6d40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa6d40a2d80 0x7fa6d40a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009bd0 tx=0x7fa6dc005f90 comp rx=0 tx=0).stop 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 msgr2=0x7fa6ec198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 0x7fa6ec198b50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000b4a0 tx=0x7fa6e000b960 comp rx=0 tx=0).stop 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 shutdown_connections 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa6d40a2d80 0x7fa6d40a5240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec10c180 0x7fa6ec19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6ec103700 0x7fa6ec198b50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 --2- 172.21.15.81:0/1340431213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa6ec102de0 0x7fa6ec198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 >> 172.21.15.81:0/1340431213 conn(0x7fa6ec0fc7a0 msgr2=0x7fa6ec0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.240+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 shutdown_connections 2024-09-12T12:16:37.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:37.241+0000 7fa6f1c1a640 1 -- 172.21.15.81:0/1340431213 wait complete. 2024-09-12T12:16:37.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:37 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1340431213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:16:37.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:37 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1340431213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:16:37.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-12T12:16:38.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:37 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1340431213' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:16:38.198 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:38.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:38 smithi081 ceph-mon[30948]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-12T12:16:38.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:38 smithi103 ceph-mon[35094]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-12T12:16:39.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:38 smithi173 ceph-mon[35326]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 54 op/s 2024-09-12T12:16:39.380 INFO:teuthology.orchestra.run.smithi081.stdout:{"run_dir":"/var/run/ceph"} 2024-09-12T12:16:39.381 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-12T12:16:39.381 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 481 2024-09-12T12:16:39.381 DEBUG:tasks.quiescer:Yielding 2024-09-12T12:16:39.381 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T12:16:39.395 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T12:16:39.395 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T12:16:39.395 INFO:tasks.workunit:timeout=3h 2024-09-12T12:16:39.396 INFO:tasks.workunit:cleanup=True 2024-09-12T12:16:39.396 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:39.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:16:39.413 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:39.413 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T12:16:39.413 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-12T12:16:39.414 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T12:16:39.414 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T12:16:39.414 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-12 12:14:53.745448757 +0000 2024-09-12T12:16:39.414 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-12 12:14:53.745448757 +0000 2024-09-12T12:16:39.414 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-12 12:16:23.575489849 +0000 2024-09-12T12:16:39.414 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-12 12:14:53.745448757 +0000 2024-09-12T12:16:39.414 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T12:16:39.414 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T12:16:39.484 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T12:16:39.540 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T12:16:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:40.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 -- 172.21.15.81:0/58380699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c1036e0 msgr2=0x7f5d3c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 --2- 172.21.15.81:0/58380699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c107b90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009930 tx=0x7f5d3002a420 comp rx=0 tx=0).stop 2024-09-12T12:16:40.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 -- 172.21.15.81:0/58380699 shutdown_connections 2024-09-12T12:16:40.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 --2- 172.21.15.81:0/58380699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d3c1082a0 0x7f5d3c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 --2- 172.21.15.81:0/58380699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c107b90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 --2- 172.21.15.81:0/58380699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c102d30 0x7f5d3c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 -- 172.21.15.81:0/58380699 >> 172.21.15.81:0/58380699 conn(0x7f5d3c0fc7d0 msgr2=0x7f5d3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 -- 172.21.15.81:0/58380699 shutdown_connections 2024-09-12T12:16:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.077+0000 7f5d426fa640 1 -- 172.21.15.81:0/58380699 wait complete. 2024-09-12T12:16:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 Processor -- start 2024-09-12T12:16:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 -- start start 2024-09-12T12:16:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 0x7f5d3c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d3c1082a0 0x7f5d3c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1121c0 con 0x7f5d3c102d30 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c112040 con 0x7f5d3c1036e0 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d426fa640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c112340 con 0x7f5d3c1082a0 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d3bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 0x7f5d3c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d3bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 0x7f5d3c198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55402/0 (socket says 172.21.15.81:55402) 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d3bfff640 1 -- 172.21.15.81:0/166254655 learned_addr learned my addr 172.21.15.81:0/166254655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.078+0000 7f5d3b7fe640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d40c97640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d3c1082a0 0x7f5d3c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3bfff640 1 -- 172.21.15.81:0/166254655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d3c1082a0 msgr2=0x7f5d3c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3bfff640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d3c1082a0 0x7f5d3c19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3bfff640 1 -- 172.21.15.81:0/166254655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c1036e0 msgr2=0x7f5d3c198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3bfff640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3bfff640 1 -- 172.21.15.81:0/166254655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c19d5b0 con 0x7f5d3c102d30 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3b7fe640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d3bfff640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 0x7f5d3c198600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00c920 tx=0x7f5d2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c007c70 con 0x7f5d3c102d30 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5d2c007e10 con 0x7f5d3c102d30 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c19d8a0 con 0x7f5d3c102d30 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c018940 con 0x7f5d3c102d30 2024-09-12T12:16:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.079+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1008c0 con 0x7f5d3c102d30 2024-09-12T12:16:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.080+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c103110 con 0x7f5d3c102d30 2024-09-12T12:16:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.081+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f5d2c018b00 con 0x7f5d3c102d30 2024-09-12T12:16:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.082+0000 7f5d397fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5d240a2e00 0x7f5d240a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.082+0000 7f5d3b7fe640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5d240a2e00 0x7f5d240a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.082+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f5d2c0cf950 con 0x7f5d3c102d30 2024-09-12T12:16:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.083+0000 7f5d3b7fe640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5d240a2e00 0x7f5d240a52c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009900 tx=0x7f5d30005a20 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.088+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d2c014030 con 0x7f5d3c102d30 2024-09-12T12:16:40.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.294+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d3c199960 con 0x7f5d3c102d30 2024-09-12T12:16:40.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.295+0000 7f5d397fa640 1 -- 172.21.15.81:0/166254655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11982 (secure 0 0 0) 0x7f5d2c00de20 con 0x7f5d3c102d30 2024-09-12T12:16:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:16:40.295 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T12:16:24:277939+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:16:24.227728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:16:40.296 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T12:16:40.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5d240a2e00 msgr2=0x7f5d240a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5d240a2e00 0x7f5d240a52c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009900 tx=0x7f5d30005a20 comp rx=0 tx=0).stop 2024-09-12T12:16:40.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 msgr2=0x7f5d3c198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 0x7f5d3c198600 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00c920 tx=0x7f5d2c00cde0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 shutdown_connections 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5d240a2e00 0x7f5d240a52c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5d3c1082a0 0x7f5d3c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3c1036e0 0x7f5d3c198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 --2- 172.21.15.81:0/166254655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d3c102d30 0x7f5d3c198600 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 >> 172.21.15.81:0/166254655 conn(0x7f5d3c0fc7d0 msgr2=0x7f5d3c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 shutdown_connections 2024-09-12T12:16:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:40.297+0000 7f5d426fa640 1 -- 172.21.15.81:0/166254655 wait complete. 2024-09-12T12:16:40.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:40 smithi103 ceph-mon[35094]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-12T12:16:40.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:40 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/166254655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- 172.21.15.81:0/14010685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 msgr2=0x7fae0010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- 172.21.15.81:0/14010685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0010e550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009900 tx=0x7fadf802a480 comp rx=0 tx=0).stop 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- 172.21.15.81:0/14010685 shutdown_connections 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- 172.21.15.81:0/14010685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0010e550 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- 172.21.15.81:0/14010685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae001035a0 0x7fae0010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- 172.21.15.81:0/14010685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae00102c80 0x7fae00103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- 172.21.15.81:0/14010685 >> 172.21.15.81:0/14010685 conn(0x7fae00077990 msgr2=0x7fae000fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- 172.21.15.81:0/14010685 shutdown_connections 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- 172.21.15.81:0/14010685 wait complete. 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 Processor -- start 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- start start 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae00102c80 0x7fae00198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae001035a0 0x7fae00198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.982+0000 7fae07dd8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae00112030 con 0x7fae0010c0d0 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae07dd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae00111eb0 con 0x7fae001035a0 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae07dd8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae001121b0 con 0x7fae00102c80 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0019cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55422/0 (socket says 172.21.15.81:55422) 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 -- 172.21.15.81:0/2744196192 learned_addr learned my addr 172.21.15.81:0/2744196192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae05b74640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae00102c80 0x7fae00198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae05373640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae001035a0 0x7fae00198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 -- 172.21.15.81:0/2744196192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae00102c80 msgr2=0x7fae00198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae00102c80 0x7fae00198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 -- 172.21.15.81:0/2744196192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae001035a0 msgr2=0x7fae00198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae001035a0 0x7fae00198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 -- 172.21.15.81:0/2744196192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0019d410 con 0x7fae0010c0d0 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae06375640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0019cce0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fadf8005ab0 tx=0x7fadf80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fadfeffd640 1 -- 172.21.15.81:0/2744196192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf803f030 con 0x7fae0010c0d0 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fadfeffd640 1 -- 172.21.15.81:0/2744196192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadf8003d00 con 0x7fae0010c0d0 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0019d6a0 con 0x7fae0010c0d0 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fadfeffd640 1 -- 172.21.15.81:0/2744196192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8035070 con 0x7fae0010c0d0 2024-09-12T12:16:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.983+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae001a4f90 con 0x7fae0010c0d0 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fadfeffd640 1 -- 172.21.15.81:0/2744196192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fadf8042030 con 0x7fae0010c0d0 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 Processor -- start 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 -- start start 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298f0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56162984a2f0 con 0x5616298e5af0 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616297f2270 con 0x5616298f0cb0 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616298462b0 con 0x5616298e6410 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298e5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55438/0 (socket says 172.21.15.81:55438) 2024-09-12T12:16:40.994 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.986+0000 7fae05373640 1 -- 172.21.15.81:0/2723057011 learned_addr learned my addr 172.21.15.81:0/2723057011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05b74640 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fadfeffd640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fade80a2ec0 0x7fade80a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 -- 172.21.15.81:0/2723057011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 msgr2=0x5616298f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298f0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 -- 172.21.15.81:0/2723057011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 msgr2=0x5616298f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 -- 172.21.15.81:0/2723057011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616297f1340 con 0x5616298e5af0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae06375640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fade80a2ec0 0x7fade80a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fae05373640 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298e5ed0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009fc0 tx=0x7fadf40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e1cadca0162d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fadfeffd640 1 -- 172.21.15.81:0/2744196192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fadf80ef8d0 con 0x7fae0010c0d0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fade7fff640 1 -- 172.21.15.81:0/2723057011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4017610 con 0x5616298e5af0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fade7fff640 1 -- 172.21.15.81:0/2723057011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadf401c070 con 0x5616298e5af0 2024-09-12T12:16:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.987+0000 7fade7fff640 1 -- 172.21.15.81:0/2723057011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40159f0 con 0x5616298e5af0 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2723057011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 msgr2=0x5616298e5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae06375640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fade80a2ec0 0x7fade80a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fadf80ed030 tx=0x7fadf8086e70 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298e5ed0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009fc0 tx=0x7fadf40095c0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2723057011 shutdown_connections 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2723057011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298e5ed0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2723057011 >> 172.21.15.81:0/2723057011 conn(0x5616298e2060 msgr2=0x5616298e2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2723057011 shutdown_connections 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2723057011 wait complete. 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 -- start start 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.988+0000 7fae0ac4b740 1 Processor -- start 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298edac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298ee540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616298f3880 con 0x5616298e5af0 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616297d3290 con 0x5616298f0cb0 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616298f3a00 con 0x5616298e6410 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae0ac4b740 10 client.0 _ll_register_callbacks cb 0x561629804140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55446/0 (socket says 172.21.15.81:55446) 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 -- 172.21.15.81:0/1231849515 learned_addr learned my addr 172.21.15.81:0/1231849515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05b74640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298ee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 -- 172.21.15.81:0/1231849515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 msgr2=0x5616298ee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 -- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 msgr2=0x5616298ee540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298ee540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 -- 172.21.15.81:0/1231849515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162955d210 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fae05373640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298edac0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fadf4004810 tx=0x7fadf4006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08ed83381f091dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.989+0000 7fade57fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fade57fa640 1 -- 172.21.15.81:0/1231849515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4015d80 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fade57fa640 1 -- 172.21.15.81:0/1231849515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fadf4024430 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf401c070 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fade57fa640 1 -- 172.21.15.81:0/1231849515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadf4024630 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 10 client.15369 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561629629620 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fade57fa640 1 -- 172.21.15.81:0/1231849515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadf401c070 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fade57fa640 1 -- 172.21.15.81:0/1231849515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fadf40179d0 con 0x5616298e5af0 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 10 client.15369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:16:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 20 client.15369 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561629900a40 0x561629902e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 4 client.15369 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561629857a20 con 0x561629900a40 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.990+0000 7fae05b74640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561629900a40 0x561629902e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.991+0000 7fae05b74640 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561629900a40 0x561629902e30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ebde08b2ccd0b5 server_cookie=2d0c235abb9a392a in_seq=0 out_seq=0 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.991+0000 7fade57fa640 10 client.15369 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.991+0000 7fade57fa640 1 -- 172.21.15.81:0/1231849515 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561629857a20 con 0x561629900a40 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.991+0000 7fade57fa640 10 client.15369 handle_command_reply: tid=0 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 client.15369 shutdown 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 msgr2=0x5616298edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298edac0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fadf4004810 tx=0x7fadf4006ea0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 shutdown_connections 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561629900a40 0x561629902e30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x5616298ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/1231849515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298edac0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fade57fa640 0 client.15369 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 >> 172.21.15.81:0/1231849515 conn(0x5616298e2060 msgr2=0x5616298e7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 shutdown_connections 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 1 -- 172.21.15.81:0/1231849515 wait complete. 2024-09-12T12:16:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:40.992+0000 7fae0ac4b740 20 client.15369 trim_cache size 0 max 16384 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 Processor -- start 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 -- start start 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x561629908460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae001ad6b0 con 0x5616298e5af0 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae001af1f0 con 0x5616298f0cb0 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae001add80 con 0x5616298e6410 2024-09-12T12:16:41.007 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298efdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55456/0 (socket says 172.21.15.81:55456) 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 -- 172.21.15.81:0/2873040122 learned_addr learned my addr 172.21.15.81:0/2873040122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 -- 172.21.15.81:0/2873040122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 msgr2=0x5616298ee370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 -- 172.21.15.81:0/2873040122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 msgr2=0x561629908460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x561629908460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.006+0000 7fae05373640 1 -- 172.21.15.81:0/2873040122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616298e1e90 con 0x5616298e5af0 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae05373640 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298efdf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fadf4011010 tx=0x7fadf4009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923abc54535c0f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fade77fe640 1 -- 172.21.15.81:0/2873040122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40159a0 con 0x5616298e5af0 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fade77fe640 1 -- 172.21.15.81:0/2873040122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadf401c070 con 0x5616298e5af0 2024-09-12T12:16:41.008 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fade77fe640 1 -- 172.21.15.81:0/2873040122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40173e0 con 0x5616298e5af0 2024-09-12T12:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2873040122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 msgr2=0x5616298efdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298efdf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fadf4011010 tx=0x7fadf4009890 comp rx=0 tx=0).stop 2024-09-12T12:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2873040122 shutdown_connections 2024-09-12T12:16:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298f0cb0 0x561629908460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298e6410 0x5616298ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2873040122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298efdf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2873040122 >> 172.21.15.81:0/2873040122 conn(0x5616298e2060 msgr2=0x5616298eca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2873040122 shutdown_connections 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.007+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2873040122 wait complete. 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 -- start start 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 Processor -- start 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298e6410 0x5616298f4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298f0cb0 0x5616298f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae001aeb20 con 0x5616298e5af0 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae001ae450 con 0x5616298e6410 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fae001ab690 con 0x5616298f0cb0 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae0ac4b740 10 client.0 _ll_register_callbacks cb 0x7fadf4009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298f9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55472/0 (socket says 172.21.15.81:55472) 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 -- 172.21.15.81:0/2138472181 learned_addr learned my addr 172.21.15.81:0/2138472181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05b74640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298e6410 0x5616298f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 -- 172.21.15.81:0/2138472181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298f0cb0 msgr2=0x5616298f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298f0cb0 0x5616298f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 -- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298e6410 msgr2=0x5616298f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.008+0000 7fae05373640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298e6410 0x5616298f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae05373640 1 -- 172.21.15.81:0/2138472181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616298f4f10 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae05b74640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298e6410 0x5616298f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae05373640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298f9120 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fadf4004810 tx=0x7fadf40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faa01bc6608ba97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fade57fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fade57fa640 1 -- 172.21.15.81:0/2138472181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4015980 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fade57fa640 1 -- 172.21.15.81:0/2138472181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fadf4024430 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf401c070 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fade57fa640 1 -- 172.21.15.81:0/2138472181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadf4015d80 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 10 client.15375 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56162996b150 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fade57fa640 1 -- 172.21.15.81:0/2138472181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadf401c070 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fade57fa640 1 -- 172.21.15.81:0/2138472181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fadf4036660 con 0x5616298e5af0 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:16:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 20 client.15375 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56162996b5d0 0x56162996d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 4 client.15375 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:16:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.009+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561629851d70 con 0x56162996b5d0 2024-09-12T12:16:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.010+0000 7fae05b74640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56162996b5d0 0x56162996d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.010+0000 7fae05b74640 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56162996b5d0 0x56162996d9c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4c716b2a22cadb8 server_cookie=37f3cef8ef63fbab in_seq=0 out_seq=0 2024-09-12T12:16:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.010+0000 7fade57fa640 10 client.15375 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.022+0000 7fade57fa640 1 -- 172.21.15.81:0/2138472181 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561629851d70 con 0x56162996b5d0 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.022+0000 7fade57fa640 10 client.15375 handle_command_reply: tid=0 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.022+0000 7fae0ac4b740 1 client.15375 shutdown 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 msgr2=0x5616298f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298f9120 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fadf4004810 tx=0x7fadf40091d0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 shutdown_connections 2024-09-12T12:16:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56162996b5d0 0x56162996d9c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616298f0cb0 0x5616298f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616298e6410 0x5616298f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fade57fa640 0 client.15375 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 --2- 172.21.15.81:0/2138472181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616298e5af0 0x5616298f9120 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 >> 172.21.15.81:0/2138472181 conn(0x5616298e2060 msgr2=0x5616298e7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 shutdown_connections 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 1 -- 172.21.15.81:0/2138472181 wait complete. 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae0ac4b740 20 client.15375 trim_cache size 0 max 16384 2024-09-12T12:16:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:16:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:16:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:16:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:16:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fade80a2ec0 msgr2=0x7fade80a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae07dd8640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fade80a2ec0 0x7fade80a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fadf80ed030 tx=0x7fadf8086e70 comp rx=0 tx=0).stop 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 msgr2=0x7fae0019cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.023+0000 7fae07dd8640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0019cce0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fadf8005ab0 tx=0x7fadf80042f0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 shutdown_connections 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fade80a2ec0 0x7fade80a5380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae0010c0d0 0x7fae0019cce0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae001035a0 0x7fae00198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 --2- 172.21.15.81:0/2744196192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fae00102c80 0x7fae00198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 >> 172.21.15.81:0/2744196192 conn(0x7fae00077990 msgr2=0x7fae000fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 shutdown_connections 2024-09-12T12:16:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:41.024+0000 7fae07dd8640 1 -- 172.21.15.81:0/2744196192 wait complete. 2024-09-12T12:16:41.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:40 smithi081 ceph-mon[30948]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-12T12:16:41.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:40 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/166254655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:41.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T12:14:35.911015+0000', 'modified': '2024-09-12T12:16:24.227728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24485, 'mds_1': 24461, 'mds_2': 24457, 'mds_3': 24437, 'mds_4': 24436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14598': {'gid': 14598, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6839/3279635401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6838', 'nonce': 3279635401}, {'type': 'v1', 'addr': '172.21.15.81:6839', 'nonce': 3279635401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14610': {'gid': 14610, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.81:6841/1006182135', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6840', 'nonce': 1006182135}, {'type': 'v1', 'addr': '172.21.15.81:6841', 'nonce': 1006182135}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24394': {'gid': 24394, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6833/372466772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6832', 'nonce': 372466772}, {'type': 'v1', 'addr': '172.21.15.173:6833', 'nonce': 372466772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24407': {'gid': 24407, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.103:6833/3064461197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6832', 'nonce': 3064461197}, {'type': 'v1', 'addr': '172.21.15.103:6833', 'nonce': 3064461197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6835/3014376257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6834', 'nonce': 3014376257}, {'type': 'v1', 'addr': '172.21.15.173:6835', 'nonce': 3014376257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24436': {'gid': 24436, 'name': 'c', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.173:6837/359177011', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 359177011}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 359177011}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6835/4242406176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 4242406176}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 4242406176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.173:6839/2860435891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2860435891}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2860435891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.103:6837/4210602713', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6836', 'nonce': 4210602713}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 4210602713}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24485': {'gid': 24485, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6839/3967449570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 3967449570}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 3967449570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24485, 'qdb_cluster': [24436, 24437, 24457, 24461, 24485]} 2024-09-12T12:16:41.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-12T12:16:41.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-12T12:16:41.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:40 smithi173 ceph-mon[35326]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-09-12T12:16:41.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:40 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/166254655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:16:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:41.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 -- 172.21.15.81:0/3623268034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c102790 msgr2=0x7fbe8c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3623268034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c102790 0x7fbe8c1067e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009900 tx=0x7fbe7402a410 comp rx=0 tx=0).stop 2024-09-12T12:16:41.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 -- 172.21.15.81:0/3623268034 shutdown_connections 2024-09-12T12:16:41.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3623268034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8c106f10 0x7fbe8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3623268034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c102790 0x7fbe8c1067e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3623268034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe8c101de0 0x7fbe8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 -- 172.21.15.81:0/3623268034 >> 172.21.15.81:0/3623268034 conn(0x7fbe8c0fd8c0 msgr2=0x7fbe8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 -- 172.21.15.81:0/3623268034 shutdown_connections 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 -- 172.21.15.81:0/3623268034 wait complete. 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 Processor -- start 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 -- start start 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.811+0000 7fbe91d27640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8c101de0 0x7fbe8c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe8c102790 0x7fbe8c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 0x7fbe8c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c112090 con 0x7fbe8c106f10 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c111f10 con 0x7fbe8c101de0 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c112210 con 0x7fbe8c102790 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 0x7fbe8c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 0x7fbe8c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55492/0 (socket says 172.21.15.81:55492) 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 -- 172.21.15.81:0/3751509356 learned_addr learned my addr 172.21.15.81:0/3751509356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe83fff640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe8c102790 0x7fbe8c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8c101de0 0x7fbe8c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 -- 172.21.15.81:0/3751509356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe8c102790 msgr2=0x7fbe8c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe8c102790 0x7fbe8c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 -- 172.21.15.81:0/3751509356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8c101de0 msgr2=0x7fbe8c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8c101de0 0x7fbe8c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 -- 172.21.15.81:0/3751509356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c19d480 con 0x7fbe8c106f10 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe8bfff640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 0x7fbe8c19cda0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400eaa0 tx=0x7fbe8400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe897fa640 1 -- 172.21.15.81:0/3751509356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400cdb0 con 0x7fbe8c106f10 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe897fa640 1 -- 172.21.15.81:0/3751509356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe84004b20 con 0x7fbe8c106f10 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c19d770 con 0x7fbe8c106f10 2024-09-12T12:16:41.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe897fa640 1 -- 172.21.15.81:0/3751509356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011760 con 0x7fbe8c106f10 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.812+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c1a5050 con 0x7fbe8c106f10 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe897fa640 1 -- 172.21.15.81:0/3751509356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fbe84004cd0 con 0x7fbe8c106f10 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 Processor -- start 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 -- start start 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555675007090 con 0x5556750a0890 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555674faea70 con 0x5556750affc0 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe94100740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555675003050 con 0x5556750a11b0 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750a0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55502/0 (socket says 172.21.15.81:55502) 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 -- 172.21.15.81:0/266302966 learned_addr learned my addr 172.21.15.81:0/266302966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe897fa640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fbe780a2d80 0x7fbe780a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe8bfff640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fbe780a2d80 0x7fbe780a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 -- 172.21.15.81:0/266302966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 msgr2=0x5556750afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 -- 172.21.15.81:0/266302966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 msgr2=0x5556750b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.815+0000 7fbe83fff640 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe83fff640 1 -- 172.21.15.81:0/266302966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555674fbb130 con 0x5556750a0890 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe897fa640 1 -- 172.21.15.81:0/3751509356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fbe840cf790 con 0x7fbe8c106f10 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe83fff640 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750a0c70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009900 tx=0x7fbe74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7227c3c158ac57c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe81ffb640 1 -- 172.21.15.81:0/266302966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74044030 con 0x5556750a0890 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe8bfff640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fbe780a2d80 0x7fbe780a5240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe840ccef0 tx=0x7fbe840c6740 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe81ffb640 1 -- 172.21.15.81:0/266302966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe74031a30 con 0x5556750a0890 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.816+0000 7fbe81ffb640 1 -- 172.21.15.81:0/266302966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74035040 con 0x5556750a0890 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- 172.21.15.81:0/266302966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 msgr2=0x5556750a0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750a0c70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009900 tx=0x7fbe74000bc0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- 172.21.15.81:0/266302966 shutdown_connections 2024-09-12T12:16:41.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- 172.21.15.81:0/266302966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750a0c70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- 172.21.15.81:0/266302966 >> 172.21.15.81:0/266302966 conn(0x55567509cf60 msgr2=0x55567509d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- 172.21.15.81:0/266302966 shutdown_connections 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- 172.21.15.81:0/266302966 wait complete. 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- start start 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 Processor -- start 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556750b2b30 con 0x5556750a0890 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555674fc1f20 con 0x5556750affc0 2024-09-12T12:16:41.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.817+0000 7fbe94100740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556750b2cb0 con 0x5556750a11b0 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe94100740 10 client.0 _ll_register_callbacks cb 0x555674f8b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55512/0 (socket says 172.21.15.81:55512) 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 -- 172.21.15.81:0/2258606286 learned_addr learned my addr 172.21.15.81:0/2258606286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 -- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 msgr2=0x5556750acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 -- 172.21.15.81:0/2258606286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 msgr2=0x5556750ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 -- 172.21.15.81:0/2258606286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555674d782b0 con 0x5556750a0890 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe83fff640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750af760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe7402ac00 tx=0x7fbe74005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5ca8e6f33acb55 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe6affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe6affd640 1 -- 172.21.15.81:0/2258606286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7404d070 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe74031a30 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe6affd640 1 -- 172.21.15.81:0/2258606286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fbe74004c20 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe6affd640 1 -- 172.21.15.81:0/2258606286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe74035070 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe94100740 10 client.15387 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.818+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5556750be3c0 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe6affd640 1 -- 172.21.15.81:0/2258606286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe74031a30 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe6affd640 1 -- 172.21.15.81:0/2258606286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbe7403a3f0 con 0x5556750a0890 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe94100740 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe94100740 10 client.15387 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe94100740 20 client.15387 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe94100740 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x5556750bf710 0x5556750c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe94100740 4 client.15387 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 --> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555675014600 con 0x5556750bf710 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.819+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x5556750bf710 0x5556750c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe6affd640 10 client.15387 ms_handle_connect on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x5556750bf710 0x5556750c1900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9331877364a3a46a server_cookie=aabf4e24404bbebd in_seq=0 out_seq=0 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe6affd640 1 -- 172.21.15.81:0/2258606286 <== mds.4 v2:172.21.15.173:6836/359177011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555675014600 con 0x5556750bf710 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe6affd640 10 client.15387 handle_command_reply: tid=0 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 client.15387 shutdown 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 msgr2=0x5556750af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750af760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe7402ac00 tx=0x7fbe74005250 comp rx=0 tx=0).stop 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 shutdown_connections 2024-09-12T12:16:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x5556750bf710 0x5556750c1900 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750affc0 0x5556750ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 --2- 172.21.15.81:0/2258606286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750a0890 0x5556750af760 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.820+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 >> 172.21.15.81:0/2258606286 conn(0x55567509cf60 msgr2=0x5556750a2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.821+0000 7fbe6affd640 0 client.15387 ms_handle_reset on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.821+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 shutdown_connections 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.821+0000 7fbe94100740 1 -- 172.21.15.81:0/2258606286 wait complete. 2024-09-12T12:16:41.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.821+0000 7fbe94100740 20 client.15387 trim_cache size 0 max 16384 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 Processor -- start 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 -- start start 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a0890 0x5556750bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a11b0 0x5556750c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556750bfc40 con 0x5556750affc0 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5556750c0310 con 0x5556750a11b0 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe94100740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556750c09e0 con 0x5556750a0890 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55518/0 (socket says 172.21.15.81:55518) 2024-09-12T12:16:41.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.838+0000 7fbe83fff640 1 -- 172.21.15.81:0/426976976 learned_addr learned my addr 172.21.15.81:0/426976976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a11b0 0x5556750c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a0890 0x5556750bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 -- 172.21.15.81:0/426976976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a0890 msgr2=0x5556750bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a0890 0x5556750bfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 -- 172.21.15.81:0/426976976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a11b0 msgr2=0x5556750c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a11b0 0x5556750c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 -- 172.21.15.81:0/426976976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556750a0fe0 con 0x5556750affc0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe83fff640 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750a19e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbe7403a960 tx=0x7fbe740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf513d52ffe09823 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe817fa640 1 -- 172.21.15.81:0/426976976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7404d070 con 0x5556750affc0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe817fa640 1 -- 172.21.15.81:0/426976976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe740052c0 con 0x5556750affc0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.839+0000 7fbe817fa640 1 -- 172.21.15.81:0/426976976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7403ae60 con 0x5556750affc0 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 -- 172.21.15.81:0/426976976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 msgr2=0x5556750a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750a19e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbe7403a960 tx=0x7fbe740046c0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 -- 172.21.15.81:0/426976976 shutdown_connections 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750a19e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a11b0 0x5556750c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 --2- 172.21.15.81:0/426976976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a0890 0x5556750bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 -- 172.21.15.81:0/426976976 >> 172.21.15.81:0/426976976 conn(0x55567509cf60 msgr2=0x55567509d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 -- 172.21.15.81:0/426976976 shutdown_connections 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 -- 172.21.15.81:0/426976976 wait complete. 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 -- start start 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.840+0000 7fbe94100740 1 Processor -- start 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a0890 0x5556750c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556750c1780 con 0x5556750affc0 2024-09-12T12:16:41.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5556750c10b0 con 0x5556750a0890 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5556750c1e50 con 0x5556750a11b0 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 10 client.0 _ll_register_callbacks cb 0x7fbe7402ab50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55524/0 (socket says 172.21.15.81:55524) 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 -- 172.21.15.81:0/496291461 learned_addr learned my addr 172.21.15.81:0/496291461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a0890 0x5556750c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 -- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 msgr2=0x5556750ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 -- 172.21.15.81:0/496291461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a0890 msgr2=0x5556750c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a0890 0x5556750c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 -- 172.21.15.81:0/496291461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556750c3980 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe83fff640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750c3150 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009900 tx=0x7fbe7403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38820e5ee34fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe6affd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe6affd640 1 -- 172.21.15.81:0/496291461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7405d070 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe740052c0 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.841+0000 7fbe6affd640 1 -- 172.21.15.81:0/496291461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fbe74004230 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe6affd640 1 -- 172.21.15.81:0/496291461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbe7404d070 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 10 client.15393 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5556750c8460 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe6affd640 1 -- 172.21.15.81:0/496291461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe740052c0 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe6affd640 1 -- 172.21.15.81:0/496291461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fbe74062070 con 0x5556750affc0 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 10 client.15393 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 20 client.15393 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:41.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55567512f000 0x55567512dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 4 client.15393 mds_command: new command op to 24436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 --> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] -- command(tid 0: {"prefix": "status"}) -- 0x55567500eb10 con 0x55567512f000 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.842+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55567512f000 0x55567512dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe6affd640 10 client.15393 ms_handle_connect on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe8b7fe640 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55567512f000 0x55567512dd10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f18408796084697e server_cookie=24489e9a26274f08 in_seq=0 out_seq=0 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe6affd640 1 -- 172.21.15.81:0/496291461 <== mds.4 v2:172.21.15.173:6836/359177011 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55567500eb10 con 0x55567512f000 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe6affd640 10 client.15393 handle_command_reply: tid=0 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 client.15393 shutdown 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 msgr2=0x5556750c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750c3150 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009900 tx=0x7fbe7403f040 comp rx=0 tx=0).stop 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 shutdown_connections 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556750affc0 0x5556750c3150 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5556750a11b0 0x5556750ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.173:6836/359177011,v1:172.21.15.173:6837/359177011] conn(0x55567512f000 0x55567512dd10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 --2- 172.21.15.81:0/496291461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5556750a0890 0x5556750c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 >> 172.21.15.81:0/496291461 conn(0x55567509cf60 msgr2=0x555675097ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe6affd640 0 client.15393 ms_handle_reset on v2:172.21.15.173:6836/359177011 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 shutdown_connections 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 1 -- 172.21.15.81:0/496291461 wait complete. 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.843+0000 7fbe94100740 20 client.15393 trim_cache size 0 max 16384 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:41.852 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 4, 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24436, 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 115.64293699300001, 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 80, 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 150.64040031799999 2024-09-12T12:16:41.853 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fbe780a2d80 msgr2=0x7fbe780a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fbe780a2d80 0x7fbe780a5240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbe840ccef0 tx=0x7fbe840c6740 comp rx=0 tx=0).stop 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 msgr2=0x7fbe8c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 0x7fbe8c19cda0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400eaa0 tx=0x7fbe8400ef60 comp rx=0 tx=0).stop 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 shutdown_connections 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fbe780a2d80 0x7fbe780a5240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe8c106f10 0x7fbe8c19cda0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbe8c102790 0x7fbe8c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 --2- 172.21.15.81:0/3751509356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8c101de0 0x7fbe8c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:41.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 >> 172.21.15.81:0/3751509356 conn(0x7fbe8c0fd8c0 msgr2=0x7fbe8c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:41.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 shutdown_connections 2024-09-12T12:16:41.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:41.844+0000 7fbe91d27640 1 -- 172.21.15.81:0/3751509356 wait complete. 2024-09-12T12:16:42.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-12T12:16:42.825 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:42.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:42 smithi081 ceph-mon[30948]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 52 op/s 2024-09-12T12:16:42.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:42 smithi103 ceph-mon[35094]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 52 op/s 2024-09-12T12:16:43.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:42 smithi173 ceph-mon[35326]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 76 KiB/s wr, 52 op/s 2024-09-12T12:16:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 -- 172.21.15.81:0/3707750493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098101420 msgr2=0x7f309810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 --2- 172.21.15.81:0/3707750493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098101420 0x7f309810d950 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3090009cd0 tx=0x7f309002a8e0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 -- 172.21.15.81:0/3707750493 shutdown_connections 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 --2- 172.21.15.81:0/3707750493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098101420 0x7f309810d950 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 --2- 172.21.15.81:0/3707750493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3098100a80 0x7f3098100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 --2- 172.21.15.81:0/3707750493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3098106a80 0x7f3098106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 -- 172.21.15.81:0/3707750493 >> 172.21.15.81:0/3707750493 conn(0x7f30980fc7a0 msgr2=0x7f30980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 -- 172.21.15.81:0/3707750493 shutdown_connections 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.234+0000 7f309e636640 1 -- 172.21.15.81:0/3707750493 wait complete. 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 Processor -- start 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 -- start start 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 0x7f30981984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3098101420 0x7f30981989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3098106a80 0x7f309819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3098110fe0 con 0x7f3098100a80 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3098110e60 con 0x7f3098106a80 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f309e636640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3098111160 con 0x7f3098101420 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f3097fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 0x7f30981984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f3097fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 0x7f30981984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55922/0 (socket says 172.21.15.81:55922) 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.235+0000 7f3097fff640 1 -- 172.21.15.81:0/796389268 learned_addr learned my addr 172.21.15.81:0/796389268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f309cbd3640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3098106a80 0x7f309819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f30977fe640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3098101420 0x7f30981989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f3097fff640 1 -- 172.21.15.81:0/796389268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3098101420 msgr2=0x7f30981989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f3097fff640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3098101420 0x7f30981989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f3097fff640 1 -- 172.21.15.81:0/796389268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3098106a80 msgr2=0x7f309819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f3097fff640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3098106a80 0x7f309819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f3097fff640 1 -- 172.21.15.81:0/796389268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309819d460 con 0x7f3098100a80 2024-09-12T12:16:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f3097fff640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 0x7f30981984b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f308800c920 tx=0x7f308800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f30957fa640 1 -- 172.21.15.81:0/796389268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088007c70 con 0x7f3098100a80 2024-09-12T12:16:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f30957fa640 1 -- 172.21.15.81:0/796389268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3088007e10 con 0x7f3098100a80 2024-09-12T12:16:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309819d750 con 0x7f3098100a80 2024-09-12T12:16:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f30957fa640 1 -- 172.21.15.81:0/796389268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088018940 con 0x7f3098100a80 2024-09-12T12:16:43.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.236+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981a5030 con 0x7f3098100a80 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30957fa640 1 -- 172.21.15.81:0/796389268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f3088018b20 con 0x7f3098100a80 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 Processor -- start 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 -- start start 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d77bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d78aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d78afc0 0x55f08d78d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f08d6e2090 con 0x55f08d77b8b0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f08d689a70 con 0x55f08d77c1d0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f08d6de050 con 0x55f08d78afc0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f309cbd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d77bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f30957fa640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f30800a2d80 0x7f30800a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f309cbd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d77bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55936/0 (socket says 172.21.15.81:55936) 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.239+0000 7f309cbd3640 1 -- 172.21.15.81:0/4159481244 learned_addr learned my addr 172.21.15.81:0/4159481244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f3097fff640 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d78aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f30977fe640 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d78afc0 0x55f08d78d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f30800a2d80 0x7f30800a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f30957fa640 1 -- 172.21.15.81:0/796389268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f30880cf700 con 0x7f3098100a80 2024-09-12T12:16:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 -- 172.21.15.81:0/4159481244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d78afc0 msgr2=0x55f08d78d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d78afc0 0x55f08d78d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 -- 172.21.15.81:0/4159481244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 msgr2=0x55f08d78aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d78aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 -- 172.21.15.81:0/4159481244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08d696130 con 0x55f08d77b8b0 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d77bc90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3090009cd0 tx=0x7f3090031b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182d03dc85fd4db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f307e7fc640 1 -- 172.21.15.81:0/4159481244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090004410 con 0x55f08d77b8b0 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f307e7fc640 1 -- 172.21.15.81:0/4159481244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3090036070 con 0x55f08d77b8b0 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f307e7fc640 1 -- 172.21.15.81:0/4159481244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309004a450 con 0x55f08d77b8b0 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.240+0000 7f309cbd3640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f30800a2d80 0x7f30800a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f309004e000 tx=0x7f309004c000 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 -- 172.21.15.81:0/4159481244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 msgr2=0x55f08d77bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d77bc90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3090009cd0 tx=0x7f3090031b70 comp rx=0 tx=0).stop 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 -- 172.21.15.81:0/4159481244 shutdown_connections 2024-09-12T12:16:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d78afc0 0x55f08d78d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d78aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/4159481244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d77bc90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 -- 172.21.15.81:0/4159481244 >> 172.21.15.81:0/4159481244 conn(0x55f08d777f60 msgr2=0x55f08d778340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 -- 172.21.15.81:0/4159481244 shutdown_connections 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 -- 172.21.15.81:0/4159481244 wait complete. 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.241+0000 7f30a0a0f740 1 -- start start 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 Processor -- start 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d78a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d787ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 0x55f08d7880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f08d78db90 con 0x55f08d78afc0 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f08d69cf20 con 0x55f08d77c1d0 2024-09-12T12:16:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f08d78dd10 con 0x55f08d77b8b0 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30a0a0f740 10 client.0 _ll_register_callbacks cb 0x55f08d666030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 0x55f08d7880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 0x55f08d7880e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55948/0 (socket says 172.21.15.81:55948) 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 -- 172.21.15.81:0/2582859732 learned_addr learned my addr 172.21.15.81:0/2582859732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f3097fff640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d78a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f30977fe640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d787ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 -- 172.21.15.81:0/2582859732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 msgr2=0x55f08d78a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d78a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 -- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 msgr2=0x55f08d787ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d787ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f309cbd3640 1 -- 172.21.15.81:0/2582859732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08d4532b0 con 0x55f08d78afc0 2024-09-12T12:16:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.242+0000 7f3097fff640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d78a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f309cbd3640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 0x55f08d7880e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3090009df0 tx=0x7f3090030ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ee5ae8bd6e9718 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30777fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30777fe640 1 -- 172.21.15.81:0/2582859732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309004a450 con 0x55f08d78afc0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30777fe640 1 -- 172.21.15.81:0/2582859732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f3090003e00 con 0x55f08d78afc0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3090036070 con 0x55f08d78afc0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30777fe640 1 -- 172.21.15.81:0/2582859732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f30900305a0 con 0x55f08d78afc0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 10 client.15405 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f08d78db90 con 0x55f08d78afc0 2024-09-12T12:16:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30777fe640 1 -- 172.21.15.81:0/2582859732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3090036070 con 0x55f08d78afc0 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30777fe640 1 -- 172.21.15.81:0/2582859732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f3090030070 con 0x55f08d78afc0 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 10 client.15405 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 20 client.15405 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d79b770 0x55f08d79cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 4 client.15405 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.243+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 --> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f08d6ef600 con 0x55f08d79b770 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.244+0000 7f3097fff640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d79b770 0x55f08d79cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.244+0000 7f3097fff640 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d79b770 0x55f08d79cbe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1c4cb84ef07e1284 server_cookie=2846dee7688d9208 in_seq=0 out_seq=0 2024-09-12T12:16:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.244+0000 7f30777fe640 10 client.15405 ms_handle_connect on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30777fe640 1 -- 172.21.15.81:0/2582859732 <== mds.3 v2:172.21.15.103:6834/4242406176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f08d6ef600 con 0x55f08d79b770 2024-09-12T12:16:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30777fe640 10 client.15405 handle_command_reply: tid=0 2024-09-12T12:16:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 client.15405 shutdown 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 msgr2=0x55f08d7880e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 0x55f08d7880e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3090009df0 tx=0x7f3090030ef0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 shutdown_connections 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d78afc0 0x55f08d7880e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d77c1d0 0x55f08d787ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d79b770 0x55f08d79cbe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/2582859732 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d78a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 >> 172.21.15.81:0/2582859732 conn(0x55f08d777f60 msgr2=0x55f08d77dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30777fe640 0 client.15405 ms_handle_reset on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 shutdown_connections 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 1 -- 172.21.15.81:0/2582859732 wait complete. 2024-09-12T12:16:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.245+0000 7f30a0a0f740 20 client.15405 trim_cache size 0 max 16384 2024-09-12T12:16:43.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.262+0000 7f30a0a0f740 1 Processor -- start 2024-09-12T12:16:43.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.262+0000 7f30a0a0f740 1 -- start start 2024-09-12T12:16:43.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d79be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 0x55f08d783130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d784e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f08d79af20 con 0x55f08d77c1d0 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f08d79b5f0 con 0x55f08d78afc0 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f08d79bcc0 con 0x55f08d77b8b0 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 0x55f08d783130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 0x55f08d783130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55960/0 (socket says 172.21.15.81:55960) 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 -- 172.21.15.81:0/1171501278 learned_addr learned my addr 172.21.15.81:0/1171501278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 -- 172.21.15.81:0/1171501278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 msgr2=0x55f08d79be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f3097fff640 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d79be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d79be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 -- 172.21.15.81:0/1171501278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 msgr2=0x55f08d784e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f309cbd3640 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d784e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d784e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 -- 172.21.15.81:0/1171501278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f08d777a00 con 0x55f08d77c1d0 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f30977fe640 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 0x55f08d783130 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f308c00b760 tx=0x7f308c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a51b9e88dd76ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f307dffb640 1 -- 172.21.15.81:0/1171501278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c01b070 con 0x55f08d77c1d0 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f307dffb640 1 -- 172.21.15.81:0/1171501278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f308c015450 con 0x55f08d77c1d0 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.263+0000 7f307dffb640 1 -- 172.21.15.81:0/1171501278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c014610 con 0x55f08d77c1d0 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 -- 172.21.15.81:0/1171501278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 msgr2=0x55f08d783130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 0x55f08d783130 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f308c00b760 tx=0x7f308c00bc20 comp rx=0 tx=0).stop 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 -- 172.21.15.81:0/1171501278 shutdown_connections 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d784e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77c1d0 0x55f08d783130 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/1171501278 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77b8b0 0x55f08d79be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 -- 172.21.15.81:0/1171501278 >> 172.21.15.81:0/1171501278 conn(0x55f08d777f60 msgr2=0x55f08d782a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 -- 172.21.15.81:0/1171501278 shutdown_connections 2024-09-12T12:16:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 -- 172.21.15.81:0/1171501278 wait complete. 2024-09-12T12:16:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.264+0000 7f30a0a0f740 1 -- start start 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 Processor -- start 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d7845b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77c1d0 0x55f08d784af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d7a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f08d79ca60 con 0x55f08d77b8b0 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f08d79c390 con 0x55f08d78afc0 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f08d79d130 con 0x55f08d77c1d0 2024-09-12T12:16:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30a0a0f740 10 client.0 _ll_register_callbacks cb 0x7f308c00b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d7845b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d7845b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55962/0 (socket says 172.21.15.81:55962) 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 -- 172.21.15.81:0/223064600 learned_addr learned my addr 172.21.15.81:0/223064600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30977fe640 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77c1d0 0x55f08d784af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 -- 172.21.15.81:0/223064600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77c1d0 msgr2=0x55f08d784af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77c1d0 0x55f08d784af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 -- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 msgr2=0x55f08d7a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d7a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 -- 172.21.15.81:0/223064600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f08d7777f0 con 0x55f08d77b8b0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f3097fff640 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d7845b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3088007590 tx=0x7f308806b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf2fd5d61e7e913 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30777fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.265+0000 7f30777fe640 1 -- 172.21.15.81:0/223064600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308809c220 con 0x55f08d77b8b0 2024-09-12T12:16:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30777fe640 1 -- 172.21.15.81:0/223064600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f3088098190 con 0x55f08d77b8b0 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f308c015450 con 0x55f08d77b8b0 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30777fe640 1 -- 172.21.15.81:0/223064600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f308809bb20 con 0x55f08d77b8b0 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 10 client.15411 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f08d7a55e0 con 0x55f08d77b8b0 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30777fe640 1 -- 172.21.15.81:0/223064600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f308c015450 con 0x55f08d77b8b0 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30777fe640 1 -- 172.21.15.81:0/223064600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f308809bd80 con 0x55f08d77b8b0 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 10 client.15411 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 20 client.15411 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d80a350 0x55f08d809060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 4 client.15411 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 --> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] -- command(tid 0: {"prefix": "status"}) -- 0x55f08d6e9b10 con 0x55f08d80a350 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.266+0000 7f30977fe640 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d80a350 0x55f08d809060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30777fe640 10 client.15411 ms_handle_connect on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30977fe640 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d80a350 0x55f08d809060 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=91b7eacebc542dda server_cookie=a8799bf3edf7aa89 in_seq=0 out_seq=0 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30777fe640 1 -- 172.21.15.81:0/223064600 <== mds.3 v2:172.21.15.103:6834/4242406176 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f08d6e9b10 con 0x55f08d80a350 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30777fe640 10 client.15411 handle_command_reply: tid=0 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 client.15411 shutdown 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 msgr2=0x55f08d7845b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d7845b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3088007590 tx=0x7f308806b980 comp rx=0 tx=0).stop 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 shutdown_connections 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f08d78afc0 0x55f08d7a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.103:6834/4242406176,v1:172.21.15.103:6835/4242406176] conn(0x55f08d80a350 0x55f08d809060 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f08d77c1d0 0x55f08d784af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 --2- 172.21.15.81:0/223064600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f08d77b8b0 0x55f08d7845b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30777fe640 0 client.15411 ms_handle_reset on v2:172.21.15.103:6834/4242406176 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 >> 172.21.15.81:0/223064600 conn(0x55f08d777f60 msgr2=0x55f08d7767e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 shutdown_connections 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 1 -- 172.21.15.81:0/223064600 wait complete. 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.267+0000 7f30a0a0f740 20 client.15411 trim_cache size 0 max 16384 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 3, 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24437, 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 118.076360373, 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 80, 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 157.106575754 2024-09-12T12:16:43.275 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f30800a2d80 msgr2=0x7f30800a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f30800a2d80 0x7f30800a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f309004e000 tx=0x7f309004c000 comp rx=0 tx=0).stop 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 msgr2=0x7f30981984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 0x7f30981984b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f308800c920 tx=0x7f308800cde0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 shutdown_connections 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f30800a2d80 0x7f30800a5240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3098106a80 0x7f309819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3098101420 0x7f30981989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 --2- 172.21.15.81:0/796389268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3098100a80 0x7f30981984b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 >> 172.21.15.81:0/796389268 conn(0x7f30980fc7a0 msgr2=0x7f309806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 shutdown_connections 2024-09-12T12:16:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:43.268+0000 7f309e636640 1 -- 172.21.15.81:0/796389268 wait complete. 2024-09-12T12:16:43.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T12:16:44.199 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:44.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 -- 172.21.15.81:0/2359196549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78102ef0 msgr2=0x7efc7810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 --2- 172.21.15.81:0/2359196549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78102ef0 0x7efc7810da40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efc70009ca0 tx=0x7efc7002a950 comp rx=0 tx=0).stop 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 -- 172.21.15.81:0/2359196549 shutdown_connections 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 --2- 172.21.15.81:0/2359196549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78102ef0 0x7efc7810da40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 --2- 172.21.15.81:0/2359196549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc78102570 0x7efc781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 --2- 172.21.15.81:0/2359196549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc78100e20 0x7efc78101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 -- 172.21.15.81:0/2359196549 >> 172.21.15.81:0/2359196549 conn(0x7efc780fc7d0 msgr2=0x7efc780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 -- 172.21.15.81:0/2359196549 shutdown_connections 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.594+0000 7efc7ff66640 1 -- 172.21.15.81:0/2359196549 wait complete. 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 Processor -- start 2024-09-12T12:16:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 -- start start 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 0x7efc780fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc78102570 0x7efc780fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc78102ef0 0x7efc780fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc781110a0 con 0x7efc78100e20 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc78110f20 con 0x7efc78102570 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7ff66640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efc78111220 con 0x7efc78102ef0 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 0x7efc780fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 0x7efc780fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55978/0 (socket says 172.21.15.81:55978) 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 -- 172.21.15.81:0/134461916 learned_addr learned my addr 172.21.15.81:0/134461916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7e503640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc78102ef0 0x7efc780fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7d501640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc78102570 0x7efc780fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 -- 172.21.15.81:0/134461916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc78102ef0 msgr2=0x7efc780fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc78102ef0 0x7efc780fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 -- 172.21.15.81:0/134461916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc78102570 msgr2=0x7efc780fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc78102570 0x7efc780fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.595+0000 7efc7dd02640 1 -- 172.21.15.81:0/134461916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc781a6a50 con 0x7efc78100e20 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.596+0000 7efc7dd02640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 0x7efc780fcc80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc7400d950 tx=0x7efc7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.596+0000 7efc6effd640 1 -- 172.21.15.81:0/134461916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74017030 con 0x7efc78100e20 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.596+0000 7efc6effd640 1 -- 172.21.15.81:0/134461916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc74004020 con 0x7efc78100e20 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.596+0000 7efc6effd640 1 -- 172.21.15.81:0/134461916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74004a00 con 0x7efc78100e20 2024-09-12T12:16:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.596+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc781a6d40 con 0x7efc78100e20 2024-09-12T12:16:44.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.596+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc781a7270 con 0x7efc78100e20 2024-09-12T12:16:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.598+0000 7efc6effd640 1 -- 172.21.15.81:0/134461916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7efc740041d0 con 0x7efc78100e20 2024-09-12T12:16:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.598+0000 7efc8233f740 1 Processor -- start 2024-09-12T12:16:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 -- start start 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd4adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd57fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bcb1090 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bc58a70 con 0x55aa1bd55bb0 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc8233f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bcad050 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc6effd640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7efc640a2e00 0x7efc640a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd55670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55990/0 (socket says 172.21.15.81:55990) 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 -- 172.21.15.81:0/2101573980 learned_addr learned my addr 172.21.15.81:0/2101573980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:44.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7d501640 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd57fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7e503640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7efc640a2e00 0x7efc640a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7e503640 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd4adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc6effd640 1 -- 172.21.15.81:0/134461916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7efc740cef30 con 0x7efc78100e20 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 -- 172.21.15.81:0/2101573980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 msgr2=0x55aa1bd4adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd4adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 -- 172.21.15.81:0/2101573980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 msgr2=0x55aa1bd57fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd57fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.599+0000 7efc7dd02640 1 -- 172.21.15.81:0/2101573980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1bc65130 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.600+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd55670 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc74000c00 tx=0x7efc740052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3506ea13e06c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.600+0000 7efc63fff640 1 -- 172.21.15.81:0/2101573980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc740b4340 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.600+0000 7efc7e503640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7efc640a2e00 0x7efc640a52c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc70009430 tx=0x7efc70009360 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.600+0000 7efc63fff640 1 -- 172.21.15.81:0/2101573980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc7409b350 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.600+0000 7efc63fff640 1 -- 172.21.15.81:0/2101573980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc74097b20 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 -- 172.21.15.81:0/2101573980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 msgr2=0x55aa1bd55670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd55670 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc74000c00 tx=0x7efc740052d0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 -- 172.21.15.81:0/2101573980 shutdown_connections 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd57fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd55670 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 --2- 172.21.15.81:0/2101573980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd4adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 -- 172.21.15.81:0/2101573980 >> 172.21.15.81:0/2101573980 conn(0x55aa1bd46f60 msgr2=0x55aa1bd47340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 -- 172.21.15.81:0/2101573980 shutdown_connections 2024-09-12T12:16:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 -- 172.21.15.81:0/2101573980 wait complete. 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 -- start start 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.601+0000 7efc8233f740 1 Processor -- start 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd52840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd52d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd58720 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bc6bf20 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd588a0 con 0x55aa1bd55bb0 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc8233f740 10 client.0 _ll_register_callbacks cb 0x55aa1bc35030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56006/0 (socket says 172.21.15.81:56006) 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 -- 172.21.15.81:0/2116046774 learned_addr learned my addr 172.21.15.81:0/2116046774 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7d501640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd52840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7e503640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd52d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 -- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd55bb0 msgr2=0x55aa1bd52d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd52d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 -- 172.21.15.81:0/2116046774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4b2f0 msgr2=0x55aa1bd52840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd52840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 -- 172.21.15.81:0/2116046774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa1ba222b0 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7d501640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:16:44.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd554f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc7409b2e0 tx=0x7efc74005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d541a9fe3f1eec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc617fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.602+0000 7efc617fa640 1 -- 172.21.15.81:0/2116046774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7409f700 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc617fa640 1 -- 172.21.15.81:0/2116046774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7efc740cc8e0 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc7409b350 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc617fa640 1 -- 172.21.15.81:0/2116046774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc7407b050 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 10 client.15423 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa1bd640d0 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc617fa640 1 -- 172.21.15.81:0/2116046774 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc7409b350 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc617fa640 1 -- 172.21.15.81:0/2116046774 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efc74097130 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 10 client.15423 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 10 client.15423 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:16:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 20 client.15423 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bd65420 0x55aa1bd675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 4 client.15423 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 --> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa1bcbe600 con 0x55aa1bd65420 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.603+0000 7efc7d501640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bd65420 0x55aa1bd675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.604+0000 7efc7d501640 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bd65420 0x55aa1bd675d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30c58d15304d3c65 server_cookie=d2031898ca7ecf23 in_seq=0 out_seq=0 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.604+0000 7efc617fa640 10 client.15423 ms_handle_connect on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc617fa640 1 -- 172.21.15.81:0/2116046774 <== mds.2 v2:172.21.15.173:6838/2860435891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa1bcbe600 con 0x55aa1bd65420 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc617fa640 10 client.15423 handle_command_reply: tid=0 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 client.15423 shutdown 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 msgr2=0x55aa1bd554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd554f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc7409b2e0 tx=0x7efc74005d30 comp rx=0 tx=0).stop 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 shutdown_connections 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bd65420 0x55aa1bd675d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd52d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc617fa640 0 client.15423 ms_handle_reset on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 --2- 172.21.15.81:0/2116046774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd554f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 >> 172.21.15.81:0/2116046774 conn(0x55aa1bd46f60 msgr2=0x55aa1bd4cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 shutdown_connections 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 1 -- 172.21.15.81:0/2116046774 wait complete. 2024-09-12T12:16:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.605+0000 7efc8233f740 20 client.15423 trim_cache size 0 max 16384 2024-09-12T12:16:44.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.622+0000 7efc8233f740 1 Processor -- start 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.622+0000 7efc8233f740 1 -- start start 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc8233f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc8233f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc8233f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd45d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc8233f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd65910 con 0x55aa1bd55bb0 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc8233f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd65fe0 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc8233f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd666b0 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd45d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd45d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56018/0 (socket says 172.21.15.81:56018) 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 -- 172.21.15.81:0/2440340540 learned_addr learned my addr 172.21.15.81:0/2440340540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7d501640 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 -- 172.21.15.81:0/2440340540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4b2f0 msgr2=0x55aa1bd457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 -- 172.21.15.81:0/2440340540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4a9d0 msgr2=0x55aa1bd675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 -- 172.21.15.81:0/2440340540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1bd4b120 con 0x55aa1bd55bb0 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7dd02640 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc7e503640 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd45d20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc70009ca0 tx=0x7efc7003d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db869006509c670c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.623+0000 7efc637fe640 1 -- 172.21.15.81:0/2440340540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70034040 con 0x55aa1bd55bb0 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc637fe640 1 -- 172.21.15.81:0/2440340540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc7004f070 con 0x55aa1bd55bb0 2024-09-12T12:16:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc637fe640 1 -- 172.21.15.81:0/2440340540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700547f0 con 0x55aa1bd55bb0 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 -- 172.21.15.81:0/2440340540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 msgr2=0x55aa1bd45d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd45d20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc70009ca0 tx=0x7efc7003d040 comp rx=0 tx=0).stop 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 -- 172.21.15.81:0/2440340540 shutdown_connections 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd55bb0 0x55aa1bd45d20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 --2- 172.21.15.81:0/2440340540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 -- 172.21.15.81:0/2440340540 >> 172.21.15.81:0/2440340540 conn(0x55aa1bd46f60 msgr2=0x55aa1bd51930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 -- 172.21.15.81:0/2440340540 shutdown_connections 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 -- 172.21.15.81:0/2440340540 wait complete. 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.624+0000 7efc8233f740 1 -- start start 2024-09-12T12:16:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 Processor -- start 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd68930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd68e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bdce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd67450 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd66d80 con 0x55aa1bd55bb0 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55aa1bd67b20 con 0x55aa1bd4a9d0 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc8233f740 10 client.0 _ll_register_callbacks cb 0x7efc6800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd68e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd68e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56022/0 (socket says 172.21.15.81:56022) 2024-09-12T12:16:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 -- 172.21.15.81:0/3530716131 learned_addr learned my addr 172.21.15.81:0/3530716131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7e503640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bdce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7dd02640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd68930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 -- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 msgr2=0x55aa1bd68930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd68930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 -- 172.21.15.81:0/3530716131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 msgr2=0x55aa1bdce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bdce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.625+0000 7efc7d501640 1 -- 172.21.15.81:0/3530716131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa1bd69710 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc7d501640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd68e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55aa1bd482e0 tx=0x7efc6801d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799e5a95302274b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc617fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc617fa640 1 -- 172.21.15.81:0/3530716131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68005220 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc617fa640 1 -- 172.21.15.81:0/3530716131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7efc680053c0 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc7004f070 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc617fa640 1 -- 172.21.15.81:0/3530716131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc680055c0 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 10 client.15429 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aa1bdcfe70 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc617fa640 1 -- 172.21.15.81:0/3530716131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc7004f070 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc617fa640 1 -- 172.21.15.81:0/3530716131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efc6802d020 con 0x55aa1bd4b2f0 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 10 client.15429 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 20 client.15429 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bdd49b0 0x55aa1bdd36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 4 client.15429 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.626+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 --> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] -- command(tid 0: {"prefix": "status"}) -- 0x55aa1bcb8b10 con 0x55aa1bdd49b0 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc7dd02640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bdd49b0 0x55aa1bdd36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc617fa640 10 client.15429 ms_handle_connect on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc7dd02640 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bdd49b0 0x55aa1bdd36c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f95131ec9e0b599 server_cookie=fa4ca98e94f0c192 in_seq=0 out_seq=0 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc617fa640 1 -- 172.21.15.81:0/3530716131 <== mds.2 v2:172.21.15.173:6838/2860435891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55aa1bcb8b10 con 0x55aa1bdd49b0 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc617fa640 10 client.15429 handle_command_reply: tid=0 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc8233f740 1 client.15429 shutdown 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 msgr2=0x55aa1bd68e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.627+0000 7efc8233f740 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd68e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55aa1bd482e0 tx=0x7efc6801d810 comp rx=0 tx=0).stop 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 shutdown_connections 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:6838/2860435891,v1:172.21.15.173:6839/2860435891] conn(0x55aa1bdd49b0 0x55aa1bdd36c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55aa1bd55bb0 0x55aa1bdce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa1bd4b2f0 0x55aa1bd68e70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 --2- 172.21.15.81:0/3530716131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55aa1bd4a9d0 0x55aa1bd68930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc617fa640 0 client.15429 ms_handle_reset on v2:172.21.15.173:6838/2860435891 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 >> 172.21.15.81:0/3530716131 conn(0x55aa1bd46f60 msgr2=0x55aa1bd457e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 shutdown_connections 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 1 -- 172.21.15.81:0/3530716131 wait complete. 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc8233f740 20 client.15429 trim_cache size 0 max 16384 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24457, 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 120.441937727, 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 80, 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 148.314239095 2024-09-12T12:16:44.636 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:44.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7efc640a2e00 msgr2=0x7efc640a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7efc640a2e00 0x7efc640a52c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc70009430 tx=0x7efc70009360 comp rx=0 tx=0).stop 2024-09-12T12:16:44.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 msgr2=0x7efc780fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:44.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 0x7efc780fcc80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc7400d950 tx=0x7efc7400de10 comp rx=0 tx=0).stop 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 shutdown_connections 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7efc640a2e00 0x7efc640a52c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efc78102ef0 0x7efc780fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc78102570 0x7efc780fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 --2- 172.21.15.81:0/134461916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc78100e20 0x7efc780fcc80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 >> 172.21.15.81:0/134461916 conn(0x7efc780fc7d0 msgr2=0x7efc7806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 shutdown_connections 2024-09-12T12:16:44.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:44.628+0000 7efc7ff66640 1 -- 172.21.15.81:0/134461916 wait complete. 2024-09-12T12:16:44.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:44 smithi081 ceph-mon[30948]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 41 KiB/s wr, 30 op/s 2024-09-12T12:16:44.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:44 smithi103 ceph-mon[35094]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 41 KiB/s wr, 30 op/s 2024-09-12T12:16:45.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:44 smithi173 ceph-mon[35326]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 41 KiB/s wr, 30 op/s 2024-09-12T12:16:45.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-12T12:16:45.627 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 -- 172.21.15.81:0/1617348645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0100e20 msgr2=0x7fafd0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/1617348645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0100e20 0x7fafd0101200 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009ca0 tx=0x7fafc802a950 comp rx=0 tx=0).stop 2024-09-12T12:16:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 -- 172.21.15.81:0/1617348645 shutdown_connections 2024-09-12T12:16:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/1617348645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0102ef0 0x7fafd010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/1617348645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd0102570 0x7fafd01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/1617348645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0100e20 0x7fafd0101200 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 -- 172.21.15.81:0/1617348645 >> 172.21.15.81:0/1617348645 conn(0x7fafd00fc7d0 msgr2=0x7fafd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 -- 172.21.15.81:0/1617348645 shutdown_connections 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.122+0000 7fafd4ef6640 1 -- 172.21.15.81:0/1617348645 wait complete. 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.123+0000 7fafd4ef6640 1 Processor -- start 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.123+0000 7fafd4ef6640 1 -- start start 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd0100e20 0x7fafd0198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0102570 0x7fafd0198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 0x7fafd019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01110a0 con 0x7fafd0102ef0 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0110f20 con 0x7fafd0100e20 2024-09-12T12:16:46.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0111220 con 0x7fafd0102570 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 0x7fafd019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 0x7fafd019cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56036/0 (socket says 172.21.15.81:56036) 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 -- 172.21.15.81:0/3736856593 learned_addr learned my addr 172.21.15.81:0/3736856593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafce59c640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd0100e20 0x7fafd0198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0102570 0x7fafd0198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 -- 172.21.15.81:0/3736856593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0102570 msgr2=0x7fafd0198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0102570 0x7fafd0198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 -- 172.21.15.81:0/3736856593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd0100e20 msgr2=0x7fafd0198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd0100e20 0x7fafd0198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 -- 172.21.15.81:0/3736856593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd019d5d0 con 0x7fafd0102ef0 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafced9d640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 0x7fafd019cef0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fafc000d750 tx=0x7fafc000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafc77fe640 1 -- 172.21.15.81:0/3736856593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0017070 con 0x7fafd0102ef0 2024-09-12T12:16:46.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd019d8c0 con 0x7fafd0102ef0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafc77fe640 1 -- 172.21.15.81:0/3736856593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafc0005520 con 0x7fafd0102ef0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafc77fe640 1 -- 172.21.15.81:0/3736856593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0004e00 con 0x7fafd0102ef0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.124+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd01a51a0 con 0x7fafd0102ef0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafc77fe640 1 -- 172.21.15.81:0/3736856593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fafc0004fa0 con 0x7fafd0102ef0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 Processor -- start 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 -- start start 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2239d0 0x55bc2a223db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a22e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a230fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a18a090 con 0x55bc2a22ebb0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a131a70 con 0x55bc2a2242f0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafd72cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a186050 con 0x55bc2a2239d0 2024-09-12T12:16:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.127+0000 7fafcdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a230fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a230fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56042/0 (socket says 172.21.15.81:56042) 2024-09-12T12:16:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 -- 172.21.15.81:0/1956457548 learned_addr learned my addr 172.21.15.81:0/1956457548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafce59c640 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a22e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2239d0 0x55bc2a223db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 -- 172.21.15.81:0/1956457548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2239d0 msgr2=0x55bc2a223db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2239d0 0x55bc2a223db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 -- 172.21.15.81:0/1956457548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 msgr2=0x55bc2a22e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a22e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 -- 172.21.15.81:0/1956457548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2a13e130 con 0x55bc2a22ebb0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafc77fe640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fafbc0a2d80 0x7fafbc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafce59c640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fafbc0a2d80 0x7fafbc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafc77fe640 1 -- 172.21.15.81:0/3736856593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fafc00ceef0 con 0x7fafd0102ef0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a230fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fafb80135f0 tx=0x7fafb800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ffc522c9d04bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafc4ff9640 1 -- 172.21.15.81:0/1956457548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8019030 con 0x55bc2a22ebb0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafc4ff9640 1 -- 172.21.15.81:0/1956457548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafb8005520 con 0x55bc2a22ebb0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.128+0000 7fafc4ff9640 1 -- 172.21.15.81:0/1956457548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8011780 con 0x55bc2a22ebb0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 -- 172.21.15.81:0/1956457548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 msgr2=0x55bc2a230fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafce59c640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fafbc0a2d80 0x7fafbc0a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009430 tx=0x7fafc8005f50 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:46.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a230fa0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fafb80135f0 tx=0x7fafb800c710 comp rx=0 tx=0).stop 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 -- 172.21.15.81:0/1956457548 shutdown_connections 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a230fa0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a22e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1956457548 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2239d0 0x55bc2a223db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 -- 172.21.15.81:0/1956457548 >> 172.21.15.81:0/1956457548 conn(0x55bc2a21ff60 msgr2=0x55bc2a220340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 -- 172.21.15.81:0/1956457548 shutdown_connections 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.129+0000 7fafd72cf740 1 -- 172.21.15.81:0/1956457548 wait complete. 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 -- start start 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 Processor -- start 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a22e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a231780 con 0x55bc2a22ebb0 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a144f20 con 0x55bc2a2239d0 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a231900 con 0x55bc2a2242f0 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafd72cf740 10 client.0 _ll_register_callbacks cb 0x55bc2a10e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56054/0 (socket says 172.21.15.81:56054) 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 -- 172.21.15.81:0/1643991150 learned_addr learned my addr 172.21.15.81:0/1643991150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafce59c640 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a22e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 -- 172.21.15.81:0/1643991150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2242f0 msgr2=0x55bc2a22b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 -- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 msgr2=0x55bc2a22e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a22e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 -- 172.21.15.81:0/1643991150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc29efb2b0 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafced9d640 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bce0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fafc000d720 tx=0x7fafc000de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896a26c00a85cbff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.130+0000 7fafb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafb5ffb640 1 -- 172.21.15.81:0/1643991150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0020070 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafb5ffb640 1 -- 172.21.15.81:0/1643991150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fafc0097980 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb8005520 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafb5ffb640 1 -- 172.21.15.81:0/1643991150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fafc009ba10 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 10 client.15441 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc2a23d0a0 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafb5ffb640 1 -- 172.21.15.81:0/1643991150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafb8005520 con 0x55bc2a22ebb0 2024-09-12T12:16:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafb5ffb640 1 -- 172.21.15.81:0/1643991150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fafc00cc8a0 con 0x55bc2a22ebb0 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 10 client.15441 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 10 client.15441 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 20 client.15441 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a23f720 0x55bc2a240b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 4 client.15441 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.131+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 --> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc2a197600 con 0x55bc2a23f720 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.132+0000 7fafce59c640 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a23f720 0x55bc2a240b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.132+0000 7fafb5ffb640 10 client.15441 ms_handle_connect on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.132+0000 7fafce59c640 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a23f720 0x55bc2a240b90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfa6b9ec375895a4 server_cookie=8741b4feb89ee359 in_seq=0 out_seq=0 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafb5ffb640 1 -- 172.21.15.81:0/1643991150 <== mds.1 v2:172.21.15.103:6836/4210602713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc2a197600 con 0x55bc2a23f720 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafb5ffb640 10 client.15441 handle_command_reply: tid=0 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 client.15441 shutdown 2024-09-12T12:16:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 msgr2=0x55bc2a22bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bce0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fafc000d720 tx=0x7fafc000de60 comp rx=0 tx=0).stop 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 shutdown_connections 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a23f720 0x55bc2a240b90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bce0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 --2- 172.21.15.81:0/1643991150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a22e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafb5ffb640 0 client.15441 ms_handle_reset on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 >> 172.21.15.81:0/1643991150 conn(0x55bc2a21ff60 msgr2=0x55bc2a225c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 shutdown_connections 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 1 -- 172.21.15.81:0/1643991150 wait complete. 2024-09-12T12:16:46.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.133+0000 7fafd72cf740 20 client.15441 trim_cache size 0 max 16384 2024-09-12T12:16:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.150+0000 7fafd72cf740 1 Processor -- start 2024-09-12T12:16:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.150+0000 7fafd72cf740 1 -- start start 2024-09-12T12:16:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a23fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafd72cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a23eed0 con 0x55bc2a2242f0 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafd72cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a23f5a0 con 0x55bc2a2239d0 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafd72cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a23fc70 con 0x55bc2a22ebb0 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56058/0 (socket says 172.21.15.81:56058) 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 -- 172.21.15.81:0/2823333766 learned_addr learned my addr 172.21.15.81:0/2823333766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafced9d640 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafce59c640 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a23fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 -- 172.21.15.81:0/2823333766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 msgr2=0x55bc2a22bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 -- 172.21.15.81:0/2823333766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 msgr2=0x55bc2a23fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a23fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 -- 172.21.15.81:0/2823333766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc2a231890 con 0x55bc2a2242f0 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafce59c640 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a23fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b760 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fafb8016040 tx=0x7fafb8005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6691f5b8571ab3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.151+0000 7fafb7fff640 1 -- 172.21.15.81:0/2823333766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8019040 con 0x55bc2a2242f0 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafb7fff640 1 -- 172.21.15.81:0/2823333766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafb8004680 con 0x55bc2a2242f0 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafb7fff640 1 -- 172.21.15.81:0/2823333766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8011740 con 0x55bc2a2242f0 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 -- 172.21.15.81:0/2823333766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 msgr2=0x55bc2a22b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b760 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fafb8016040 tx=0x7fafb8005a90 comp rx=0 tx=0).stop 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 -- 172.21.15.81:0/2823333766 shutdown_connections 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a22bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2242f0 0x55bc2a22b760 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 --2- 172.21.15.81:0/2823333766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2239d0 0x55bc2a23fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 -- 172.21.15.81:0/2823333766 >> 172.21.15.81:0/2823333766 conn(0x55bc2a21ff60 msgr2=0x55bc2a21ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 -- 172.21.15.81:0/2823333766 shutdown_connections 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.152+0000 7fafd72cf740 1 -- 172.21.15.81:0/2823333766 wait complete. 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 -- start start 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 Processor -- start 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2239d0 0x55bc2a227bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a2280f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a228630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a240a10 con 0x55bc2a2239d0 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a240340 con 0x55bc2a2242f0 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55bc2a2410e0 con 0x55bc2a22ebb0 2024-09-12T12:16:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.153+0000 7fafd72cf740 10 client.0 _ll_register_callbacks cb 0x7fafc00b9f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafce59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2239d0 0x55bc2a227bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafced9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a228630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafce59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2239d0 0x55bc2a227bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56064/0 (socket says 172.21.15.81:56064) 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a2280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafce59c640 1 -- 172.21.15.81:0/4032338582 learned_addr learned my addr 172.21.15.81:0/4032338582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafced9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a228630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.81:42928/0 (socket says 172.21.15.81:42928) 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 -- 172.21.15.81:0/4032338582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 msgr2=0x55bc2a228630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a228630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 -- 172.21.15.81:0/4032338582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2239d0 msgr2=0x55bc2a227bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:46.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2239d0 0x55bc2a227bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 -- 172.21.15.81:0/4032338582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc2a248050 con 0x55bc2a2242f0 2024-09-12T12:16:46.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafcdd9b640 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a2280f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55bc2a211b60 tx=0x7fafb800ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d05992dc10130b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:46.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-12T12:16:46.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafb5ffb640 1 -- 172.21.15.81:0/4032338582 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8035060 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.154+0000 7fafb5ffb640 1 -- 172.21.15.81:0/4032338582 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fafb8013240 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb8004680 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafb5ffb640 1 -- 172.21.15.81:0/4032338582 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fafb8004020 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 10 client.25001 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bc2a2492c0 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafb5ffb640 1 -- 172.21.15.81:0/4032338582 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafb8004680 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafb5ffb640 1 -- 172.21.15.81:0/4032338582 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fafb8038030 con 0x55bc2a2242f0 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 10 client.25001 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 10 client.25001 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 20 client.25001 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:46.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a2ada30 0x55bc2a2ac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 4 client.25001 mds_command: new command op to 24461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.155+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 --> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] -- command(tid 0: {"prefix": "status"}) -- 0x55bc2a191b10 con 0x55bc2a2ada30 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafce59c640 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a2ada30 0x55bc2a2ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafb5ffb640 10 client.25001 ms_handle_connect on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafce59c640 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a2ada30 0x55bc2a2ac740 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8831ccf0da46a643 server_cookie=dd33ca3771764dee in_seq=0 out_seq=0 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafb5ffb640 1 -- 172.21.15.81:0/4032338582 <== mds.1 v2:172.21.15.103:6836/4210602713 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bc2a191b10 con 0x55bc2a2ada30 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafb5ffb640 10 client.25001 handle_command_reply: tid=0 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 client.25001 shutdown 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 msgr2=0x55bc2a2280f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a2280f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55bc2a211b60 tx=0x7fafb800ce20 comp rx=0 tx=0).stop 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 shutdown_connections 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:6836/4210602713,v1:172.21.15.103:6837/4210602713] conn(0x55bc2a2ada30 0x55bc2a2ac740 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55bc2a22ebb0 0x55bc2a228630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bc2a2242f0 0x55bc2a2280f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 --2- 172.21.15.81:0/4032338582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc2a2239d0 0x55bc2a227bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 >> 172.21.15.81:0/4032338582 conn(0x55bc2a21ff60 msgr2=0x55bc2a22b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.156+0000 7fafb5ffb640 0 client.25001 ms_handle_reset on v2:172.21.15.103:6836/4210602713 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 shutdown_connections 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd72cf740 1 -- 172.21.15.81:0/4032338582 wait complete. 2024-09-12T12:16:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd72cf740 20 client.25001 trim_cache size 0 max 16384 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24461, 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 122.979252437, 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 80, 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 152.41641105100001 2024-09-12T12:16:46.174 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fafbc0a2d80 msgr2=0x7fafbc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fafbc0a2d80 0x7fafbc0a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009430 tx=0x7fafc8005f50 comp rx=0 tx=0).stop 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 msgr2=0x7fafd019cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 0x7fafd019cef0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fafc000d750 tx=0x7fafc000dc10 comp rx=0 tx=0).stop 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 shutdown_connections 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fafbc0a2d80 0x7fafbc0a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafd0102ef0 0x7fafd019cef0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fafd0102570 0x7fafd0198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 --2- 172.21.15.81:0/3736856593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafd0100e20 0x7fafd0198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.157+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 >> 172.21.15.81:0/3736856593 conn(0x7fafd00fc7d0 msgr2=0x7fafd006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.158+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 shutdown_connections 2024-09-12T12:16:46.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:46.158+0000 7fafd4ef6640 1 -- 172.21.15.81:0/3736856593 wait complete. 2024-09-12T12:16:46.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:46 smithi081 ceph-mon[30948]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T12:16:46.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T12:16:46.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:46 smithi103 ceph-mon[35094]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T12:16:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:16:47.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:46 smithi173 ceph-mon[35326]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T12:16:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 -- 172.21.15.81:0/849176355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 msgr2=0x7fed8c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 --2- 172.21.15.81:0/849176355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c1021c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009900 tx=0x7fed7c02a410 comp rx=0 tx=0).stop 2024-09-12T12:16:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 -- 172.21.15.81:0/849176355 shutdown_connections 2024-09-12T12:16:47.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 --2- 172.21.15.81:0/849176355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c106f10 0x7fed8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 --2- 172.21.15.81:0/849176355 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed8c102790 0x7fed8c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 --2- 172.21.15.81:0/849176355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c1021c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 -- 172.21.15.81:0/849176355 >> 172.21.15.81:0/849176355 conn(0x7fed8c0fd8c0 msgr2=0x7fed8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 -- 172.21.15.81:0/849176355 shutdown_connections 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.570+0000 7fed90f5a640 1 -- 172.21.15.81:0/849176355 wait complete. 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 Processor -- start 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 -- start start 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c102790 0x7fed8c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed8c106f10 0x7fed8c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c112090 con 0x7fed8c101de0 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c111f10 con 0x7fed8c102790 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed90f5a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c112210 con 0x7fed8c106f10 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56084/0 (socket says 172.21.15.81:56084) 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.571+0000 7fed8a59c640 1 -- 172.21.15.81:0/66446713 learned_addr learned my addr 172.21.15.81:0/66446713 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed83fff640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c102790 0x7fed8c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8a59c640 1 -- 172.21.15.81:0/66446713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed8c106f10 msgr2=0x7fed8c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed8c106f10 0x7fed8c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8a59c640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed8c106f10 0x7fed8c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8a59c640 1 -- 172.21.15.81:0/66446713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c102790 msgr2=0x7fed8c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8a59c640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c102790 0x7fed8c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8a59c640 1 -- 172.21.15.81:0/66446713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c19d440 con 0x7fed8c101de0 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed83fff640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c102790 0x7fed8c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:47.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed8a59c640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c198490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fed7c006010 tx=0x7fed7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed837fe640 1 -- 172.21.15.81:0/66446713 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c03f030 con 0x7fed8c101de0 2024-09-12T12:16:47.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed837fe640 1 -- 172.21.15.81:0/66446713 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed7c003d00 con 0x7fed8c101de0 2024-09-12T12:16:47.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed8c19d6d0 con 0x7fed8c101de0 2024-09-12T12:16:47.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed837fe640 1 -- 172.21.15.81:0/66446713 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c035070 con 0x7fed8c101de0 2024-09-12T12:16:47.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.572+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed8c1a5010 con 0x7fed8c101de0 2024-09-12T12:16:47.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.575+0000 7fed837fe640 1 -- 172.21.15.81:0/66446713 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7fed7c042030 con 0x7fed8c101de0 2024-09-12T12:16:47.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.575+0000 7fed93333740 1 Processor -- start 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.575+0000 7fed93333740 1 -- start start 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed93333740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b821cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed93333740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b822ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed93333740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b822e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed93333740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b8183090 con 0x5637b822bfc0 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed93333740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637b812aa70 con 0x5637b821c8b0 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed93333740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5637b817f050 con 0x5637b821d1d0 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b822e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b822e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56096/0 (socket says 172.21.15.81:56096) 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 -- 172.21.15.81:0/2997202457 learned_addr learned my addr 172.21.15.81:0/2997202457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed8a59c640 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b822ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b821cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 -- 172.21.15.81:0/2997202457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 msgr2=0x5637b822ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b822ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 -- 172.21.15.81:0/2997202457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 msgr2=0x5637b821cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b821cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 -- 172.21.15.81:0/2997202457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b8137130 con 0x5637b822bfc0 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed8a59c640 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b822ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed837fe640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fed780a2d80 0x7fed780a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed83fff640 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b822e3b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fed7400bb40 tx=0x7fed7400d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e93727d8a528b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.576+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fed780a2d80 0x7fed780a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.577+0000 7fed837fe640 1 -- 172.21.15.81:0/66446713 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fed7c0eff50 con 0x7fed8c101de0 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.577+0000 7fed80ff9640 1 -- 172.21.15.81:0/2997202457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74017420 con 0x5637b822bfc0 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.577+0000 7fed80ff9640 1 -- 172.21.15.81:0/2997202457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed74017ac0 con 0x5637b822bfc0 2024-09-12T12:16:47.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.577+0000 7fed80ff9640 1 -- 172.21.15.81:0/2997202457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7400fc80 con 0x5637b822bfc0 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- 172.21.15.81:0/2997202457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 msgr2=0x5637b822e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fed780a2d80 0x7fed780a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed84005cc0 tx=0x7fed8400b340 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b822e3b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fed7400bb40 tx=0x7fed7400d340 comp rx=0 tx=0).stop 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- 172.21.15.81:0/2997202457 shutdown_connections 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b822e3b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b822ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- 172.21.15.81:0/2997202457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b821cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- 172.21.15.81:0/2997202457 >> 172.21.15.81:0/2997202457 conn(0x5637b8218f60 msgr2=0x5637b8219340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- 172.21.15.81:0/2997202457 shutdown_connections 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- 172.21.15.81:0/2997202457 wait complete. 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- start start 2024-09-12T12:16:47.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 Processor -- start 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b822b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 0x5637b8228b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b822bfc0 0x5637b82290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b822eb90 con 0x5637b821d1d0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637b813df20 con 0x5637b821c8b0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5637b822ed10 con 0x5637b822bfc0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 0x5637b8228b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.578+0000 7fed93333740 10 client.0 _ll_register_callbacks cb 0x5637b8107030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 0x5637b8228b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56098/0 (socket says 172.21.15.81:56098) 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 -- 172.21.15.81:0/3589730004 learned_addr learned my addr 172.21.15.81:0/3589730004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed8a59c640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b822b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b822bfc0 0x5637b82290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 -- 172.21.15.81:0/3589730004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b822bfc0 msgr2=0x5637b82290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b822bfc0 0x5637b82290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 -- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 msgr2=0x5637b822b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b822b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 -- 172.21.15.81:0/3589730004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b7ef42b0 con 0x5637b821d1d0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed83fff640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 0x5637b8228b80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fed74019040 tx=0x7fed7400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18d834abd1b1e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed71ffb640 1 -- 172.21.15.81:0/3589730004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74026070 con 0x5637b821d1d0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed71ffb640 1 -- 172.21.15.81:0/3589730004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fed7400fc10 con 0x5637b821d1d0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed74017ac0 con 0x5637b821d1d0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed71ffb640 1 -- 172.21.15.81:0/3589730004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed74032050 con 0x5637b821d1d0 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed93333740 10 client.15459 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.579+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5637b823a4c0 con 0x5637b821d1d0 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed71ffb640 1 -- 172.21.15.81:0/3589730004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed74017ac0 con 0x5637b821d1d0 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed71ffb640 1 -- 172.21.15.81:0/3589730004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fed74022ab0 con 0x5637b821d1d0 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed93333740 10 client.15459 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed93333740 10 client.15459 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed93333740 20 client.15459 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed93333740 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b823c6f0 0x5637b823db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed93333740 4 client.15459 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637b8190600 con 0x5637b823c6f0 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.580+0000 7fed8a59c640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b823c6f0 0x5637b823db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed71ffb640 10 client.15459 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed8a59c640 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b823c6f0 0x5637b823db60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecfaf8a6ede67db server_cookie=5bb78f43716058b0 in_seq=0 out_seq=0 2024-09-12T12:16:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed71ffb640 1 -- 172.21.15.81:0/3589730004 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637b8190600 con 0x5637b823c6f0 2024-09-12T12:16:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed71ffb640 10 client.15459 handle_command_reply: tid=0 2024-09-12T12:16:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed93333740 1 client.15459 shutdown 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 msgr2=0x5637b8228b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.581+0000 7fed93333740 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 0x5637b8228b80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fed74019040 tx=0x7fed7400b880 comp rx=0 tx=0).stop 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 shutdown_connections 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b823c6f0 0x5637b823db60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b822bfc0 0x5637b82290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821d1d0 0x5637b8228b80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed71ffb640 0 client.15459 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 --2- 172.21.15.81:0/3589730004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821c8b0 0x5637b822b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 >> 172.21.15.81:0/3589730004 conn(0x5637b8218f60 msgr2=0x5637b821ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 shutdown_connections 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 1 -- 172.21.15.81:0/3589730004 wait complete. 2024-09-12T12:16:47.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.582+0000 7fed93333740 20 client.15459 trim_cache size 0 max 16384 2024-09-12T12:16:47.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 Processor -- start 2024-09-12T12:16:47.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 -- start start 2024-09-12T12:16:47.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821c8b0 0x5637b823db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821d1d0 0x5637b8224130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b8225e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b823bea0 con 0x5637b822bfc0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637b823c570 con 0x5637b821d1d0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed93333740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5637b823cc40 con 0x5637b821c8b0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.599+0000 7fed8ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b8225e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b8225e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56106/0 (socket says 172.21.15.81:56106) 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 -- 172.21.15.81:0/2000419852 learned_addr learned my addr 172.21.15.81:0/2000419852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed83fff640 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821d1d0 0x5637b8224130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8a59c640 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821c8b0 0x5637b823db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 -- 172.21.15.81:0/2000419852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821c8b0 msgr2=0x5637b823db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821c8b0 0x5637b823db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 -- 172.21.15.81:0/2000419852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821d1d0 msgr2=0x5637b8224130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821d1d0 0x5637b8224130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 -- 172.21.15.81:0/2000419852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637b821d000 con 0x5637b822bfc0 2024-09-12T12:16:47.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b8225e00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fed84011790 tx=0x7fed84013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1384ef902b04454c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed73fff640 1 -- 172.21.15.81:0/2000419852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84011e50 con 0x5637b822bfc0 2024-09-12T12:16:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed73fff640 1 -- 172.21.15.81:0/2000419852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed8401ee40 con 0x5637b822bfc0 2024-09-12T12:16:47.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.600+0000 7fed73fff640 1 -- 172.21.15.81:0/2000419852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840273d0 con 0x5637b822bfc0 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 -- 172.21.15.81:0/2000419852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 msgr2=0x5637b8225e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b8225e00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fed84011790 tx=0x7fed84013000 comp rx=0 tx=0).stop 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 -- 172.21.15.81:0/2000419852 shutdown_connections 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b822bfc0 0x5637b8225e00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b821d1d0 0x5637b8224130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 --2- 172.21.15.81:0/2000419852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821c8b0 0x5637b823db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 -- 172.21.15.81:0/2000419852 >> 172.21.15.81:0/2000419852 conn(0x5637b8218f60 msgr2=0x5637b8223a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 -- 172.21.15.81:0/2000419852 shutdown_connections 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 -- 172.21.15.81:0/2000419852 wait complete. 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 -- start start 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 Processor -- start 2024-09-12T12:16:47.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 0x5637b8246670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.601+0000 7fed93333740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b8225a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed93333740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b822bfc0 0x5637b8226080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed93333740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5637b823d9e0 con 0x5637b821c8b0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed93333740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5637b823d310 con 0x5637b822bfc0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed93333740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5637b823e0b0 con 0x5637b821d1d0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed93333740 10 client.0 _ll_register_callbacks cb 0x7fed7400b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 0x5637b8246670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 0x5637b8246670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56108/0 (socket says 172.21.15.81:56108) 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed83fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b8225a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 -- 172.21.15.81:0/3283469679 learned_addr learned my addr 172.21.15.81:0/3283469679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b822bfc0 0x5637b8226080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 -- 172.21.15.81:0/3283469679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 msgr2=0x5637b8225a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b8225a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 -- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b822bfc0 msgr2=0x5637b8226080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b822bfc0 0x5637b8226080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 -- 172.21.15.81:0/3283469679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637b8226880 con 0x5637b821c8b0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8ad9d640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b822bfc0 0x5637b8226080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed8a59c640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 0x5637b8246670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0b87d0 tx=0x7fed7c03b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d171049d636189 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed71ffb640 1 -- 172.21.15.81:0/3283469679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c0ede60 con 0x5637b821c8b0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed71ffb640 1 -- 172.21.15.81:0/3283469679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fed7c0f20b0 con 0x5637b821c8b0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.602+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed8401ee40 con 0x5637b821c8b0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed71ffb640 1 -- 172.21.15.81:0/3283469679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed7c049040 con 0x5637b821c8b0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 10 client.15465 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5637b82a6ef0 con 0x5637b821c8b0 2024-09-12T12:16:47.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed71ffb640 1 -- 172.21.15.81:0/3283469679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed8401ee40 con 0x5637b821c8b0 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed71ffb640 1 -- 172.21.15.81:0/3283469679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fed7c03b4f0 con 0x5637b821c8b0 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 10 client.15465 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 10 client.15465 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 20 client.15465 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b82aba50 0x5637b82aa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 4 client.15465 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "status"}) -- 0x5637b818ab10 con 0x5637b82aba50 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.603+0000 7fed83fff640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b82aba50 0x5637b82aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed83fff640 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b82aba50 0x5637b82aa760 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f28081bddba03e3 server_cookie=52d6eba46cb6a69f in_seq=0 out_seq=0 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed71ffb640 10 client.15465 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed71ffb640 1 -- 172.21.15.81:0/3283469679 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5637b818ab10 con 0x5637b82aba50 2024-09-12T12:16:47.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed71ffb640 10 client.15465 handle_command_reply: tid=0 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 client.15465 shutdown 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 msgr2=0x5637b8246670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 0x5637b8246670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0b87d0 tx=0x7fed7c03b890 comp rx=0 tx=0).stop 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 shutdown_connections 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5637b82aba50 0x5637b82aa760 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5637b822bfc0 0x5637b8226080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5637b821d1d0 0x5637b8225a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 --2- 172.21.15.81:0/3283469679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637b821c8b0 0x5637b8246670 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 >> 172.21.15.81:0/3283469679 conn(0x5637b8218f60 msgr2=0x5637b8224240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed71ffb640 0 client.15465 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 shutdown_connections 2024-09-12T12:16:47.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 1 -- 172.21.15.81:0/3283469679 wait complete. 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.604+0000 7fed93333740 20 client.15465 trim_cache size 0 max 16384 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "595bfb7a-70ff-11ef-bcea-c7b262605968", 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24485, 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-12T12:16:47.611 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 131.224130589, 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 27, 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 80, 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 142.084198321 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fed780a2d80 msgr2=0x7fed780a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fed780a2d80 0x7fed780a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed84005cc0 tx=0x7fed8400b340 comp rx=0 tx=0).stop 2024-09-12T12:16:47.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 msgr2=0x7fed8c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c198490 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fed7c006010 tx=0x7fed7c0042f0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 shutdown_connections 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fed780a2d80 0x7fed780a5240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed8c106f10 0x7fed8c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8c102790 0x7fed8c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 --2- 172.21.15.81:0/66446713 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c101de0 0x7fed8c198490 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 >> 172.21.15.81:0/66446713 conn(0x7fed8c0fd8c0 msgr2=0x7fed8c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 shutdown_connections 2024-09-12T12:16:47.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:16:47.605+0000 7fed90f5a640 1 -- 172.21.15.81:0/66446713 wait complete. 2024-09-12T12:16:48.295 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-12T12:16:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:49 smithi081 ceph-mon[30948]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-09-12T12:16:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:49 smithi173 ceph-mon[35326]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-09-12T12:16:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:49 smithi103 ceph-mon[35094]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 KiB/s wr, 17 op/s 2024-09-12T12:16:51.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:51 smithi081 ceph-mon[30948]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T12:16:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:51 smithi173 ceph-mon[35326]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T12:16:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:51 smithi103 ceph-mon[35094]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-09-12T12:16:53.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:53 smithi081 ceph-mon[30948]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-12T12:16:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:53 smithi173 ceph-mon[35326]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-12T12:16:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:53 smithi103 ceph-mon[35094]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-12T12:16:54.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 -- 172.21.15.81:0/2410513303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa8100850 msgr2=0x7f9fa8100c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 --2- 172.21.15.81:0/2410513303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa8100850 0x7f9fa8100c30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009930 tx=0x7f9f9802a420 comp rx=0 tx=0).stop 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 -- 172.21.15.81:0/2410513303 shutdown_connections 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 --2- 172.21.15.81:0/2410513303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa8108110 0x7f9fa810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 --2- 172.21.15.81:0/2410513303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa8101200 0x7f9fa81079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 --2- 172.21.15.81:0/2410513303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa8100850 0x7f9fa8100c30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 -- 172.21.15.81:0/2410513303 >> 172.21.15.81:0/2410513303 conn(0x7f9fa8075db0 msgr2=0x7f9fa80761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 -- 172.21.15.81:0/2410513303 shutdown_connections 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 -- 172.21.15.81:0/2410513303 wait complete. 2024-09-12T12:16:54.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 Processor -- start 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.118+0000 7f9fae58d640 1 -- start start 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fae58d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa8100850 0x7f9fa8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fae58d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa8108110 0x7f9fa81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fae58d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 0x7f9fa819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fae58d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8112030 con 0x7f9fa819cd20 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fae58d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8111eb0 con 0x7f9fa8108110 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fae58d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81121b0 con 0x7f9fa8100850 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 0x7f9fa819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 0x7f9fa819d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36732/0 (socket says 172.21.15.81:36732) 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 -- 172.21.15.81:0/3987707123 learned_addr learned my addr 172.21.15.81:0/3987707123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:54.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa8108110 0x7f9fa81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa8100850 0x7f9fa8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 -- 172.21.15.81:0/3987707123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa8100850 msgr2=0x7f9fa8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa8100850 0x7f9fa8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 -- 172.21.15.81:0/3987707123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa8108110 msgr2=0x7f9fa81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa8108110 0x7f9fa81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 -- 172.21.15.81:0/3987707123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa819d810 con 0x7f9fa819cd20 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.119+0000 7f9facb2a640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 0x7f9fa819d1d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000cce0 tx=0x7f9fa000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.120+0000 7f9fa57fa640 1 -- 172.21.15.81:0/3987707123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000f450 con 0x7f9fa819cd20 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.120+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa819db00 con 0x7f9fa819cd20 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.120+0000 7f9fa57fa640 1 -- 172.21.15.81:0/3987707123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fa000faf0 con 0x7f9fa819cd20 2024-09-12T12:16:54.124 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.120+0000 7f9fa57fa640 1 -- 172.21.15.81:0/3987707123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0018cc0 con 0x7f9fa819cd20 2024-09-12T12:16:54.125 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.120+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa81a5270 con 0x7f9fa819cd20 2024-09-12T12:16:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.122+0000 7f9fa57fa640 1 -- 172.21.15.81:0/3987707123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 138009+0+0 (secure 0 0 0) 0x7f9fa000f5f0 con 0x7f9fa819cd20 2024-09-12T12:16:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.122+0000 7f9fb1403740 1 Processor -- start 2024-09-12T12:16:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.122+0000 7f9fb1403740 1 -- start start 2024-09-12T12:16:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac51af0 0x556f0ac51ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 0x556f0ac5c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fb1403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556f0abb62f0 con 0x556f0ac52410 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fb1403740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556f0ab5e270 con 0x556f0ac5ccb0 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fb1403740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556f0abb22b0 con 0x556f0ac51af0 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 0x556f0ac5c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac51af0 0x556f0ac51ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 0x556f0ac5c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36738/0 (socket says 172.21.15.81:36738) 2024-09-12T12:16:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 -- 172.21.15.81:0/2113546218 learned_addr learned my addr 172.21.15.81:0/2113546218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa57fa640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f9f900a2e40 0x7f9f900a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 -- 172.21.15.81:0/2113546218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac51af0 msgr2=0x556f0ac51ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac51af0 0x556f0ac51ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 -- 172.21.15.81:0/2113546218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac5ccb0 msgr2=0x556f0ac5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 -- 172.21.15.81:0/2113546218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0ab5d340 con 0x556f0ac52410 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9facb2a640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f9f900a2e40 0x7f9f900a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa57fa640 1 -- 172.21.15.81:0/3987707123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f9fa00cfa10 con 0x7f9fa819cd20 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.123+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 0x556f0ac5c770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009930 tx=0x7f9f98032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61055195c44ac17a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9f8e7fc640 1 -- 172.21.15.81:0/2113546218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9803f070 con 0x556f0ac52410 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9f8e7fc640 1 -- 172.21.15.81:0/2113546218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f98032e20 con 0x556f0ac52410 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9f8e7fc640 1 -- 172.21.15.81:0/2113546218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98035070 con 0x556f0ac52410 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 -- 172.21.15.81:0/2113546218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 msgr2=0x556f0ac5c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9facb2a640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f9f900a2e40 0x7f9f900a5300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00cd170 tx=0x7f9fa00912c0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 0x556f0ac5c770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009930 tx=0x7f9f98032d30 comp rx=0 tx=0).stop 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 -- 172.21.15.81:0/2113546218 shutdown_connections 2024-09-12T12:16:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac52410 0x556f0ac5c770 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2113546218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac51af0 0x556f0ac51ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 -- 172.21.15.81:0/2113546218 >> 172.21.15.81:0/2113546218 conn(0x556f0ac4e060 msgr2=0x556f0ac4e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 -- 172.21.15.81:0/2113546218 shutdown_connections 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.124+0000 7f9fb1403740 1 -- 172.21.15.81:0/2113546218 wait complete. 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 -- start start 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 Processor -- start 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 0x556f0ac59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac52410 0x556f0ac5a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556f0ac5f880 con 0x556f0ac51af0 2024-09-12T12:16:54.135 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556f0ab3f290 con 0x556f0ac52410 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556f0ac5fa00 con 0x556f0ac5ccb0 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fb1403740 10 client.0 _ll_register_callbacks cb 0x556f0ab70140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 0x556f0ac59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.125+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 0x556f0ac59ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36742/0 (socket says 172.21.15.81:36742) 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 -- 172.21.15.81:0/3633336395 learned_addr learned my addr 172.21.15.81:0/3633336395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac52410 0x556f0ac5a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 -- 172.21.15.81:0/3633336395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac5ccb0 msgr2=0x556f0ac5a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 -- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac52410 msgr2=0x556f0ac5a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac52410 0x556f0ac5a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 -- 172.21.15.81:0/3633336395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0a8c9210 con 0x556f0ac51af0 2024-09-12T12:16:54.136 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac52410 0x556f0ac5a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 0x556f0ac59ba0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c004330 tx=0x7f9f9c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5744f79984a47efc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9f877fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9f877fe640 1 -- 172.21.15.81:0/3633336395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c005220 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9f877fe640 1 -- 172.21.15.81:0/3633336395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f9f9c0053c0 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f98032e20 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9f877fe640 1 -- 172.21.15.81:0/3633336395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c0055c0 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fb1403740 10 client.15477 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556f0a995620 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.126+0000 7f9f877fe640 1 -- 172.21.15.81:0/3633336395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f98032e20 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9f877fe640 1 -- 172.21.15.81:0/3633336395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9f9c025050 con 0x556f0ac51af0 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fb1403740 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:54.137 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fb1403740 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fb1403740 20 client.15477 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fb1403740 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0ac6cc60 0x556f0ac6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fb1403740 4 client.15477 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f0abc3a20 con 0x556f0ac6cc60 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0ac6cc60 0x556f0ac6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0ac6cc60 0x556f0ac6f090 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d4b7fa7ba264ead server_cookie=811f2dfdc78e53c4 in_seq=0 out_seq=0 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.127+0000 7f9f877fe640 10 client.15477 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9f877fe640 1 -- 172.21.15.81:0/3633336395 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f0abc3a20 con 0x556f0ac6cc60 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9f877fe640 10 client.15477 handle_command_reply: tid=0 2024-09-12T12:16:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 client.15477 shutdown 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 msgr2=0x556f0ac59ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 0x556f0ac59ba0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c004330 tx=0x7f9f9c0039c0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 shutdown_connections 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0ac6cc60 0x556f0ac6f090 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac52410 0x556f0ac5a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9f877fe640 0 client.15477 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 --2- 172.21.15.81:0/3633336395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac51af0 0x556f0ac59ba0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 >> 172.21.15.81:0/3633336395 conn(0x556f0ac4e060 msgr2=0x556f0ac53d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 shutdown_connections 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 1 -- 172.21.15.81:0/3633336395 wait complete. 2024-09-12T12:16:54.139 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.128+0000 7f9fb1403740 20 client.15477 trim_cache size 0 max 16384 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 Processor -- start 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- start start 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac54560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac5a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ad540 con 0x556f0ac5ccb0 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81af080 con 0x556f0ac51af0 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81adc10 con 0x556f0ac52410 2024-09-12T12:16:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36750/0 (socket says 172.21.15.81:36750) 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 -- 172.21.15.81:0/1880561890 learned_addr learned my addr 172.21.15.81:0/1880561890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac54560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac5a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 -- 172.21.15.81:0/1880561890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 msgr2=0x556f0ac5a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac5a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 -- 172.21.15.81:0/1880561890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 msgr2=0x556f0ac54560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac54560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 -- 172.21.15.81:0/1880561890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0ac52240 con 0x556f0ac5ccb0 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5bb10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0059f0 tx=0x7f9f9c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97a22531ce17215 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9f8dffb640 1 -- 172.21.15.81:0/1880561890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c02c070 con 0x556f0ac5ccb0 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9f8dffb640 1 -- 172.21.15.81:0/1880561890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f9c02d040 con 0x556f0ac5ccb0 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9f8dffb640 1 -- 172.21.15.81:0/1880561890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c010460 con 0x556f0ac5ccb0 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- 172.21.15.81:0/1880561890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 msgr2=0x556f0ac5bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5bb10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0059f0 tx=0x7f9f9c004040 comp rx=0 tx=0).stop 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- 172.21.15.81:0/1880561890 shutdown_connections 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac5bb10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac5a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 --2- 172.21.15.81:0/1880561890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac54560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- 172.21.15.81:0/1880561890 >> 172.21.15.81:0/1880561890 conn(0x556f0ac4e060 msgr2=0x556f0ac5b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- 172.21.15.81:0/1880561890 shutdown_connections 2024-09-12T12:16:54.151 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.144+0000 7f9fb1403740 1 -- 172.21.15.81:0/1880561890 wait complete. 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 -- start start 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 Processor -- start 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac65210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac60530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ae9b0 con 0x556f0ac5ccb0 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ae2e0 con 0x556f0ac51af0 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ab520 con 0x556f0ac52410 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fb1403740 10 client.0 _ll_register_callbacks cb 0x7f9f9c00bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fa77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac60a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36754/0 (socket says 172.21.15.81:36754) 2024-09-12T12:16:54.152 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fa77fe640 1 -- 172.21.15.81:0/2721975694 learned_addr learned my addr 172.21.15.81:0/2721975694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.145+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac65210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac60530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa77fe640 1 -- 172.21.15.81:0/2721975694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 msgr2=0x556f0ac60530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac60530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa77fe640 1 -- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 msgr2=0x556f0ac65210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac65210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa77fe640 1 -- 172.21.15.81:0/2721975694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0ac610b0 con 0x556f0ac5ccb0 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac60530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fa77fe640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac60a70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c005f80 tx=0x7f9f9c00b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f351fecbcb19d6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:16:54.153 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9f877fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9f877fe640 1 -- 172.21.15.81:0/2721975694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c02c070 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9f877fe640 1 -- 172.21.15.81:0/2721975694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f9f9c010460 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f9c02d040 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9f877fe640 1 -- 172.21.15.81:0/2721975694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9f9c010660 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fb1403740 10 client.15483 fetch_fsmap learned FSMap version 27 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556f0acd77b0 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9f877fe640 1 -- 172.21.15.81:0/2721975694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f9c02d040 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9f877fe640 1 -- 172.21.15.81:0/2721975694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9f9c025070 con 0x556f0ac5ccb0 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.146+0000 7f9fb1403740 10 client.15483 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fb1403740 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:16:54.154 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fb1403740 20 client.15483 populate_metadata read hostname 'smithi081' 2024-09-12T12:16:54.155 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0acd7d10 0x556f0acda100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:16:54.155 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fb1403740 4 client.15483 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:16:54.155 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556f0abbdd70 con 0x556f0acd7d10 2024-09-12T12:16:54.155 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0acd7d10 0x556f0acda100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:16:54.155 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9fa7fff640 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0acd7d10 0x556f0acda100 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32718aacaec91267 server_cookie=b2b3cafb28d9e20c in_seq=0 out_seq=0 2024-09-12T12:16:54.155 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.147+0000 7f9f877fe640 10 client.15483 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:54.156 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9f877fe640 1 -- 172.21.15.81:0/2721975694 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556f0abbdd70 con 0x556f0acd7d10 2024-09-12T12:16:54.156 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9f877fe640 10 client.15483 handle_command_reply: tid=0 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 client.15483 shutdown 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 msgr2=0x556f0ac60a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac60a70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c005f80 tx=0x7f9f9c00b9d0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 shutdown_connections 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x556f0acd7d10 0x556f0acda100 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f0ac5ccb0 0x556f0ac60a70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556f0ac52410 0x556f0ac60530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 --2- 172.21.15.81:0/2721975694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556f0ac51af0 0x556f0ac65210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9f877fe640 0 client.15483 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 >> 172.21.15.81:0/2721975694 conn(0x556f0ac4e060 msgr2=0x556f0ac5bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 shutdown_connections 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 1 -- 172.21.15.81:0/2721975694 wait complete. 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.155+0000 7f9fb1403740 20 client.15483 trim_cache size 0 max 16384 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:16:54.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:16:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f9f900a2e40 msgr2=0x7f9f900a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f9f900a2e40 0x7f9f900a5300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00cd170 tx=0x7f9fa00912c0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 msgr2=0x7f9fa819d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 0x7f9fa819d1d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000cce0 tx=0x7f9fa000a620 comp rx=0 tx=0).stop 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 shutdown_connections 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f9f900a2e40 0x7f9f900a5300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fa819cd20 0x7f9fa819d1d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fa8108110 0x7f9fa81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 --2- 172.21.15.81:0/3987707123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fa8100850 0x7f9fa8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 >> 172.21.15.81:0/3987707123 conn(0x7f9fa8075db0 msgr2=0x7f9fa80ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 shutdown_connections 2024-09-12T12:16:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:16:54.156+0000 7f9fae58d640 1 -- 172.21.15.81:0/3987707123 wait complete. 2024-09-12T12:16:55.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:55 smithi081 ceph-mon[30948]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-09-12T12:16:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:55 smithi173 ceph-mon[35326]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-09-12T12:16:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:55 smithi103 ceph-mon[35094]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 15 op/s 2024-09-12T12:16:57.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:57 smithi081 ceph-mon[30948]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:16:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:57 smithi173 ceph-mon[35326]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:16:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:57 smithi103 ceph-mon[35094]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:16:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:16:59 smithi081 ceph-mon[30948]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 13 op/s 2024-09-12T12:16:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:16:59 smithi173 ceph-mon[35326]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 13 op/s 2024-09-12T12:16:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:16:59 smithi103 ceph-mon[35094]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 682 B/s wr, 13 op/s 2024-09-12T12:17:00.359 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:17:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:17:00.084+0000 7f4e4f9b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:17:00.360 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:17:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:17:00.084+0000 7f4e4f9b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:17:00.360 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:17:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:17:00.084+0000 7f4e4f9b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:17:00.360 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:17:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:17:00.084+0000 7f4e4f9b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:17:00.360 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:17:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:17:00.084+0000 7f4e4f9b6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T12:17:01.473 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:01 smithi173 ceph-mon[35326]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-12T12:17:01.488 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:01 smithi103 ceph-mon[35094]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-12T12:17:01.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:01 smithi081 ceph-mon[30948]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-12T12:17:03.296 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-12T12:17:03.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:17:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:03.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:03 smithi081 ceph-mon[30948]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 26 op/s 2024-09-12T12:17:03.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:03 smithi081 ceph-mon[30948]: mgrmap e24: x(active, since 36s), standbys: z, y 2024-09-12T12:17:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:03 smithi173 ceph-mon[35326]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 26 op/s 2024-09-12T12:17:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:03 smithi173 ceph-mon[35326]: mgrmap e24: x(active, since 36s), standbys: z, y 2024-09-12T12:17:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:03 smithi103 ceph-mon[35094]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 26 op/s 2024-09-12T12:17:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:03 smithi103 ceph-mon[35094]: mgrmap e24: x(active, since 36s), standbys: z, y 2024-09-12T12:17:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.124+0000 7f5a30451640 1 -- 172.21.15.81:0/3461980928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 msgr2=0x7f5a2810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.124+0000 7f5a30451640 1 --2- 172.21.15.81:0/3461980928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a2810da40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009ca0 tx=0x7f5a2002a950 comp rx=0 tx=0).stop 2024-09-12T12:17:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.124+0000 7f5a30451640 1 -- 172.21.15.81:0/3461980928 shutdown_connections 2024-09-12T12:17:04.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.124+0000 7f5a30451640 1 --2- 172.21.15.81:0/3461980928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a2810da40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.124+0000 7f5a30451640 1 --2- 172.21.15.81:0/3461980928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a28102570 0x7f5a281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 --2- 172.21.15.81:0/3461980928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a28100e20 0x7f5a28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- 172.21.15.81:0/3461980928 >> 172.21.15.81:0/3461980928 conn(0x7f5a280fc7d0 msgr2=0x7f5a280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- 172.21.15.81:0/3461980928 shutdown_connections 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- 172.21.15.81:0/3461980928 wait complete. 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 Processor -- start 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- start start 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a28100e20 0x7f5a28199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a28102570 0x7f5a281996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a281a4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a281110a0 con 0x7f5a28102ef0 2024-09-12T12:17:04.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28110f20 con 0x7f5a28102570 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.125+0000 7f5a30451640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28111220 con 0x7f5a28100e20 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a281a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a281a4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54434/0 (socket says 172.21.15.81:54434) 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 -- 172.21.15.81:0/2197497437 learned_addr learned my addr 172.21.15.81:0/2197497437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e1ed640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a28100e20 0x7f5a28199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2d9ec640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a28102570 0x7f5a281996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 -- 172.21.15.81:0/2197497437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a28100e20 msgr2=0x7f5a28199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a28100e20 0x7f5a28199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 -- 172.21.15.81:0/2197497437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a28102570 msgr2=0x7f5a281996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a28102570 0x7f5a281996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 -- 172.21.15.81:0/2197497437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a281a4740 con 0x7f5a28102ef0 2024-09-12T12:17:04.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a2e9ee640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a281a4200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5a20005e30 tx=0x7f5a2002f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20034040 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5a20030940 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20039690 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.126+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a281a4910 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.127+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a281a4df0 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.128+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2806a5a0 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.129+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f5a20037020 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.130+0000 7f5a1f7fe640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a140a2e90 0x7f5a140a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.130+0000 7f5a2e1ed640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a140a2e90 0x7f5a140a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.130+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f5a200f04c0 con 0x7f5a28102ef0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.131+0000 7f5a2e1ed640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a140a2e90 0x7f5a140a5350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009b60 tx=0x7f5a24005f90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:04.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.134+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a200bd120 con 0x7f5a28102ef0 2024-09-12T12:17:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.349+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a28107b40 con 0x7f5a28102ef0 2024-09-12T12:17:04.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.350+0000 7f5a1f7fe640 1 -- 172.21.15.81:0/2197497437 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11982 (secure 0 0 0) 0x7f5a20030b10 con 0x7f5a28102ef0 2024-09-12T12:17:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:17:04.351 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T12:16:24:277939+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:16:24.227728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:17:04.351 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a140a2e90 msgr2=0x7f5a140a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a140a2e90 0x7f5a140a5350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009b60 tx=0x7f5a24005f90 comp rx=0 tx=0).stop 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 msgr2=0x7f5a281a4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a281a4200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5a20005e30 tx=0x7f5a2002f940 comp rx=0 tx=0).stop 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 shutdown_connections 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5a140a2e90 0x7f5a140a5350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a28102ef0 0x7f5a281a4200 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a28102570 0x7f5a281996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 --2- 172.21.15.81:0/2197497437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5a28100e20 0x7f5a28199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.352+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 >> 172.21.15.81:0/2197497437 conn(0x7f5a280fc7d0 msgr2=0x7f5a28104650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.353+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 shutdown_connections 2024-09-12T12:17:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:04.353+0000 7f5a30451640 1 -- 172.21.15.81:0/2197497437 wait complete. 2024-09-12T12:17:05.065 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-12T12:17:05.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-12T12:17:05.326 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:05.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:05 smithi081 ceph-mon[30948]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T12:17:05.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:05 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2197497437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:17:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:05 smithi173 ceph-mon[35326]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T12:17:05.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:05 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2197497437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:17:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:05 smithi103 ceph-mon[35094]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 28 op/s 2024-09-12T12:17:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:05 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2197497437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:17:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/1950712988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4102ef0 msgr2=0x7f5ff410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/1950712988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4102ef0 0x7f5ff410da40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009ca0 tx=0x7f5fec02a950 comp rx=0 tx=0).stop 2024-09-12T12:17:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/1950712988 shutdown_connections 2024-09-12T12:17:05.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/1950712988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4102ef0 0x7f5ff410da40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/1950712988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102570 0x7f5ff41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/1950712988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ff4100e20 0x7f5ff4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/1950712988 >> 172.21.15.81:0/1950712988 conn(0x7f5ff40fc7d0 msgr2=0x7f5ff40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/1950712988 shutdown_connections 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.850+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/1950712988 wait complete. 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.851+0000 7f5ff9a2f640 1 Processor -- start 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.851+0000 7f5ff9a2f640 1 -- start start 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.851+0000 7f5ff9a2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 0x7f5ff41993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.851+0000 7f5ff9a2f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ff4102570 0x7f5ff4199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff9a2f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102ef0 0x7f5ff41a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff9a2f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff41110e0 con 0x7f5ff4100e20 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff9a2f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4110f60 con 0x7f5ff4102ef0 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff9a2f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4111260 con 0x7f5ff4102570 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 0x7f5ff41993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 0x7f5ff41993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54452/0 (socket says 172.21.15.81:54452) 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/2639904826 learned_addr learned my addr 172.21.15.81:0/2639904826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ff4102570 0x7f5ff4199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102ef0 0x7f5ff41a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/2639904826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ff4102570 msgr2=0x7f5ff4199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ff4102570 0x7f5ff4199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/2639904826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102ef0 msgr2=0x7f5ff41a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102ef0 0x7f5ff41a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/2639904826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff41a4990 con 0x7f5ff4100e20 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102ef0 0x7f5ff41a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 0x7f5ff41993d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400b4a0 tx=0x7f5fe400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff8a2d640 1 -- 172.21.15.81:0/2639904826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4015020 con 0x7f5ff4100e20 2024-09-12T12:17:05.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.852+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff41971c0 con 0x7f5ff4100e20 2024-09-12T12:17:05.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.853+0000 7f5ff8a2d640 1 -- 172.21.15.81:0/2639904826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fe4011d30 con 0x7f5ff4100e20 2024-09-12T12:17:05.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.853+0000 7f5ff8a2d640 1 -- 172.21.15.81:0/2639904826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400f2e0 con 0x7f5ff4100e20 2024-09-12T12:17:05.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.853+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff4197700 con 0x7f5ff4100e20 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.855+0000 7f5ff8a2d640 1 -- 172.21.15.81:0/2639904826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f5fe4018020 con 0x7f5ff4100e20 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ff8a2d640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5fdc0a2e10 0x7f5fdc0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5fdc0a2e10 0x7f5fdc0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ff8a2d640 1 -- 172.21.15.81:0/2639904826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f5fe40ced80 con 0x7f5ff4100e20 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 Processor -- start 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 -- start start 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa1bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa1c080 0x55f3cfa26400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 0x55f3cfa28d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf9812a0 con 0x55f3cfa26940 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf928b10 con 0x55f3cfa1c080 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf97d260 con 0x55f3cfa1b760 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5fdc0a2e10 0x7f5fdc0a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406aac0 tx=0x7f5fe800a2d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.856+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 0x55f3cfa28d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 0x55f3cfa28d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54466/0 (socket says 172.21.15.81:54466) 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 -- 172.21.15.81:0/3435251177 learned_addr learned my addr 172.21.15.81:0/3435251177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa1c080 0x55f3cfa26400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa1bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 -- 172.21.15.81:0/3435251177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 msgr2=0x55f3cfa1bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa1bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 -- 172.21.15.81:0/3435251177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa1c080 msgr2=0x55f3cfa26400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa1c080 0x55f3cfa26400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 -- 172.21.15.81:0/3435251177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cf6f2b90 con 0x55f3cfa26940 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 0x55f3cfa28d30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009a20 tx=0x7f5fec02f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d1c8d0b6681744 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5fd9ffb640 1 -- 172.21.15.81:0/3435251177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec04b070 con 0x55f3cfa26940 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5fd9ffb640 1 -- 172.21.15.81:0/3435251177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fec02fc10 con 0x55f3cfa26940 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.857+0000 7f5fd9ffb640 1 -- 172.21.15.81:0/3435251177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec034050 con 0x55f3cfa26940 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 -- 172.21.15.81:0/3435251177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 msgr2=0x55f3cfa28d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 0x55f3cfa28d30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009a20 tx=0x7f5fec02f9f0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 -- 172.21.15.81:0/3435251177 shutdown_connections 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa26940 0x55f3cfa28d30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa1c080 0x55f3cfa26400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/3435251177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa1bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 -- 172.21.15.81:0/3435251177 >> 172.21.15.81:0/3435251177 conn(0x55f3cfa17cf0 msgr2=0x55f3cfa180d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 -- 172.21.15.81:0/3435251177 shutdown_connections 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.858+0000 7f5ffbe08740 1 -- 172.21.15.81:0/3435251177 wait complete. 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 -- start start 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 Processor -- start 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 0x55f3cfa23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa26940 0x55f3cfa24230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f3cfa29510 con 0x55f3cfa1c080 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f3cf9096e0 con 0x55f3cfa26940 2024-09-12T12:17:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f3cfa29690 con 0x55f3cfa1b760 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ffbe08740 10 client.0 _ll_register_callbacks cb 0x55f3cf92da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ff27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 0x55f3cfa23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ff27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 0x55f3cfa23cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54470/0 (socket says 172.21.15.81:54470) 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ff27fc640 1 -- 172.21.15.81:0/2423896722 learned_addr learned my addr 172.21.15.81:0/2423896722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa26940 0x55f3cfa24230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.859+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff27fc640 1 -- 172.21.15.81:0/2423896722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 msgr2=0x55f3cfa237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff27fc640 1 -- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa26940 msgr2=0x55f3cfa24230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa26940 0x55f3cfa24230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff27fc640 1 -- 172.21.15.81:0/2423896722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cfa32a10 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa26940 0x55f3cfa24230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 0x55f3cfa23cf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5fe801de60 tx=0x7f5fe8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94d10937fc616fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5fd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/2423896722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8016070 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/2423896722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f5fe801b400 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fec02fc10 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/2423896722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fe8026640 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ffbe08740 10 client.15507 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3cfa35430 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.860+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/2423896722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fec02fc10 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/2423896722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5fe8024070 con 0x55f3cfa1c080 2024-09-12T12:17:05.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ffbe08740 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ffbe08740 10 client.15507 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ffbe08740 20 client.15507 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfa36e10 0x55f3cfa39250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ffbe08740 4 client.15507 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3cf98e9d0 con 0x55f3cfa36e10 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfa36e10 0x55f3cfa39250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfa36e10 0x55f3cfa39250 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a4db719bf2a4caf server_cookie=cafe821b6a290f29 in_seq=0 out_seq=0 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.861+0000 7f5fd2ffd640 10 client.15507 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/2423896722 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3cf98e9d0 con 0x55f3cfa36e10 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5fd2ffd640 10 client.15507 handle_command_reply: tid=0 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 client.15507 shutdown 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 msgr2=0x55f3cfa23cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 0x55f3cfa23cf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5fe801de60 tx=0x7f5fe8004730 comp rx=0 tx=0).stop 2024-09-12T12:17:05.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 shutdown_connections 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfa36e10 0x55f3cfa39250 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa26940 0x55f3cfa24230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1c080 0x55f3cfa23cf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/2423896722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa1b760 0x55f3cfa237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 >> 172.21.15.81:0/2423896722 conn(0x55f3cfa17cf0 msgr2=0x55f3cfa16e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.862+0000 7f5fd2ffd640 0 client.15507 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.863+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 shutdown_connections 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.863+0000 7f5ffbe08740 1 -- 172.21.15.81:0/2423896722 wait complete. 2024-09-12T12:17:05.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.863+0000 7f5ffbe08740 20 client.15507 trim_cache size 0 max 16384 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.880+0000 7f5ffbe08740 1 Processor -- start 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.880+0000 7f5ffbe08740 1 -- start start 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa3eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa20e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000e5d0 con 0x55f3cfa1b760 2024-09-12T12:17:05.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe0010110 con 0x55f3cfa20a10 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000eca0 con 0x55f3cfa26940 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa3eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa3eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54486/0 (socket says 172.21.15.81:54486) 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/33974007 learned_addr learned my addr 172.21.15.81:0/33974007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa20e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/33974007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 msgr2=0x55f3cfa3f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa3f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/33974007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 msgr2=0x55f3cfa20e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa20e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/33974007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3cfa1e5d0 con 0x55f3cfa1b760 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa3f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.881+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa3eb60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5fe409b160 tx=0x7f5fe40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178e732e341e70c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5fd97fa640 1 -- 172.21.15.81:0/33974007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40b3070 con 0x55f3cfa1b760 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5fd97fa640 1 -- 172.21.15.81:0/33974007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fe40994d0 con 0x55f3cfa1b760 2024-09-12T12:17:05.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5fd97fa640 1 -- 172.21.15.81:0/33974007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40a39b0 con 0x55f3cfa1b760 2024-09-12T12:17:05.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 -- 172.21.15.81:0/33974007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 msgr2=0x55f3cfa3eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa3eb60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5fe409b160 tx=0x7f5fe40047d0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 -- 172.21.15.81:0/33974007 shutdown_connections 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa20e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa3f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/33974007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa3eb60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 -- 172.21.15.81:0/33974007 >> 172.21.15.81:0/33974007 conn(0x55f3cfa17cf0 msgr2=0x55f3cfa25830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 -- 172.21.15.81:0/33974007 shutdown_connections 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.882+0000 7f5ffbe08740 1 -- 172.21.15.81:0/33974007 wait complete. 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 -- start start 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 Processor -- start 2024-09-12T12:17:05.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa2eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000fa40 con 0x55f3cfa1b760 2024-09-12T12:17:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000f370 con 0x55f3cfa20a10 2024-09-12T12:17:05.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000c5b0 con 0x55f3cfa26940 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.883+0000 7f5ffbe08740 10 client.0 _ll_register_callbacks cb 0x7f5fe801d7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa2f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:58250/0 (socket says 172.21.15.81:58250) 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa2eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff27fc640 1 -- 172.21.15.81:0/1990753440 learned_addr learned my addr 172.21.15.81:0/1990753440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/1990753440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 msgr2=0x55f3cfa2b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa2b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 msgr2=0x55f3cfa2f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:05.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa2f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 -- 172.21.15.81:0/1990753440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3cfa2c080 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ff2ffd640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa2eb50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40ccb40 tx=0x7f5fe409b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a26ed6b7ae2e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5fd2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/1990753440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40b3070 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/1990753440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f5fe40bb240 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fe40994d0 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/1990753440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5fe409b6b0 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ffbe08740 10 client.15513 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.884+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f3cfaa2560 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/1990753440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5fe40994d0 con 0x55f3cfa1b760 2024-09-12T12:17:05.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/1990753440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5fe409a620 con 0x55f3cfa1b760 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ffbe08740 10 client.15513 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ffbe08740 10 client.15513 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ffbe08740 20 client.15513 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfaa2be0 0x55f3cfaa4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ffbe08740 4 client.15513 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x55f3cf988d20 con 0x55f3cfaa2be0 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfaa2be0 0x55f3cfaa4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.885+0000 7f5fd2ffd640 10 client.15513 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:05.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.886+0000 7f5ff27fc640 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfaa2be0 0x55f3cfaa4fd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7826b7488afcd7f2 server_cookie=dfc7cf1b6ec0667b in_seq=0 out_seq=0 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5fd2ffd640 1 -- 172.21.15.81:0/1990753440 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55f3cf988d20 con 0x55f3cfaa2be0 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5fd2ffd640 10 client.15513 handle_command_reply: tid=0 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5ffbe08740 1 client.15513 shutdown 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 msgr2=0x55f3cfa2eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa2eb50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40ccb40 tx=0x7f5fe409b250 comp rx=0 tx=0).stop 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 shutdown_connections 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.898+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f3cfaa2be0 0x55f3cfaa4fd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3cfa26940 0x55f3cfa2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5fd2ffd640 0 client.15513 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f3cfa20a10 0x55f3cfa2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 1 --2- 172.21.15.81:0/1990753440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3cfa1b760 0x55f3cfa2eb50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 >> 172.21.15.81:0/1990753440 conn(0x55f3cfa17cf0 msgr2=0x55f3cfa25010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 shutdown_connections 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 1 -- 172.21.15.81:0/1990753440 wait complete. 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ffbe08740 20 client.15513 trim_cache size 0 max 16384 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:17:05.900 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 27, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 2, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "1c187455": { 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 2, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 144.5, 2024-09-12T12:17:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:05.902 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5fdc0a2e10 msgr2=0x7f5fdc0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5fdc0a2e10 0x7f5fdc0a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406aac0 tx=0x7f5fe800a2d0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 msgr2=0x7f5ff41993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 0x7f5ff41993d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400b4a0 tx=0x7f5fe400b8a0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 shutdown_connections 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5fdc0a2e10 0x7f5fdc0a52d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff4102ef0 0x7f5ff41a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ff4102570 0x7f5ff4199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.899+0000 7f5ff9a2f640 1 --2- 172.21.15.81:0/2639904826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff4100e20 0x7f5ff41993d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.900+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 >> 172.21.15.81:0/2639904826 conn(0x7f5ff40fc7d0 msgr2=0x7f5ff4105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.900+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 shutdown_connections 2024-09-12T12:17:05.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:05.900+0000 7f5ff9a2f640 1 -- 172.21.15.81:0/2639904826 wait complete. 2024-09-12T12:17:06.592 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1c187455', quiesce took 3.3 seconds. Will release after: 21.2 2024-09-12T12:17:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 -- 172.21.15.81:0/856983016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 msgr2=0x7f1f10106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/856983016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f10106da0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009930 tx=0x7f1f0402a420 comp rx=0 tx=0).stop 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 -- 172.21.15.81:0/856983016 shutdown_connections 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/856983016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f10101350 0x7f1f1010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/856983016 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f101009b0 0x7f1f10100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/856983016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f10106da0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 -- 172.21.15.81:0/856983016 >> 172.21.15.81:0/856983016 conn(0x7f1f10077990 msgr2=0x7f1f100fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 -- 172.21.15.81:0/856983016 shutdown_connections 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.248+0000 7f1f14fb9640 1 -- 172.21.15.81:0/856983016 wait complete. 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 Processor -- start 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 -- start start 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f101009b0 0x7f1f101984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f10101350 0x7f1f10198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f1019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10110f20 con 0x7f1f101069c0 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10110da0 con 0x7f1f101009b0 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f14fb9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101110a0 con 0x7f1f10101350 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f0ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f1019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f0ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f1019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54506/0 (socket says 172.21.15.81:54506) 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f0ed9d640 1 -- 172.21.15.81:0/3029458573 learned_addr learned my addr 172.21.15.81:0/3029458573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.249+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f101009b0 0x7f1f101984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f10101350 0x7f1f10198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0ed9d640 1 -- 172.21.15.81:0/3029458573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f10101350 msgr2=0x7f1f10198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0ed9d640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f10101350 0x7f1f10198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0ed9d640 1 -- 172.21.15.81:0/3029458573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f101009b0 msgr2=0x7f1f101984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0ed9d640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f101009b0 0x7f1f101984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0ed9d640 1 -- 172.21.15.81:0/3029458573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1019d4d0 con 0x7f1f101069c0 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f0ed9d640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f1019cda0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009fd0 tx=0x7f1f0800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1eff7fe640 1 -- 172.21.15.81:0/3029458573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08017070 con 0x7f1f101069c0 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1019d7c0 con 0x7f1f101069c0 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1eff7fe640 1 -- 172.21.15.81:0/3029458573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f08004020 con 0x7f1f101069c0 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1eff7fe640 1 -- 172.21.15.81:0/3029458573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f080106c0 con 0x7f1f101069c0 2024-09-12T12:17:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.250+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f101a5050 con 0x7f1f101069c0 2024-09-12T12:17:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.252+0000 7f1eff7fe640 1 -- 172.21.15.81:0/3029458573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f1f080041d0 con 0x7f1f101069c0 2024-09-12T12:17:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 Processor -- start 2024-09-12T12:17:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 -- start start 2024-09-12T12:17:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e6af0 0x5615650e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 0x5615650f1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56156504b2f0 con 0x5615650e7410 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561564ff3270 con 0x5615650e6af0 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f17e26740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615650472b0 con 0x5615650f1cb0 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 0x5615650f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 0x5615650f1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54516/0 (socket says 172.21.15.81:54516) 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f0e59c640 1 -- 172.21.15.81:0/792426810 learned_addr learned my addr 172.21.15.81:0/792426810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1eff7fe640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1ef80a2ec0 0x7f1ef80a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e6af0 0x5615650e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.253+0000 7f1f0ed9d640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1ef80a2ec0 0x7f1ef80a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0e59c640 1 -- 172.21.15.81:0/792426810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 msgr2=0x5615650f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0e59c640 1 -- 172.21.15.81:0/792426810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e6af0 msgr2=0x5615650e6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e6af0 0x5615650e6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0e59c640 1 -- 172.21.15.81:0/792426810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561564ff2340 con 0x5615650e7410 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1eff7fe640 1 -- 172.21.15.81:0/3029458573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1f080cf340 con 0x7f1f101069c0 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 0x5615650f1770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005ec0 tx=0x7f1f04005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17db9301c1b2deb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1f0ed9d640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1ef80a2ec0 0x7f1ef80a5380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f080cc9e0 tx=0x7f1f0806e6f0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1efcff9640 1 -- 172.21.15.81:0/792426810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04040070 con 0x5615650e7410 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1efcff9640 1 -- 172.21.15.81:0/792426810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f04031a00 con 0x5615650e7410 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.254+0000 7f1efcff9640 1 -- 172.21.15.81:0/792426810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04035040 con 0x5615650e7410 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 -- 172.21.15.81:0/792426810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 msgr2=0x5615650f1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 0x5615650f1770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005ec0 tx=0x7f1f04005c00 comp rx=0 tx=0).stop 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 -- 172.21.15.81:0/792426810 shutdown_connections 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e7410 0x5615650f1770 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 --2- 172.21.15.81:0/792426810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e6af0 0x5615650e6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 -- 172.21.15.81:0/792426810 >> 172.21.15.81:0/792426810 conn(0x5615650e3060 msgr2=0x5615650e3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 -- 172.21.15.81:0/792426810 shutdown_connections 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 -- 172.21.15.81:0/792426810 wait complete. 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 -- start start 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.255+0000 7f1f17e26740 1 Processor -- start 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650ef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615650f4880 con 0x5615650e6af0 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561564fd4290 con 0x5615650e7410 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5615650f4a00 con 0x5615650f1cb0 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f17e26740 10 client.0 _ll_register_callbacks cb 0x561565005140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650eeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54530/0 (socket says 172.21.15.81:54530) 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/2808921010 learned_addr learned my addr 172.21.15.81:0/2808921010 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/2808921010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 msgr2=0x5615650ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650ef600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 msgr2=0x5615650ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/2808921010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561564d5e210 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650eeb80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1f00005bb0 tx=0x7f1f0000e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d838bbfa089ab28b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1ef5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.256+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/2808921010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00010d60 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/2808921010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1f00005020 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f04031a00 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/2808921010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f00005220 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 10 client.15525 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561564e2a620 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/2808921010 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f04031a00 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/2808921010 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1f00024050 con 0x5615650e6af0 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 10 client.15525 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:07.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 20 client.15525 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561565101bf0 0x561565104020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 4 client.15525 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561565058a20 con 0x561565101bf0 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.257+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561565101bf0 0x561565104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.258+0000 7f1ef5ffb640 10 client.15525 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.258+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561565101bf0 0x561565104020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b5b58320691d83 server_cookie=36f8fb59cc9871b4 in_seq=0 out_seq=0 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/2808921010 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561565058a20 con 0x561565101bf0 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1ef5ffb640 10 client.15525 handle_command_reply: tid=0 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 client.15525 shutdown 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 msgr2=0x5615650eeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650eeb80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1f00005bb0 tx=0x7f1f0000e630 comp rx=0 tx=0).stop 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 shutdown_connections 2024-09-12T12:17:07.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x561565101bf0 0x561565104020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 --2- 172.21.15.81:0/2808921010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650eeb80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1ef5ffb640 0 client.15525 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 >> 172.21.15.81:0/2808921010 conn(0x5615650e3060 msgr2=0x5615650e8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 shutdown_connections 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 1 -- 172.21.15.81:0/2808921010 wait complete. 2024-09-12T12:17:07.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.259+0000 7f1f17e26740 20 client.15525 trim_cache size 0 max 16384 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 Processor -- start 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 -- start start 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650e6af0 0x5615650e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 0x5615651098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101ad780 con 0x5615650f1cb0 2024-09-12T12:17:07.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101af2c0 con 0x5615650e7410 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f17e26740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101ade50 con 0x5615650e6af0 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 0x5615651098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 0x5615651098f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54546/0 (socket says 172.21.15.81:54546) 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/960716147 learned_addr learned my addr 172.21.15.81:0/960716147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650e6af0 0x5615650e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/960716147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650e6af0 msgr2=0x5615650e95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650e6af0 0x5615650e95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/960716147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 msgr2=0x5615650ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.274+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/960716147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615650e6920 con 0x5615650f1cb0 2024-09-12T12:17:07.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.275+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 0x5615651098f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000e7e0 tx=0x7f1f00001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bc0291d1aa30ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.275+0000 7f1ef7fff640 1 -- 172.21.15.81:0/960716147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00025810 con 0x5615650f1cb0 2024-09-12T12:17:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.275+0000 7f1ef7fff640 1 -- 172.21.15.81:0/960716147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f000259b0 con 0x5615650f1cb0 2024-09-12T12:17:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.275+0000 7f1ef7fff640 1 -- 172.21.15.81:0/960716147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0001bac0 con 0x5615650f1cb0 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- 172.21.15.81:0/960716147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 msgr2=0x5615651098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 0x5615651098f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000e7e0 tx=0x7f1f00001e70 comp rx=0 tx=0).stop 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- 172.21.15.81:0/960716147 shutdown_connections 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650f1cb0 0x5615651098f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- 172.21.15.81:0/960716147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650e6af0 0x5615650e95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- 172.21.15.81:0/960716147 >> 172.21.15.81:0/960716147 conn(0x5615650e3060 msgr2=0x5615650f0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- 172.21.15.81:0/960716147 shutdown_connections 2024-09-12T12:17:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- 172.21.15.81:0/960716147 wait complete. 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- start start 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 Processor -- start 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101aebf0 con 0x5615650e6af0 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101ae520 con 0x5615650e7410 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101ab7c0 con 0x5615650f1cb0 2024-09-12T12:17:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f17e26740 10 client.0 _ll_register_callbacks cb 0x7f1f00013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650fa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54562/0 (socket says 172.21.15.81:54562) 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.276+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/1127622060 learned_addr learned my addr 172.21.15.81:0/1127622060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/1127622060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 msgr2=0x5615650f5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 msgr2=0x5615650f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 -- 172.21.15.81:0/1127622060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615650f5fc0 con 0x5615650e6af0 2024-09-12T12:17:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f0dd9b640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650fa1a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000e520 tx=0x7f1f00010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b94d76d036ad7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1ef5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/1127622060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00025810 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/1127622060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1f0001b770 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.277+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f000259b0 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/1127622060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f00046050 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 10 client.15531 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56156516c660 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/1127622060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f000259b0 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/1127622060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1f00024070 con 0x5615650e6af0 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 10 client.15531 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 20 client.15531 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56156516cb30 0x56156516ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 4 client.15531 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:17:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561565052d70 con 0x56156516cb30 2024-09-12T12:17:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.278+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56156516cb30 0x56156516ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.279+0000 7f1ef5ffb640 10 client.15531 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.279+0000 7f1f0e59c640 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56156516cb30 0x56156516ef20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc034a27c7e959bb server_cookie=8bd250da0a2d47fb in_seq=0 out_seq=0 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.286+0000 7f1ef5ffb640 1 -- 172.21.15.81:0/1127622060 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561565052d70 con 0x56156516cb30 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.286+0000 7f1ef5ffb640 10 client.15531 handle_command_reply: tid=0 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.286+0000 7f1f17e26740 1 client.15531 shutdown 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.286+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 msgr2=0x5615650fa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.286+0000 7f1f17e26740 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650fa1a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000e520 tx=0x7f1f00010d00 comp rx=0 tx=0).stop 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 shutdown_connections 2024-09-12T12:17:07.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56156516cb30 0x56156516ef20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5615650f1cb0 0x5615650f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615650e7410 0x5615650f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1ef5ffb640 0 client.15531 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 --2- 172.21.15.81:0/1127622060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615650e6af0 0x5615650fa1a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 >> 172.21.15.81:0/1127622060 conn(0x5615650e3060 msgr2=0x5615650fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 shutdown_connections 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 1 -- 172.21.15.81:0/1127622060 wait complete. 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f17e26740 20 client.15531 trim_cache size 0 max 16384 2024-09-12T12:17:07.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:17:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:17:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:17:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:17:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1ef80a2ec0 msgr2=0x7f1ef80a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1ef80a2ec0 0x7f1ef80a5380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f080cc9e0 tx=0x7f1f0806e6f0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 msgr2=0x7f1f1019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f1019cda0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009fd0 tx=0x7f1f0800b260 comp rx=0 tx=0).stop 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 shutdown_connections 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1ef80a2ec0 0x7f1ef80a5380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f101069c0 0x7f1f1019cda0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f10101350 0x7f1f10198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 --2- 172.21.15.81:0/3029458573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f101009b0 0x7f1f101984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 >> 172.21.15.81:0/3029458573 conn(0x7f1f10077990 msgr2=0x7f1f10069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.287+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 shutdown_connections 2024-09-12T12:17:07.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:07.288+0000 7f1f14fb9640 1 -- 172.21.15.81:0/3029458573 wait complete. 2024-09-12T12:17:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:07 smithi081 ceph-mon[30948]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-12T12:17:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:07 smithi173 ceph-mon[35326]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-12T12:17:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:07 smithi103 ceph-mon[35094]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-12T12:17:09.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:09 smithi081 ceph-mon[30948]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-09-12T12:17:09.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:09 smithi173 ceph-mon[35326]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-09-12T12:17:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:09 smithi103 ceph-mon[35094]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 29 op/s 2024-09-12T12:17:11.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:11 smithi081 ceph-mon[30948]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-12T12:17:11.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:11 smithi173 ceph-mon[35326]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-12T12:17:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:11 smithi103 ceph-mon[35094]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-12T12:17:13.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:13 smithi081 ceph-mon[30948]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T12:17:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:13 smithi173 ceph-mon[35326]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T12:17:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:13 smithi103 ceph-mon[35094]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-09-12T12:17:15.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:15 smithi081 ceph-mon[30948]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-12T12:17:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:15 smithi173 ceph-mon[35326]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-12T12:17:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:15 smithi103 ceph-mon[35094]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-12T12:17:17.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:17 smithi081 ceph-mon[30948]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T12:17:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:17 smithi173 ceph-mon[35326]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T12:17:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:17 smithi103 ceph-mon[35094]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-12T12:17:19.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:19 smithi081 ceph-mon[30948]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-12T12:17:19.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:19 smithi173 ceph-mon[35326]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-12T12:17:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:19 smithi103 ceph-mon[35094]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-12T12:17:20.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 -- 172.21.15.81:0/1423548891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f0101350 msgr2=0x7f17f010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 --2- 172.21.15.81:0/1423548891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f0101350 0x7f17f010d880 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009cd0 tx=0x7f17e802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 -- 172.21.15.81:0/1423548891 shutdown_connections 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 --2- 172.21.15.81:0/1423548891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f0101350 0x7f17f010d880 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 --2- 172.21.15.81:0/1423548891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f01009b0 0x7f17f0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 --2- 172.21.15.81:0/1423548891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f01069c0 0x7f17f0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 -- 172.21.15.81:0/1423548891 >> 172.21.15.81:0/1423548891 conn(0x7f17f0077990 msgr2=0x7f17f00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 -- 172.21.15.81:0/1423548891 shutdown_connections 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.413+0000 7f17f841e640 1 -- 172.21.15.81:0/1423548891 wait complete. 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 Processor -- start 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 -- start start 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 0x7f17f00fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f0101350 0x7f17f00fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f01069c0 0x7f17f00fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0110f20 con 0x7f17f01009b0 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0110da0 con 0x7f17f0101350 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f841e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01110a0 con 0x7f17f01069c0 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f61ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 0x7f17f00fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f61ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 0x7f17f00fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54618/0 (socket says 172.21.15.81:54618) 2024-09-12T12:17:20.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f61ba640 1 -- 172.21.15.81:0/1348775064 learned_addr learned my addr 172.21.15.81:0/1348775064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.414+0000 7f17f59b9640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f0101350 0x7f17f00fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f69bb640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f01069c0 0x7f17f00fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f61ba640 1 -- 172.21.15.81:0/1348775064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f01069c0 msgr2=0x7f17f00fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f61ba640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f01069c0 0x7f17f00fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f61ba640 1 -- 172.21.15.81:0/1348775064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f0101350 msgr2=0x7f17f00fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f61ba640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f0101350 0x7f17f00fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f61ba640 1 -- 172.21.15.81:0/1348775064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f01a67f0 con 0x7f17f01009b0 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f61ba640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 0x7f17f00fcde0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00e9f0 tx=0x7f17ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17e77fe640 1 -- 172.21.15.81:0/1348775064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00ccc0 con 0x7f17f01009b0 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f01a6ae0 con 0x7f17f01009b0 2024-09-12T12:17:20.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17e77fe640 1 -- 172.21.15.81:0/1348775064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17ec00ce60 con 0x7f17f01009b0 2024-09-12T12:17:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17e77fe640 1 -- 172.21.15.81:0/1348775064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec010690 con 0x7f17f01009b0 2024-09-12T12:17:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.415+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01a7030 con 0x7f17f01009b0 2024-09-12T12:17:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 Processor -- start 2024-09-12T12:17:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17e77fe640 1 -- 172.21.15.81:0/1348775064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f17ec0046c0 con 0x7f17f01009b0 2024-09-12T12:17:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 -- start start 2024-09-12T12:17:20.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee813ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee8210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624ee7782f0 con 0x5624ee814410 2024-09-12T12:17:20.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5624ee720270 con 0x5624ee813af0 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.419+0000 7f17fb28d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5624ee7742b0 con 0x5624ee81ecb0 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee813ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee813ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:39406/0 (socket says 172.21.15.81:39406) 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 -- 172.21.15.81:0/726869444 learned_addr learned my addr 172.21.15.81:0/726869444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f61ba640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f59b9640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee8210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 -- 172.21.15.81:0/726869444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 msgr2=0x5624ee8210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee8210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 -- 172.21.15.81:0/726869444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 msgr2=0x5624ee81e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f69bb640 1 -- 172.21.15.81:0/726869444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ee71f340 con 0x5624ee813af0 2024-09-12T12:17:20.421 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f59b9640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee8210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:20.422 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.420+0000 7f17f61ba640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17e77fe640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17dc0a2ec0 0x7f17dc0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17f69bb640 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee813ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005f30 tx=0x7f17e8005f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65fef736f46addc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17f61ba640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17dc0a2ec0 0x7f17dc0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17e77fe640 1 -- 172.21.15.81:0/1348775064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f17ec0cfac0 con 0x7f17f01009b0 2024-09-12T12:17:20.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17e4bfe640 1 -- 172.21.15.81:0/726869444 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80317e0 con 0x5624ee813af0 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17e4bfe640 1 -- 172.21.15.81:0/726869444 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e8036040 con 0x5624ee813af0 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.421+0000 7f17e4bfe640 1 -- 172.21.15.81:0/726869444 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8004520 con 0x5624ee813af0 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17f61ba640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17dc0a2ec0 0x7f17dc0a5380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0cd160 tx=0x7f17ec0d35d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 -- 172.21.15.81:0/726869444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 msgr2=0x5624ee813ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee813ed0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005f30 tx=0x7f17e8005f60 comp rx=0 tx=0).stop 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 -- 172.21.15.81:0/726869444 shutdown_connections 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee8210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 --2- 172.21.15.81:0/726869444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee813ed0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 -- 172.21.15.81:0/726869444 >> 172.21.15.81:0/726869444 conn(0x5624ee810060 msgr2=0x5624ee810440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 -- 172.21.15.81:0/726869444 shutdown_connections 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.422+0000 7f17fb28d740 1 -- 172.21.15.81:0/726869444 wait complete. 2024-09-12T12:17:20.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.423+0000 7f17fb28d740 1 -- start start 2024-09-12T12:17:20.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.423+0000 7f17fb28d740 1 Processor -- start 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee81bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee81c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5624ee821880 con 0x5624ee814410 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5624ee701290 con 0x5624ee813af0 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5624ee821a00 con 0x5624ee81ecb0 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54644/0 (socket says 172.21.15.81:54644) 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 -- 172.21.15.81:0/2444067050 learned_addr learned my addr 172.21.15.81:0/2444067050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee81bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17fb28d740 10 client.0 _ll_register_callbacks cb 0x5624ee732140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee81c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 -- 172.21.15.81:0/2444067050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 msgr2=0x5624ee81c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee81c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 -- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 msgr2=0x5624ee81bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee81bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 -- 172.21.15.81:0/2444067050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ee48b210 con 0x5624ee814410 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee81c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17f59b9640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81c0b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f17e0012700 tx=0x7f17e0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b268d604b7d530a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.424+0000 7f17d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2444067050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e001f060 con 0x5624ee814410 2024-09-12T12:17:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e8036040 con 0x5624ee814410 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2444067050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f17e0010dc0 con 0x5624ee814410 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2444067050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17e0024440 con 0x5624ee814410 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17fb28d740 10 client.15543 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624ee557620 con 0x5624ee814410 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.425+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2444067050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e8036040 con 0x5624ee814410 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2444067050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f17e0022020 con 0x5624ee814410 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17fb28d740 10 client.15543 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17fb28d740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17fb28d740 20 client.15543 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee82efa0 0x5624ee831460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17fb28d740 4 client.15543 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624ee785a20 con 0x5624ee82efa0 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.426+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee82efa0 0x5624ee831460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.427+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee82efa0 0x5624ee831460 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63224f143663c5b6 server_cookie=1b983de6e1af77bb in_seq=0 out_seq=0 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.427+0000 7f17d9ffb640 10 client.15543 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.427+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2444067050 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624ee785a20 con 0x5624ee82efa0 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.427+0000 7f17d9ffb640 10 client.15543 handle_command_reply: tid=0 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.427+0000 7f17fb28d740 1 client.15543 shutdown 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 msgr2=0x5624ee81c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81c0b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f17e0012700 tx=0x7f17e0012bc0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 shutdown_connections 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee82efa0 0x5624ee831460 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ecb0 0x5624ee81c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee814410 0x5624ee81c0b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2444067050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee81bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 >> 172.21.15.81:0/2444067050 conn(0x5624ee810060 msgr2=0x5624ee815dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17d9ffb640 0 client.15543 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 shutdown_connections 2024-09-12T12:17:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 1 -- 172.21.15.81:0/2444067050 wait complete. 2024-09-12T12:17:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.428+0000 7f17fb28d740 20 client.15543 trim_cache size 0 max 16384 2024-09-12T12:17:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 Processor -- start 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 -- start start 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee816560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 0x5624ee81c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee81dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01af850 con 0x5624ee81ecb0 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01b1390 con 0x5624ee813af0 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17fb28d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01aff20 con 0x5624ee81ac80 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17f59b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 0x5624ee81c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17f59b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 0x5624ee81c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54660/0 (socket says 172.21.15.81:54660) 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17f59b9640 1 -- 172.21.15.81:0/1057157097 learned_addr learned my addr 172.21.15.81:0/1057157097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.456+0000 7f17f69bb640 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee816560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee81dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 -- 172.21.15.81:0/1057157097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 msgr2=0x5624ee81dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee81dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 -- 172.21.15.81:0/1057157097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 msgr2=0x5624ee81c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 0x5624ee81c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 -- 172.21.15.81:0/1057157097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ee811110 con 0x5624ee813af0 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f59b9640 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 0x5624ee81c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17f69bb640 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee816560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17e802ae00 tx=0x7f17e8004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d062c2e7464c33a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17dbfff640 1 -- 172.21.15.81:0/1057157097 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80041f0 con 0x5624ee813af0 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17dbfff640 1 -- 172.21.15.81:0/1057157097 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e8036070 con 0x5624ee813af0 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.457+0000 7f17dbfff640 1 -- 172.21.15.81:0/1057157097 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8031d70 con 0x5624ee813af0 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 -- 172.21.15.81:0/1057157097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 msgr2=0x5624ee816560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee816560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17e802ae00 tx=0x7f17e8004180 comp rx=0 tx=0).stop 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 -- 172.21.15.81:0/1057157097 shutdown_connections 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee81dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee81ecb0 0x5624ee81c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 --2- 172.21.15.81:0/1057157097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee813af0 0x5624ee816560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.458+0000 7f17fb28d740 1 -- 172.21.15.81:0/1057157097 >> 172.21.15.81:0/1057157097 conn(0x5624ee810060 msgr2=0x5624ee81d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 -- 172.21.15.81:0/1057157097 shutdown_connections 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 -- 172.21.15.81:0/1057157097 wait complete. 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 -- start start 2024-09-12T12:17:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 Processor -- start 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 0x5624ee826ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee827430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee81ecb0 0x5624ee8183e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01b0cc0 con 0x5624ee813af0 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17fb28d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01b05f0 con 0x5624ee81ecb0 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17f69bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 0x5624ee826ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.459+0000 7f17f69bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 0x5624ee826ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54664/0 (socket says 172.21.15.81:54664) 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 -- 172.21.15.81:0/2290466997 learned_addr learned my addr 172.21.15.81:0/2290466997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01ad830 con 0x5624ee81ac80 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17fb28d740 10 client.0 _ll_register_callbacks cb 0x7f17e0005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f59b9640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee827430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee81ecb0 0x5624ee8183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 -- 172.21.15.81:0/2290466997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 msgr2=0x5624ee827430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee827430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 -- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee81ecb0 msgr2=0x5624ee8183e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee81ecb0 0x5624ee8183e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 -- 172.21.15.81:0/2290466997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ee80b2d0 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17f69bb640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 0x5624ee826ef0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f17e8031c30 tx=0x7f17e8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8929dfbc16d958 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2290466997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8031e30 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2290466997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f17e8049040 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.460+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17e8036070 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2290466997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f17e80041f0 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 10 client.15549 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624ee82d7c0 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2290466997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17e8036070 con 0x5624ee813af0 2024-09-12T12:17:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2290466997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f17e8063050 con 0x5624ee813af0 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 10 client.15549 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 20 client.15549 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee8996f0 0x5624ee89bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 4 client.15549 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624ee77fd70 con 0x5624ee8996f0 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.461+0000 7f17f59b9640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee8996f0 0x5624ee89bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.462+0000 7f17d9ffb640 10 client.15549 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.462+0000 7f17f59b9640 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee8996f0 0x5624ee89bae0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f715db4f9b906d0 server_cookie=fd9304c207f27c51 in_seq=0 out_seq=0 2024-09-12T12:17:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17d9ffb640 1 -- 172.21.15.81:0/2290466997 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624ee77fd70 con 0x5624ee8996f0 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17d9ffb640 10 client.15549 handle_command_reply: tid=0 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 client.15549 shutdown 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 msgr2=0x5624ee826ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 0x5624ee826ef0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f17e8031c30 tx=0x7f17e8009920 comp rx=0 tx=0).stop 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 shutdown_connections 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5624ee8996f0 0x5624ee89bae0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5624ee81ecb0 0x5624ee8183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5624ee81ac80 0x5624ee827430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17d9ffb640 0 client.15549 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 --2- 172.21.15.81:0/2290466997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ee813af0 0x5624ee826ef0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 >> 172.21.15.81:0/2290466997 conn(0x5624ee810060 msgr2=0x5624ee80f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 shutdown_connections 2024-09-12T12:17:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 1 -- 172.21.15.81:0/2290466997 wait complete. 2024-09-12T12:17:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.466+0000 7f17fb28d740 20 client.15549 trim_cache size 0 max 16384 2024-09-12T12:17:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:17:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:17:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:17:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:17:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17dc0a2ec0 msgr2=0x7f17dc0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17dc0a2ec0 0x7f17dc0a5380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0cd160 tx=0x7f17ec0d35d0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 msgr2=0x7f17f00fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 0x7f17f00fcde0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00e9f0 tx=0x7f17ec00edf0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 shutdown_connections 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f17dc0a2ec0 0x7f17dc0a5380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17f01069c0 0x7f17f00fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17f0101350 0x7f17f00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 --2- 172.21.15.81:0/1348775064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f01009b0 0x7f17f00fcde0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 >> 172.21.15.81:0/1348775064 conn(0x7f17f0077990 msgr2=0x7f17f0069970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 shutdown_connections 2024-09-12T12:17:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:20.467+0000 7f17f841e640 1 -- 172.21.15.81:0/1348775064 wait complete. 2024-09-12T12:17:21.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:21 smithi081 ceph-mon[30948]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-12T12:17:21.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:21 smithi173 ceph-mon[35326]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-12T12:17:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:21 smithi103 ceph-mon[35094]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-12T12:17:23.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:23 smithi081 ceph-mon[30948]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-12T12:17:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:23 smithi173 ceph-mon[35326]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-12T12:17:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:23 smithi103 ceph-mon[35094]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-12T12:17:25.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:25 smithi081 ceph-mon[30948]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T12:17:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:25 smithi173 ceph-mon[35326]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T12:17:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:25 smithi103 ceph-mon[35094]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-12T12:17:27.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:27 smithi081 ceph-mon[30948]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T12:17:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:27 smithi173 ceph-mon[35326]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T12:17:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:27 smithi103 ceph-mon[35094]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-12T12:17:27.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:17:28.080 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:28.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 -- 172.21.15.81:0/3654404621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 msgr2=0x7f2e541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:28.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 --2- 172.21.15.81:0/3654404621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e541021d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009900 tx=0x7f2e4402a410 comp rx=0 tx=0).stop 2024-09-12T12:17:28.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 -- 172.21.15.81:0/3654404621 shutdown_connections 2024-09-12T12:17:28.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 --2- 172.21.15.81:0/3654404621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e54106f20 0x7f2e5410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 --2- 172.21.15.81:0/3654404621 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e541027a0 0x7f2e541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 --2- 172.21.15.81:0/3654404621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e541021d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 -- 172.21.15.81:0/3654404621 >> 172.21.15.81:0/3654404621 conn(0x7f2e540fd8f0 msgr2=0x7f2e540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 -- 172.21.15.81:0/3654404621 shutdown_connections 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.573+0000 7f2e59605640 1 -- 172.21.15.81:0/3654404621 wait complete. 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e59605640 1 Processor -- start 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e59605640 1 -- start start 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e59605640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e54198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e59605640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e541027a0 0x7f2e54198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e59605640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e54106f20 0x7f2e5419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e52ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e54198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.574+0000 7f2e59605640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541120a0 con 0x7f2e54101df0 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e59605640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54111f20 con 0x7f2e541027a0 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e52ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e54198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40252/0 (socket says 172.21.15.81:40252) 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e52ffd640 1 -- 172.21.15.81:0/79200726 learned_addr learned my addr 172.21.15.81:0/79200726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e541027a0 0x7f2e54198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e59605640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54112220 con 0x7f2e54106f20 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e537fe640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e54106f20 0x7f2e5419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 -- 172.21.15.81:0/79200726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e54106f20 msgr2=0x7f2e5419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e54106f20 0x7f2e5419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 -- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 msgr2=0x7f2e54198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e54198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 -- 172.21.15.81:0/79200726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5419d4b0 con 0x7f2e541027a0 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e52ffd640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e54198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.575+0000 7f2e527fc640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e541027a0 0x7f2e54198a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800abc0 tx=0x7f2e48007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.576+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48007ca0 con 0x7f2e541027a0 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.576+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e48007e40 con 0x7f2e541027a0 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.576+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48004b10 con 0x7f2e541027a0 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.576+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5419d7a0 con 0x7f2e541027a0 2024-09-12T12:17:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.576+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e54074420 con 0x7f2e541027a0 2024-09-12T12:17:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.577+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e541032d0 con 0x7f2e541027a0 2024-09-12T12:17:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.578+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f2e4800f6d0 con 0x7f2e541027a0 2024-09-12T12:17:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.579+0000 7f2e3bfff640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2e3c0a2e90 0x7f2e3c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.579+0000 7f2e52ffd640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2e3c0a2e90 0x7f2e3c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.579+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f2e480d2cd0 con 0x7f2e541027a0 2024-09-12T12:17:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.579+0000 7f2e52ffd640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2e3c0a2e90 0x7f2e3c0a5350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e440096c0 tx=0x7f2e44005a20 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.584+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e4809f060 con 0x7f2e541027a0 2024-09-12T12:17:28.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.806+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e5410a100 con 0x7f2e541027a0 2024-09-12T12:17:28.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.807+0000 7f2e3bfff640 1 -- 172.21.15.81:0/79200726 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11982 (secure 0 0 0) 0x7f2e480a3360 con 0x7f2e541027a0 2024-09-12T12:17:28.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:17:28.808 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-12T12:17:28.808 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"btime":"2024-09-12T12:16:24:277939+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:16:24.227728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.810+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2e3c0a2e90 msgr2=0x7f2e3c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.810+0000 7f2e59605640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2e3c0a2e90 0x7f2e3c0a5350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2e440096c0 tx=0x7f2e44005a20 comp rx=0 tx=0).stop 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.810+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e541027a0 msgr2=0x7f2e54198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.810+0000 7f2e59605640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e541027a0 0x7f2e54198a40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800abc0 tx=0x7f2e48007590 comp rx=0 tx=0).stop 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 shutdown_connections 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2e3c0a2e90 0x7f2e3c0a5350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e54106f20 0x7f2e5419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e541027a0 0x7f2e54198a40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 --2- 172.21.15.81:0/79200726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54101df0 0x7f2e54198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 >> 172.21.15.81:0/79200726 conn(0x7f2e540fd8f0 msgr2=0x7f2e540fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 shutdown_connections 2024-09-12T12:17:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:28.811+0000 7f2e59605640 1 -- 172.21.15.81:0/79200726 wait complete. 2024-09-12T12:17:29.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:29 smithi081 ceph-mon[30948]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 13 op/s 2024-09-12T12:17:29.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:29 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/79200726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:17:29.492 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id 1c187455 --release --await' 2024-09-12T12:17:29.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id 1c187455 --release --await 2024-09-12T12:17:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:29 smithi173 ceph-mon[35326]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 13 op/s 2024-09-12T12:17:29.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:29 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/79200726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:17:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:29 smithi103 ceph-mon[35094]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 13 op/s 2024-09-12T12:17:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:29 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/79200726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:17:29.827 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:17:30.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 -- 172.21.15.81:0/1474660356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 msgr2=0x7fa75010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 --2- 172.21.15.81:0/1474660356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75010d940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa748009ca0 tx=0x7fa74802a8c0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 -- 172.21.15.81:0/1474660356 shutdown_connections 2024-09-12T12:17:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 --2- 172.21.15.81:0/1474660356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75010d940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 --2- 172.21.15.81:0/1474660356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa750100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 --2- 172.21.15.81:0/1474660356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa750106a70 0x7fa750106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 -- 172.21.15.81:0/1474660356 >> 172.21.15.81:0/1474660356 conn(0x7fa7500fc7d0 msgr2=0x7fa7500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 -- 172.21.15.81:0/1474660356 shutdown_connections 2024-09-12T12:17:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.415+0000 7fa756daf640 1 -- 172.21.15.81:0/1474660356 wait complete. 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.416+0000 7fa756daf640 1 Processor -- start 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.416+0000 7fa756daf640 1 -- start start 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.416+0000 7fa756daf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa75019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa75019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa75019e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40266/0 (socket says 172.21.15.81:40266) 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa754b4b640 1 -- 172.21.15.81:0/2339774861 learned_addr learned my addr 172.21.15.81:0/2339774861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75019e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa750106a70 0x7fa750196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa750110fe0 con 0x7fa750100a70 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa750110e60 con 0x7fa750101410 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa750111160 con 0x7fa750106a70 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa75534c640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa750106a70 0x7fa750196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.417+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75019e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa74ffff640 1 -- 172.21.15.81:0/2339774861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa750106a70 msgr2=0x7fa750196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa750106a70 0x7fa750196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa74ffff640 1 -- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 msgr2=0x7fa75019e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa75019e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa74ffff640 1 -- 172.21.15.81:0/2339774861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa750196d00 con 0x7fa750101410 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa754b4b640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa75019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.418+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75019e580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00e9f0 tx=0x7fa73c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.419+0000 7fa74dffb640 1 -- 172.21.15.81:0/2339774861 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00ccc0 con 0x7fa750101410 2024-09-12T12:17:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.419+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa750196ff0 con 0x7fa750101410 2024-09-12T12:17:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.419+0000 7fa74dffb640 1 -- 172.21.15.81:0/2339774861 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73c010930 con 0x7fa750101410 2024-09-12T12:17:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.419+0000 7fa74dffb640 1 -- 172.21.15.81:0/2339774861 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0189f0 con 0x7fa750101410 2024-09-12T12:17:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.419+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7501b3e80 con 0x7fa750101410 2024-09-12T12:17:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.422+0000 7fa74dffb640 1 -- 172.21.15.81:0/2339774861 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7fa73c010ae0 con 0x7fa750101410 2024-09-12T12:17:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.422+0000 7fa759188740 1 Processor -- start 2024-09-12T12:17:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.422+0000 7fa759188740 1 -- start start 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa759188740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa706440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa759188740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa710d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa759188740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa713630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa759188740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1fa66b620 con 0x55b1fa711240 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa759188740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b1fa612e50 con 0x55b1fa706060 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa759188740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b1fa6675e0 con 0x55b1fa706980 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa75534c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa706440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa75534c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa706440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:48358/0 (socket says 172.21.15.81:48358) 2024-09-12T12:17:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa75534c640 1 -- 172.21.15.81:0/1992399174 learned_addr learned my addr 172.21.15.81:0/1992399174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa74dffb640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa7400a2f10 0x7fa7400a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa74ffff640 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa713630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.423+0000 7fa754b4b640 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa710d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa74dffb640 1 -- 172.21.15.81:0/2339774861 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa73c0cf9b0 con 0x7fa750101410 2024-09-12T12:17:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa75534c640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa7400a2f10 0x7fa7400a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa754b4b640 1 -- 172.21.15.81:0/1992399174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 msgr2=0x55b1fa706440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa754b4b640 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa706440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa754b4b640 1 -- 172.21.15.81:0/1992399174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 msgr2=0x55b1fa713630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa754b4b640 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa713630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa754b4b640 1 -- 172.21.15.81:0/1992399174 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1fa603d40 con 0x55b1fa706980 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa754b4b640 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa710d00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7440104a0 tx=0x7fa744010960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ea5628d7d3f53ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa73affd640 1 -- 172.21.15.81:0/1992399174 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744011700 con 0x55b1fa706980 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa73affd640 1 -- 172.21.15.81:0/1992399174 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa744011da0 con 0x55b1fa706980 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.424+0000 7fa73affd640 1 -- 172.21.15.81:0/1992399174 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440195d0 con 0x55b1fa706980 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 -- 172.21.15.81:0/1992399174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 msgr2=0x55b1fa710d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa75534c640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa7400a2f10 0x7fa7400a53d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa748009430 tx=0x7fa748005f50 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa710d00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7440104a0 tx=0x7fa744010960 comp rx=0 tx=0).stop 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 -- 172.21.15.81:0/1992399174 shutdown_connections 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa713630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa710d00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 --2- 172.21.15.81:0/1992399174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa706440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 -- 172.21.15.81:0/1992399174 >> 172.21.15.81:0/1992399174 conn(0x55b1fa7025f0 msgr2=0x55b1fa7029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 -- 172.21.15.81:0/1992399174 shutdown_connections 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.425+0000 7fa759188740 1 -- 172.21.15.81:0/1992399174 wait complete. 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 -- start start 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 Processor -- start 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa710cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa70df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa70e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b1fa713e60 con 0x55b1fa711240 2024-09-12T12:17:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa710cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.426+0000 7fa759188740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b1fa5f3f10 con 0x55b1fa706060 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa710cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:48360/0 (socket says 172.21.15.81:48360) 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa70df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa754b4b640 1 -- 172.21.15.81:0/4066965181 learned_addr learned my addr 172.21.15.81:0/4066965181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa759188740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b1fa713fe0 con 0x55b1fa706980 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa759188740 10 client.0 _ll_register_callbacks cb 0x55b1fa617db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 -- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 msgr2=0x55b1fa710cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa710cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 -- 172.21.15.81:0/4066965181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 msgr2=0x55b1fa70e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa70e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 -- 172.21.15.81:0/4066965181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1fa37a580 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa74ffff640 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa70df70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ccf90 tx=0x7fa73c06baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6be7573392804650 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa72ffff640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa72ffff640 1 -- 172.21.15.81:0/4066965181 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c09c390 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa744011da0 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa72ffff640 1 -- 172.21.15.81:0/4066965181 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa73c0cd480 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa72ffff640 1 -- 172.21.15.81:0/4066965181 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa73c09bc90 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa759188740 10 client.25024 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.427+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b1fa444960 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa72ffff640 1 -- 172.21.15.81:0/4066965181 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73c0a0040 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa72ffff640 1 -- 172.21.15.81:0/4066965181 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa73c09b0e0 con 0x55b1fa706980 2024-09-12T12:17:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa759188740 10 client.25024 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa759188740 10 client.25024 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa759188740 20 client.25024 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa759188740 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa720ca0 0x55b1fa7230d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa759188740 4 client.25024 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa744011da0 con 0x55b1fa720ca0 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.428+0000 7fa754b4b640 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa720ca0 0x55b1fa7230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.429+0000 7fa72ffff640 10 client.25024 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.429+0000 7fa754b4b640 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa720ca0 0x55b1fa7230d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f6e3568fb6560e server_cookie=b30bb9494136f098 in_seq=0 out_seq=0 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.429+0000 7fa72ffff640 1 -- 172.21.15.81:0/4066965181 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa744011da0 con 0x55b1fa720ca0 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.429+0000 7fa72ffff640 10 client.25024 handle_command_reply: tid=0 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.429+0000 7fa759188740 1 client.25024 shutdown 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 msgr2=0x55b1fa70df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa70df70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ccf90 tx=0x7fa73c06baf0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 shutdown_connections 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa720ca0 0x55b1fa7230d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa72ffff640 0 client.25024 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:30.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa711240 0x55b1fa70e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa706980 0x55b1fa70df70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 --2- 172.21.15.81:0/4066965181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706060 0x55b1fa710cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 >> 172.21.15.81:0/4066965181 conn(0x55b1fa7025f0 msgr2=0x55b1fa701750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 shutdown_connections 2024-09-12T12:17:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 1 -- 172.21.15.81:0/4066965181 wait complete. 2024-09-12T12:17:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.430+0000 7fa759188740 20 client.25024 trim_cache size 0 max 16384 2024-09-12T12:17:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.447+0000 7fa759188740 1 Processor -- start 2024-09-12T12:17:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.447+0000 7fa759188740 1 -- start start 2024-09-12T12:17:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.447+0000 7fa759188740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa701640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.447+0000 7fa759188740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa7289a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.447+0000 7fa759188740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa728ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa759188740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501bc6f0 con 0x55b1fa706060 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa759188740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501be230 con 0x55b1fa706980 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa759188740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501bcdc0 con 0x55b1fa711240 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa7289a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa701640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa7289a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:48366/0 (socket says 172.21.15.81:48366) 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa701640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40296/0 (socket says 172.21.15.81:40296) 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 -- 172.21.15.81:0/3604917802 learned_addr learned my addr 172.21.15.81:0/3604917802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa75534c640 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa728ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 -- 172.21.15.81:0/3604917802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 msgr2=0x55b1fa728ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa728ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 -- 172.21.15.81:0/3604917802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 msgr2=0x55b1fa701640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa701640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 -- 172.21.15.81:0/3604917802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1fa7067b0 con 0x55b1fa706980 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa74ffff640 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa7289a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa73c09b990 tx=0x7fa73c005b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e48083d5d42019 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa73a7fc640 1 -- 172.21.15.81:0/3604917802 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0a4900 con 0x55b1fa706980 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa73a7fc640 1 -- 172.21.15.81:0/3604917802 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa73c09b0e0 con 0x55b1fa706980 2024-09-12T12:17:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.448+0000 7fa73a7fc640 1 -- 172.21.15.81:0/3604917802 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c06bdc0 con 0x55b1fa706980 2024-09-12T12:17:30.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 -- 172.21.15.81:0/3604917802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 msgr2=0x55b1fa7289a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa7289a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa73c09b990 tx=0x7fa73c005b30 comp rx=0 tx=0).stop 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 -- 172.21.15.81:0/3604917802 shutdown_connections 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa728ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa7289a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 --2- 172.21.15.81:0/3604917802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa701640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 -- 172.21.15.81:0/3604917802 >> 172.21.15.81:0/3604917802 conn(0x55b1fa7025f0 msgr2=0x55b1fa700f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 -- 172.21.15.81:0/3604917802 shutdown_connections 2024-09-12T12:17:30.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.449+0000 7fa759188740 1 -- 172.21.15.81:0/3604917802 wait complete. 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.450+0000 7fa759188740 1 -- start start 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.450+0000 7fa759188740 1 Processor -- start 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.450+0000 7fa759188740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa719a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa759188740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa714220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa759188740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa714830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa719a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa759188740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501bdb60 con 0x55b1fa706060 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa719a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40300/0 (socket says 172.21.15.81:40300) 2024-09-12T12:17:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa759188740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501bd490 con 0x55b1fa706980 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 -- 172.21.15.81:0/2576029329 learned_addr learned my addr 172.21.15.81:0/2576029329 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa7501ba6d0 con 0x55b1fa711240 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa75534c640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa714830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa714220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 -- 172.21.15.81:0/2576029329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 msgr2=0x55b1fa714830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa714830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 -- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 msgr2=0x55b1fa714220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa714220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.451+0000 7fa754b4b640 1 -- 172.21.15.81:0/2576029329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1fa715030 con 0x55b1fa706060 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa759188740 10 client.0 _ll_register_callbacks cb 0x7fa73c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa73c09b0e0 con 0x55b1fa706060 2024-09-12T12:17:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa754b4b640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa719a40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa744006010 tx=0x7fa74400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7addc7c98159a305 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa72ffff640 10 client.15570 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa72ffff640 1 -- 172.21.15.81:0/2576029329 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400e4f0 con 0x55b1fa706060 2024-09-12T12:17:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa72ffff640 1 -- 172.21.15.81:0/2576029329 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa74400e690 con 0x55b1fa706060 2024-09-12T12:17:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa72ffff640 1 -- 172.21.15.81:0/2576029329 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa744005040 con 0x55b1fa706060 2024-09-12T12:17:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa759188740 10 client.15570 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.452+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b1fa78c920 con 0x55b1fa706060 2024-09-12T12:17:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa72ffff640 1 -- 172.21.15.81:0/2576029329 <== mon.0 v2:172.21.15.81:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa7440051e0 con 0x55b1fa706060 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa759188740 10 client.15570 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa759188740 10 client.15570 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa759188740 20 client.15570 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa759188740 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa78cc00 0x55b1fa78eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa759188740 4 client.15570 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1c187455", "release": true, "await": true}] 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1c187455", "release": true, "await": true}) -- 0x55b1fa678b90 con 0x55b1fa78cc00 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.453+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa78cc00 0x55b1fa78eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.454+0000 7fa74ffff640 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa78cc00 0x55b1fa78eff0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1d2cbcae5621b9 server_cookie=33205c35568abfb5 in_seq=0 out_seq=0 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.454+0000 7fa72ffff640 10 client.15570 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.456+0000 7fa72ffff640 1 -- 172.21.15.81:0/2576029329 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b1fa678b90 con 0x55b1fa78cc00 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.456+0000 7fa72ffff640 10 client.15570 handle_command_reply: tid=0 2024-09-12T12:17:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.456+0000 7fa759188740 1 client.15570 shutdown 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.456+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 msgr2=0x55b1fa719a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.456+0000 7fa759188740 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa719a40 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa744006010 tx=0x7fa74400ed00 comp rx=0 tx=0).stop 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 shutdown_connections 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b1fa78cc00 0x55b1fa78eff0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b1fa711240 0x55b1fa714830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b1fa706980 0x55b1fa714220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 --2- 172.21.15.81:0/2576029329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b1fa706060 0x55b1fa719a40 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 >> 172.21.15.81:0/2576029329 conn(0x55b1fa7025f0 msgr2=0x55b1fa701750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa72ffff640 0 client.15570 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 shutdown_connections 2024-09-12T12:17:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 1 -- 172.21.15.81:0/2576029329 wait complete. 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.457+0000 7fa759188740 20 client.15570 trim_cache size 0 max 16384 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 27, 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 4, 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T12:17:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "1c187455": { 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 4, 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 144.5, 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:17:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:17:30.462 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa7400a2f10 msgr2=0x7fa7400a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa7400a2f10 0x7fa7400a53d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa748009430 tx=0x7fa748005f50 comp rx=0 tx=0).stop 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 msgr2=0x7fa75019e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75019e580 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00e9f0 tx=0x7fa73c00eeb0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 shutdown_connections 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa7400a2f10 0x7fa7400a53d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa750106a70 0x7fa750196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa750101410 0x7fa75019e580 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 --2- 172.21.15.81:0/2339774861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa750100a70 0x7fa75019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.459+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 >> 172.21.15.81:0/2339774861 conn(0x7fa7500fc7d0 msgr2=0x7fa75010c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.461+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 shutdown_connections 2024-09-12T12:17:30.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:17:30.461+0000 7fa756daf640 1 -- 172.21.15.81:0/2339774861 wait complete. 2024-09-12T12:17:30.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:30 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:30.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:30 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:30.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:30 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:17:31.193 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1c187455', total seconds elapsed: 27.9 2024-09-12T12:17:31.555 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:31 smithi173 ceph-mon[35326]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:17:31.555 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.555 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:31.555 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:17:31.587 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:31 smithi103 ceph-mon[35094]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:17:31.587 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.587 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:31.587 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:17:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:31 smithi081 ceph-mon[30948]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:17:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:17:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:17:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:17:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 -- 172.21.15.81:0/3286823616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424101350 msgr2=0x7f242410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 --2- 172.21.15.81:0/3286823616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424101350 0x7f242410d880 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f241c009cd0 tx=0x7f241c02a8e0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 -- 172.21.15.81:0/3286823616 shutdown_connections 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 --2- 172.21.15.81:0/3286823616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424101350 0x7f242410d880 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 --2- 172.21.15.81:0/3286823616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24241009b0 0x7f2424100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 --2- 172.21.15.81:0/3286823616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24241069c0 0x7f2424106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 -- 172.21.15.81:0/3286823616 >> 172.21.15.81:0/3286823616 conn(0x7f2424077990 msgr2=0x7f24240fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 -- 172.21.15.81:0/3286823616 shutdown_connections 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.561+0000 7f2429e6e640 1 -- 172.21.15.81:0/3286823616 wait complete. 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 Processor -- start 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 -- start start 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24241009b0 0x7f24241973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2424101350 0x7f2424197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 0x7f242419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2424110f20 con 0x7f24241069c0 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2424110da0 con 0x7f24241009b0 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2429e6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24241110a0 con 0x7f2424101350 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2423fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 0x7f242419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2423fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 0x7f242419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33072/0 (socket says 172.21.15.81:33072) 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.562+0000 7f2423fff640 1 -- 172.21.15.81:0/2885150467 learned_addr learned my addr 172.21.15.81:0/2885150467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f24237fe640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24241009b0 0x7f24241973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2424101350 0x7f2424197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2423fff640 1 -- 172.21.15.81:0/2885150467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2424101350 msgr2=0x7f2424197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2423fff640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2424101350 0x7f2424197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2423fff640 1 -- 172.21.15.81:0/2885150467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24241009b0 msgr2=0x7f24241973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2423fff640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24241009b0 0x7f24241973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2423fff640 1 -- 172.21.15.81:0/2885150467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242419c3e0 con 0x7f24241069c0 2024-09-12T12:17:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2423fff640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 0x7f242419bcb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f241c006010 tx=0x7f241c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2420ff9640 1 -- 172.21.15.81:0/2885150467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c031c80 con 0x7f24241069c0 2024-09-12T12:17:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242419c670 con 0x7f24241069c0 2024-09-12T12:17:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2420ff9640 1 -- 172.21.15.81:0/2885150467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f241c031e20 con 0x7f24241069c0 2024-09-12T12:17:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2420ff9640 1 -- 172.21.15.81:0/2885150467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c030cf0 con 0x7f24241069c0 2024-09-12T12:17:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.563+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24241a3f60 con 0x7f24241069c0 2024-09-12T12:17:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.565+0000 7f2420ff9640 1 -- 172.21.15.81:0/2885150467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f241c004040 con 0x7f24241069c0 2024-09-12T12:17:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 Processor -- start 2024-09-12T12:17:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f2420ff9640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f240c0a2ec0 0x7f240c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 -- start start 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f2420ff9640 1 -- 172.21.15.81:0/2885150467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f241c02e030 con 0x7f24241069c0 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f240c0a2ec0 0x7f240c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55863d1502f0 con 0x55863d1edd00 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55863d0f8270 con 0x55863d1f8ec0 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f242cc08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55863d14c2b0 con 0x55863d1ee620 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f24237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.566+0000 7f24237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33076/0 (socket says 172.21.15.81:33076) 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 -- 172.21.15.81:0/3462595421 learned_addr learned my addr 172.21.15.81:0/3462595421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f2423fff640 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f240c0a2ec0 0x7f240c0a5380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24240ffe50 tx=0x7f2418005f90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 -- 172.21.15.81:0/3462595421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 msgr2=0x55863d1f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f2422ffd640 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 -- 172.21.15.81:0/3462595421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 msgr2=0x55863d1fb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1fb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 -- 172.21.15.81:0/3462595421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863d0f7340 con 0x55863d1edd00 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f24237fe640 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1ee0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f241400bc90 tx=0x7f24140107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d033ca4eb1581a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f2409ffb640 1 -- 172.21.15.81:0/3462595421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241401c480 con 0x55863d1edd00 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f2409ffb640 1 -- 172.21.15.81:0/3462595421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f241401cb20 con 0x55863d1edd00 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.567+0000 7f2409ffb640 1 -- 172.21.15.81:0/3462595421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414011c70 con 0x55863d1edd00 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 -- 172.21.15.81:0/3462595421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 msgr2=0x55863d1ee0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1ee0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f241400bc90 tx=0x7f24140107a0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 -- 172.21.15.81:0/3462595421 shutdown_connections 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1fb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 --2- 172.21.15.81:0/3462595421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1ee0e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 -- 172.21.15.81:0/3462595421 >> 172.21.15.81:0/3462595421 conn(0x55863d1ea270 msgr2=0x55863d1ea650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 -- 172.21.15.81:0/3462595421 shutdown_connections 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 -- 172.21.15.81:0/3462595421 wait complete. 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.568+0000 7f242cc08740 1 -- start start 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 Processor -- start 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55863d1fba90 con 0x55863d1edd00 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55863d0d9290 con 0x55863d1f8ec0 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55863d1fbc10 con 0x55863d1ee620 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f242cc08740 10 client.0 _ll_register_callbacks cb 0x55863d10a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33088/0 (socket says 172.21.15.81:33088) 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 -- 172.21.15.81:0/2994718915 learned_addr learned my addr 172.21.15.81:0/2994718915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f2423fff640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 -- 172.21.15.81:0/2994718915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 msgr2=0x55863d1f6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 -- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 msgr2=0x55863d1f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f24237fe640 1 -- 172.21.15.81:0/2994718915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863ce63210 con 0x55863d1edd00 2024-09-12T12:17:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.569+0000 7f2423fff640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f24237fe640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1f5d40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2414010ca0 tx=0x7f2414011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26d6e819332427 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f2402ffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f2402ffd640 1 -- 172.21.15.81:0/2994718915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241401c480 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f2402ffd640 1 -- 172.21.15.81:0/2994718915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f241401c620 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f241401cb20 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f2402ffd640 1 -- 172.21.15.81:0/2994718915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f241401c820 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 10 client.15582 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55863cf2f620 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f2402ffd640 1 -- 172.21.15.81:0/2994718915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f241401cb20 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f2402ffd640 1 -- 172.21.15.81:0/2994718915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f241401dce0 con 0x55863d1edd00 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 10 client.15582 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 20 client.15582 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d208e30 0x55863d20b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 4 client.15582 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.570+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55863d15da20 con 0x55863d208e30 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.571+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d208e30 0x55863d20b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.571+0000 7f2402ffd640 10 client.15582 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.571+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d208e30 0x55863d20b220 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97b3ad30cbcbb9f server_cookie=140555d9047931ea in_seq=0 out_seq=0 2024-09-12T12:17:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f2402ffd640 1 -- 172.21.15.81:0/2994718915 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55863d15da20 con 0x55863d208e30 2024-09-12T12:17:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f2402ffd640 10 client.15582 handle_command_reply: tid=0 2024-09-12T12:17:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 client.15582 shutdown 2024-09-12T12:17:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 msgr2=0x55863d1f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1f5d40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2414010ca0 tx=0x7f2414011580 comp rx=0 tx=0).stop 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 shutdown_connections 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d208e30 0x55863d20b220 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d1f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1ee620 0x55863d1f6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f2402ffd640 0 client.15582 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 --2- 172.21.15.81:0/2994718915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d1f5d40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 >> 172.21.15.81:0/2994718915 conn(0x55863d1ea270 msgr2=0x55863d1e71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 shutdown_connections 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 1 -- 172.21.15.81:0/2994718915 wait complete. 2024-09-12T12:17:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.572+0000 7f242cc08740 20 client.15582 trim_cache size 0 max 16384 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.586+0000 7f242cc08740 1 Processor -- start 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.586+0000 7f242cc08740 1 -- start start 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f242cc08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1edd00 0x55863d1e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f242cc08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 0x55863d210940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f242cc08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d210e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f242cc08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24241ab4c0 con 0x55863d1ee620 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f242cc08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24241ad000 con 0x55863d1f8ec0 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f242cc08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24241abb90 con 0x55863d1edd00 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 0x55863d210940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 0x55863d210940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33104/0 (socket says 172.21.15.81:33104) 2024-09-12T12:17:33.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 -- 172.21.15.81:0/2830502622 learned_addr learned my addr 172.21.15.81:0/2830502622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f24237fe640 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1edd00 0x55863d1e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2423fff640 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d210e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 -- 172.21.15.81:0/2830502622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1edd00 msgr2=0x55863d1e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1edd00 0x55863d1e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 -- 172.21.15.81:0/2830502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 msgr2=0x55863d210e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d210e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 -- 172.21.15.81:0/2830502622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55863d1ea0a0 con 0x55863d1ee620 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f2422ffd640 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 0x55863d210940 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55863d1eb0d0 tx=0x7f2418016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da94cbd653552034 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.587+0000 7f24097fa640 1 -- 172.21.15.81:0/2830502622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418004220 con 0x55863d1ee620 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f24097fa640 1 -- 172.21.15.81:0/2830502622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f241801de10 con 0x55863d1ee620 2024-09-12T12:17:33.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f24097fa640 1 -- 172.21.15.81:0/2830502622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418004a00 con 0x55863d1ee620 2024-09-12T12:17:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 -- 172.21.15.81:0/2830502622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 msgr2=0x55863d210940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 0x55863d210940 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55863d1eb0d0 tx=0x7f2418016000 comp rx=0 tx=0).stop 2024-09-12T12:17:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 -- 172.21.15.81:0/2830502622 shutdown_connections 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1f8ec0 0x55863d210e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1ee620 0x55863d210940 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 --2- 172.21.15.81:0/2830502622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1edd00 0x55863d1e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 -- 172.21.15.81:0/2830502622 >> 172.21.15.81:0/2830502622 conn(0x55863d1ea270 msgr2=0x55863d1e69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 -- 172.21.15.81:0/2830502622 shutdown_connections 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.588+0000 7f242cc08740 1 -- 172.21.15.81:0/2830502622 wait complete. 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 -- start start 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 Processor -- start 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d2014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 0x55863d1fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1f8ec0 0x55863d1fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24241ac930 con 0x55863d1edd00 2024-09-12T12:17:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24241ac260 con 0x55863d1ee620 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24241a94c0 con 0x55863d1f8ec0 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.589+0000 7f242cc08740 10 client.0 _ll_register_callbacks cb 0x7f241400bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 0x55863d1fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 0x55863d1fc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:55084/0 (socket says 172.21.15.81:55084) 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 -- 172.21.15.81:0/3490420639 learned_addr learned my addr 172.21.15.81:0/3490420639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2423fff640 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1f8ec0 0x55863d1fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 -- 172.21.15.81:0/3490420639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1f8ec0 msgr2=0x55863d1fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1f8ec0 0x55863d1fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 -- 172.21.15.81:0/3490420639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 msgr2=0x55863d2014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d2014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 -- 172.21.15.81:0/3490420639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863d1f0b50 con 0x55863d1ee620 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2422ffd640 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 0x55863d1fc7d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f241802c000 tx=0x7f24180056e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8789938214428026 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:33.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2402ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2402ffd640 1 -- 172.21.15.81:0/3490420639 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418036070 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f241801de10 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.590+0000 7f2402ffd640 1 -- 172.21.15.81:0/3490420639 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f2418004040 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f2402ffd640 1 -- 172.21.15.81:0/3490420639 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2418042050 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 10 client.25112 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55863d273610 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f2402ffd640 1 -- 172.21.15.81:0/3490420639 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f241801de10 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f2402ffd640 1 -- 172.21.15.81:0/3490420639 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f241802f040 con 0x55863d1ee620 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 10 client.25112 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 10 client.25112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 20 client.25112 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d273d40 0x55863d276160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:33.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 4 client.25112 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:17:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55863d157d70 con 0x55863d273d40 2024-09-12T12:17:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.591+0000 7f24237fe640 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d273d40 0x55863d276160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.592+0000 7f24237fe640 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d273d40 0x55863d276160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ea3f3ea21379d7f server_cookie=cbcf2263e87c7e74 in_seq=0 out_seq=0 2024-09-12T12:17:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.592+0000 7f2402ffd640 10 client.25112 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f2402ffd640 1 -- 172.21.15.81:0/3490420639 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55863d157d70 con 0x55863d273d40 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f2402ffd640 10 client.25112 handle_command_reply: tid=0 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 client.25112 shutdown 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 msgr2=0x55863d1fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 0x55863d1fc7d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f241802c000 tx=0x7f24180056e0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 shutdown_connections 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55863d273d40 0x55863d276160 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55863d1f8ec0 0x55863d1fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f242cc08740 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55863d1ee620 0x55863d1fc7d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f242cc08740 1 --2- 172.21.15.81:0/3490420639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863d1edd00 0x55863d2014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.595+0000 7f2402ffd640 0 client.25112 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 >> 172.21.15.81:0/3490420639 conn(0x55863d1ea270 msgr2=0x55863d1e71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 shutdown_connections 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f242cc08740 1 -- 172.21.15.81:0/3490420639 wait complete. 2024-09-12T12:17:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f242cc08740 20 client.25112 trim_cache size 0 max 16384 2024-09-12T12:17:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:17:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:17:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:17:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f240c0a2ec0 msgr2=0x7f240c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f240c0a2ec0 0x7f240c0a5380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24240ffe50 tx=0x7f2418005f90 comp rx=0 tx=0).stop 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 msgr2=0x7f242419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 0x7f242419bcb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f241c006010 tx=0x7f241c003f10 comp rx=0 tx=0).stop 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 shutdown_connections 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f240c0a2ec0 0x7f240c0a5380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24241069c0 0x7f242419bcb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2424101350 0x7f2424197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 --2- 172.21.15.81:0/2885150467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24241009b0 0x7f24241973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 >> 172.21.15.81:0/2885150467 conn(0x7f2424077990 msgr2=0x7f2424103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 shutdown_connections 2024-09-12T12:17:33.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:33.596+0000 7f2429e6e640 1 -- 172.21.15.81:0/2885150467 wait complete. 2024-09-12T12:17:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:33 smithi081 ceph-mon[30948]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:17:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:33 smithi173 ceph-mon[35326]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:17:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:33 smithi103 ceph-mon[35094]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:17:35.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:35 smithi081 ceph-mon[30948]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:17:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:35 smithi173 ceph-mon[35326]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:17:35.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:35 smithi103 ceph-mon[35094]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:17:37.405 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.406 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-09-12T12:17:37.407 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.407 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-09-12T12:17:37.407 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.407 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T12:17:37.407 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-09-12T12:17:37.407 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T12:17:37.411 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T12:17:37.473 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T12:17:37.476 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T12:17:37.476 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T12:17:37.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:37 smithi081 ceph-mon[30948]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:17:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:37 smithi173 ceph-mon[35326]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:17:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:37 smithi103 ceph-mon[35094]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:17:38.159 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T12:17:38.231 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T12:17:38.271 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T12:17:38.273 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T12:17:38.273 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T12:17:38.312 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T12:17:38.316 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:17:38.316 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T12:17:38.372 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-12T12:17:38.373 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-12T12:17:38.373 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-12T12:17:38.434 INFO:tasks.workunit.client.0.smithi081.stderr:+ KERNEL=linux-4.0.5 2024-09-12T12:17:38.434 INFO:tasks.workunit.client.0.smithi081.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-12T12:17:39.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:39 smithi081 ceph-mon[30948]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:17:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:39 smithi173 ceph-mon[35326]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:17:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:39 smithi103 ceph-mon[35094]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:17:41.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir untar_tar 2024-09-12T12:17:41.293 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd untar_tar 2024-09-12T12:17:41.293 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-12T12:17:41.317 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ 2024-09-12T12:17:41.319 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-12T12:17:41.320 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-12T12:17:41.320 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-12T12:17:41.321 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-12T12:17:41.322 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-12T12:17:41.323 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-12T12:17:41.325 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-12T12:17:41.326 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-12T12:17:41.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-12T12:17:41.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-12T12:17:41.328 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-12T12:17:41.329 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-12T12:17:41.330 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-12T12:17:41.331 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-12T12:17:41.332 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-12T12:17:41.333 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-12T12:17:41.334 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-12T12:17:41.335 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-12T12:17:41.336 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-12T12:17:41.337 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-12T12:17:41.338 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-12T12:17:41.339 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-12T12:17:41.340 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-12T12:17:41.341 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-12T12:17:41.342 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-12T12:17:41.343 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-12T12:17:41.344 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-12T12:17:41.345 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-12T12:17:41.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-12T12:17:41.347 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-12T12:17:41.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-12T12:17:41.349 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-12T12:17:41.349 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-12T12:17:41.350 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-12T12:17:41.351 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-12T12:17:41.352 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-12T12:17:41.353 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-12T12:17:41.354 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-12T12:17:41.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-12T12:17:41.356 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-12T12:17:41.358 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-12T12:17:41.359 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-12T12:17:41.360 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-12T12:17:41.361 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-12T12:17:41.362 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-12T12:17:41.363 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-12T12:17:41.364 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-12T12:17:41.365 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-12T12:17:41.366 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-12T12:17:41.367 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-12T12:17:41.368 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-12T12:17:41.369 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-12T12:17:41.370 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-12T12:17:41.371 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-12T12:17:41.372 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-12T12:17:41.373 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-12T12:17:41.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-12T12:17:41.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-12T12:17:41.376 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-12T12:17:41.377 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-12T12:17:41.378 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-12T12:17:41.379 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-12T12:17:41.380 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-12T12:17:41.381 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-12T12:17:41.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-12T12:17:41.383 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-12T12:17:41.384 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-12T12:17:41.385 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-12T12:17:41.385 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-12T12:17:41.387 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-12T12:17:41.387 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-12T12:17:41.388 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-12T12:17:41.389 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-12T12:17:41.390 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-12T12:17:41.391 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-12T12:17:41.392 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-12T12:17:41.393 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-12T12:17:41.394 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-12T12:17:41.395 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-12T12:17:41.396 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-12T12:17:41.397 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-12T12:17:41.398 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-12T12:17:41.399 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-12T12:17:41.400 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-12T12:17:41.401 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-12T12:17:41.402 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-12T12:17:41.403 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-12T12:17:41.404 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-12T12:17:41.405 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-12T12:17:41.406 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-12T12:17:41.407 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-12T12:17:41.409 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-12T12:17:41.409 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-12T12:17:41.410 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-12T12:17:41.411 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-12T12:17:41.412 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-12T12:17:41.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-12T12:17:41.414 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-12T12:17:41.415 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-12T12:17:41.416 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-12T12:17:41.417 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-12T12:17:41.418 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-12T12:17:41.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-12T12:17:41.420 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-12T12:17:41.421 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-12T12:17:41.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-12T12:17:41.423 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-12T12:17:41.424 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-12T12:17:41.424 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-12T12:17:41.425 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-12T12:17:41.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-12T12:17:41.427 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-12T12:17:41.428 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-12T12:17:41.429 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-12T12:17:41.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-12T12:17:41.431 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-12T12:17:41.432 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-12T12:17:41.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-12T12:17:41.434 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-12T12:17:41.435 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-12T12:17:41.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-12T12:17:41.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-12T12:17:41.438 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-12T12:17:41.439 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-12T12:17:41.440 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-12T12:17:41.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-12T12:17:41.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-12T12:17:41.442 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-12T12:17:41.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-12T12:17:41.444 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-12T12:17:41.445 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-12T12:17:41.446 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-12T12:17:41.447 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-12T12:17:41.448 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-12T12:17:41.448 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-12T12:17:41.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-12T12:17:41.450 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-12T12:17:41.451 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-12T12:17:41.452 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-12T12:17:41.453 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-12T12:17:41.453 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-12T12:17:41.454 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-12T12:17:41.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-12T12:17:41.456 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-12T12:17:41.457 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-12T12:17:41.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-12T12:17:41.459 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-12T12:17:41.460 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-12T12:17:41.460 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-12T12:17:41.461 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-12T12:17:41.462 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-12T12:17:41.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-12T12:17:41.464 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-12T12:17:41.465 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-12T12:17:41.466 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-12T12:17:41.466 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-12T12:17:41.467 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-12T12:17:41.468 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-12T12:17:41.469 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-12T12:17:41.470 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-12T12:17:41.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-12T12:17:41.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-12T12:17:41.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-12T12:17:41.474 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-12T12:17:41.475 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-12T12:17:41.475 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-12T12:17:41.476 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-12T12:17:41.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-12T12:17:41.478 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-12T12:17:41.479 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-12T12:17:41.480 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-12T12:17:41.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-12T12:17:41.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-12T12:17:41.482 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-12T12:17:41.483 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-12T12:17:41.484 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-12T12:17:41.485 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-12T12:17:41.486 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-12T12:17:41.487 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-12T12:17:41.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-12T12:17:41.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-12T12:17:41.489 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-12T12:17:41.490 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-12T12:17:41.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-12T12:17:41.492 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-12T12:17:41.493 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-12T12:17:41.493 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-12T12:17:41.494 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-12T12:17:41.495 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-12T12:17:41.496 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-12T12:17:41.497 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-12T12:17:41.498 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-12T12:17:41.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-12T12:17:41.500 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-12T12:17:41.501 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-12T12:17:41.501 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-12T12:17:41.502 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-12T12:17:41.503 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-12T12:17:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:41 smithi081 ceph-mon[30948]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:17:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:41 smithi173 ceph-mon[35326]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:17:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:41 smithi103 ceph-mon[35094]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:17:43.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:43 smithi081 ceph-mon[30948]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-12T12:17:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:43 smithi173 ceph-mon[35326]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-12T12:17:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:43 smithi103 ceph-mon[35094]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-12T12:17:44.206 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-12T12:17:44.209 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-12T12:17:44.210 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-12T12:17:44.211 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-12T12:17:44.213 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-12T12:17:44.215 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-12T12:17:44.216 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-12T12:17:44.217 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-12T12:17:44.218 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-12T12:17:44.220 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-12T12:17:44.221 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-12T12:17:44.223 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-12T12:17:44.224 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-12T12:17:44.225 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-12T12:17:44.227 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-12T12:17:44.228 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-12T12:17:44.230 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-12T12:17:44.231 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-12T12:17:44.233 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-12T12:17:44.234 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-12T12:17:44.235 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-12T12:17:44.237 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-12T12:17:44.238 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-12T12:17:44.240 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-12T12:17:44.241 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-12T12:17:44.243 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-12T12:17:44.244 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-12T12:17:44.246 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-12T12:17:44.247 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-12T12:17:44.249 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-12T12:17:44.250 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-12T12:17:44.251 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-12T12:17:44.253 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-12T12:17:44.254 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-12T12:17:44.255 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-12T12:17:44.256 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-12T12:17:44.256 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-12T12:17:44.258 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-12T12:17:44.258 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-12T12:17:44.259 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-12T12:17:44.260 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-12T12:17:44.261 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-12T12:17:44.262 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-12T12:17:44.263 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-12T12:17:44.264 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-12T12:17:44.265 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-12T12:17:44.266 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-12T12:17:44.267 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-12T12:17:44.268 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-12T12:17:44.269 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-12T12:17:44.270 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-12T12:17:44.271 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-12T12:17:44.272 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-12T12:17:44.272 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-12T12:17:44.273 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-12T12:17:44.274 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-12T12:17:44.275 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-12T12:17:44.276 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-12T12:17:44.277 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-12T12:17:44.278 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-12T12:17:44.279 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-12T12:17:44.281 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-12T12:17:44.281 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-12T12:17:44.282 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/Changes 2024-09-12T12:17:44.283 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-12T12:17:44.284 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-12T12:17:44.285 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-12T12:17:44.286 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-12T12:17:44.287 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-12T12:17:44.288 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-12T12:17:44.288 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-12T12:17:44.289 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-12T12:17:44.290 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-12T12:17:44.291 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-12T12:17:44.292 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-12T12:17:44.293 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-12T12:17:44.294 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-12T12:17:44.295 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-12T12:17:44.295 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-12T12:17:44.296 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-12T12:17:44.298 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-12T12:17:44.299 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-12T12:17:44.299 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-12T12:17:44.300 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-12T12:17:44.301 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-12T12:17:44.302 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-12T12:17:44.303 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-12T12:17:44.304 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-12T12:17:44.305 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-12T12:17:44.305 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-12T12:17:44.306 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-12T12:17:44.307 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-12T12:17:44.308 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-12T12:17:44.309 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-12T12:17:44.310 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-12T12:17:44.311 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-12T12:17:44.311 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-12T12:17:44.312 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-12T12:17:44.313 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-12T12:17:44.314 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-12T12:17:44.315 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-12T12:17:44.316 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-12T12:17:44.317 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-12T12:17:44.318 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-12T12:17:44.319 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-12T12:17:44.320 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-12T12:17:44.321 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-12T12:17:44.322 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-12T12:17:44.323 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-12T12:17:44.324 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-12T12:17:44.325 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-12T12:17:44.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-12T12:17:44.328 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-12T12:17:44.329 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-12T12:17:44.330 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-12T12:17:44.331 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-12T12:17:44.332 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-12T12:17:44.333 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-12T12:17:44.334 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-12T12:17:44.335 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-12T12:17:44.336 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-12T12:17:44.337 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-12T12:17:44.339 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-12T12:17:44.341 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-12T12:17:44.344 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-12T12:17:44.344 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-12T12:17:44.345 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-12T12:17:44.345 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-12T12:17:44.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-12T12:17:44.347 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-12T12:17:44.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-12T12:17:44.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-12T12:17:44.349 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-12T12:17:44.350 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-12T12:17:44.351 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-12T12:17:44.352 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-12T12:17:44.353 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-12T12:17:44.354 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-12T12:17:44.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-12T12:17:44.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-12T12:17:44.356 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-12T12:17:44.357 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-12T12:17:44.358 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-12T12:17:44.359 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-12T12:17:44.360 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-12T12:17:44.361 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-12T12:17:44.361 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-12T12:17:44.362 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-12T12:17:44.363 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-12T12:17:44.364 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-12T12:17:44.365 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-12T12:17:44.366 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-12T12:17:44.366 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-12T12:17:44.367 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-12T12:17:44.368 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-12T12:17:44.369 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-12T12:17:44.370 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-12T12:17:44.371 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-12T12:17:44.372 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-12T12:17:44.373 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-12T12:17:44.374 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-12T12:17:44.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-12T12:17:44.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-12T12:17:44.376 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-12T12:17:44.377 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-12T12:17:44.378 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-12T12:17:44.379 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-12T12:17:44.380 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-12T12:17:44.381 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-12T12:17:44.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-12T12:17:44.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-12T12:17:44.383 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-12T12:17:44.384 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-12T12:17:44.385 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-12T12:17:44.386 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-12T12:17:44.386 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-12T12:17:44.387 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-12T12:17:44.388 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-12T12:17:44.389 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-12T12:17:44.390 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-12T12:17:44.391 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-12T12:17:44.392 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-12T12:17:44.393 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-12T12:17:44.394 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-12T12:17:44.395 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-12T12:17:44.396 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-12T12:17:44.397 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-12T12:17:44.398 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-12T12:17:44.399 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-12T12:17:44.400 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-12T12:17:44.401 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-12T12:17:44.402 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-12T12:17:44.403 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-12T12:17:44.403 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-12T12:17:44.404 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-12T12:17:44.405 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-12T12:17:44.406 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-12T12:17:44.406 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-12T12:17:44.407 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-12T12:17:44.408 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-12T12:17:44.409 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-12T12:17:44.410 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-12T12:17:44.411 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-12T12:17:44.412 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-12T12:17:44.412 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-12T12:17:44.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-12T12:17:44.414 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-12T12:17:44.415 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-12T12:17:44.416 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-12T12:17:44.417 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-12T12:17:44.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-12T12:17:44.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-12T12:17:44.420 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-12T12:17:44.421 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-12T12:17:44.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-12T12:17:44.423 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-12T12:17:44.424 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-12T12:17:44.425 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-12T12:17:44.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-12T12:17:44.427 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-12T12:17:44.428 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-12T12:17:44.428 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-12T12:17:44.429 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-12T12:17:44.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-12T12:17:44.431 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-12T12:17:44.432 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-12T12:17:44.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-12T12:17:44.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-12T12:17:44.434 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-12T12:17:44.435 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-12T12:17:44.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-12T12:17:44.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-12T12:17:44.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-12T12:17:44.438 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-12T12:17:44.439 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-12T12:17:44.440 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-12T12:17:44.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-12T12:17:44.442 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-12T12:17:44.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-12T12:17:44.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-12T12:17:44.444 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-12T12:17:44.445 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-12T12:17:44.446 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-12T12:17:44.447 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-12T12:17:44.447 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-12T12:17:44.448 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-12T12:17:44.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-12T12:17:44.450 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-12T12:17:44.450 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-12T12:17:44.451 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-12T12:17:44.452 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-12T12:17:44.453 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-12T12:17:44.454 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-12T12:17:44.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-12T12:17:44.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-12T12:17:44.456 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-12T12:17:44.457 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-12T12:17:44.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-12T12:17:44.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-12T12:17:44.459 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-12T12:17:44.460 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-12T12:17:44.461 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-12T12:17:44.462 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-12T12:17:44.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-12T12:17:44.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-12T12:17:44.464 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-12T12:17:44.465 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-12T12:17:44.466 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-12T12:17:44.467 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-12T12:17:45.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:45 smithi081 ceph-mon[30948]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-12T12:17:45.647 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-12T12:17:45.648 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-12T12:17:45.649 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-12T12:17:45.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-12T12:17:45.651 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-12T12:17:45.652 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-12T12:17:45.653 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-12T12:17:45.654 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-12T12:17:45.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:45 smithi173 ceph-mon[35326]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-12T12:17:45.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-12T12:17:45.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-12T12:17:45.656 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-12T12:17:45.658 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-12T12:17:45.659 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-12T12:17:45.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-12T12:17:45.662 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-12T12:17:45.663 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-12T12:17:45.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-12T12:17:45.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-12T12:17:45.665 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-12T12:17:45.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-12T12:17:45.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-12T12:17:45.668 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-12T12:17:45.669 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-12T12:17:45.670 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-12T12:17:45.671 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-12T12:17:45.671 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-12T12:17:45.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-12T12:17:45.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-12T12:17:45.674 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-12T12:17:45.676 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-12T12:17:45.677 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-12T12:17:45.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-12T12:17:45.680 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-12T12:17:45.681 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-12T12:17:45.682 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-12T12:17:45.683 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-12T12:17:45.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-12T12:17:45.685 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-12T12:17:45.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:45 smithi103 ceph-mon[35094]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2024-09-12T12:17:45.686 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-12T12:17:45.687 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-12T12:17:45.688 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-12T12:17:45.688 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-12T12:17:45.689 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-12T12:17:45.690 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-12T12:17:45.691 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-12T12:17:45.692 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-12T12:17:45.693 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-12T12:17:45.694 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-12T12:17:45.695 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-12T12:17:45.696 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-12T12:17:45.698 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-12T12:17:45.699 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/Makefile 2024-09-12T12:17:45.700 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-12T12:17:45.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-12T12:17:45.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-12T12:17:45.702 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-12T12:17:45.703 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-12T12:17:45.704 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-12T12:17:45.705 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-12T12:17:45.707 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-12T12:17:45.707 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-12T12:17:45.708 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-12T12:17:45.713 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-12T12:17:45.713 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-12T12:17:45.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-12T12:17:45.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-12T12:17:45.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-12T12:17:45.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-12T12:17:45.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-12T12:17:45.717 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-12T12:17:45.717 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-12T12:17:45.718 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-12T12:17:45.718 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-12T12:17:45.719 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-12T12:17:45.721 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-12T12:17:45.722 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-12T12:17:45.723 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-12T12:17:45.727 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-12T12:17:45.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-12T12:17:45.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-12T12:17:45.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-12T12:17:45.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-12T12:17:45.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-12T12:17:45.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-12T12:17:45.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-12T12:17:45.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-12T12:17:45.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-12T12:17:45.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-12T12:17:45.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-12T12:17:45.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-12T12:17:45.738 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-12T12:17:45.738 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-12T12:17:45.739 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-12T12:17:45.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-12T12:17:45.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-12T12:17:45.741 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-12T12:17:45.741 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-12T12:17:45.742 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-12T12:17:45.743 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-12T12:17:45.744 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-12T12:17:45.745 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-12T12:17:45.745 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-12T12:17:45.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-12T12:17:45.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-12T12:17:45.748 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-12T12:17:45.749 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-12T12:17:45.750 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-12T12:17:45.751 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-12T12:17:45.753 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-12T12:17:45.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-12T12:17:45.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-12T12:17:45.755 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-12T12:17:45.756 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-12T12:17:45.757 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-12T12:17:45.758 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-12T12:17:45.758 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-12T12:17:45.759 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-12T12:17:45.761 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/ 2024-09-12T12:17:45.762 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-12T12:17:45.763 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-12T12:17:45.764 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-12T12:17:45.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-12T12:17:45.766 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-12T12:17:45.766 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-12T12:17:45.768 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-12T12:17:45.768 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-12T12:17:45.769 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-12T12:17:45.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-12T12:17:45.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-12T12:17:45.774 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-12T12:17:45.775 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-12T12:17:45.776 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-12T12:17:45.777 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-12T12:17:45.777 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/README 2024-09-12T12:17:45.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-12T12:17:45.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-12T12:17:45.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-12T12:17:45.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-12T12:17:45.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-12T12:17:45.780 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-12T12:17:45.781 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-12T12:17:45.782 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-12T12:17:45.782 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-12T12:17:45.783 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-12T12:17:45.784 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-12T12:17:45.785 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-12T12:17:45.786 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-12T12:17:45.787 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-12T12:17:45.788 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-12T12:17:45.789 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-12T12:17:45.790 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-12T12:17:45.791 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-12T12:17:45.791 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-12T12:17:45.792 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-12T12:17:45.793 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-12T12:17:45.793 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-12T12:17:45.794 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-12T12:17:45.795 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-12T12:17:45.796 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-12T12:17:45.796 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-12T12:17:45.798 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-12T12:17:45.799 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-12T12:17:45.799 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-12T12:17:45.800 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-12T12:17:45.801 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-12T12:17:45.802 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-12T12:17:45.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-12T12:17:45.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-12T12:17:45.804 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-12T12:17:45.805 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-12T12:17:45.806 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-12T12:17:45.807 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-12T12:17:45.807 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-12T12:17:45.808 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-12T12:17:45.809 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-12T12:17:45.810 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-12T12:17:45.811 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-12T12:17:45.812 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-12T12:17:45.813 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-12T12:17:45.813 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-12T12:17:45.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-12T12:17:45.815 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-12T12:17:45.816 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-12T12:17:45.817 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-12T12:17:45.818 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-12T12:17:45.819 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-12T12:17:45.820 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-12T12:17:45.820 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-12T12:17:45.821 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-12T12:17:45.821 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-12T12:17:45.822 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-12T12:17:45.823 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-12T12:17:45.824 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-12T12:17:45.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-12T12:17:45.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-12T12:17:45.826 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-12T12:17:45.827 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-12T12:17:45.828 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-12T12:17:45.829 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-12T12:17:45.830 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-12T12:17:45.832 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-12T12:17:45.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-12T12:17:45.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-12T12:17:45.834 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-12T12:17:45.835 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-12T12:17:45.836 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-12T12:17:45.837 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-12T12:17:45.838 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-12T12:17:45.839 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-12T12:17:45.840 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-12T12:17:45.840 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-12T12:17:45.841 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-12T12:17:45.842 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-12T12:17:45.843 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-12T12:17:45.844 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-12T12:17:45.845 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-12T12:17:45.845 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-12T12:17:45.846 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-12T12:17:45.847 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-12T12:17:45.848 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-12T12:17:45.849 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-12T12:17:45.850 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-12T12:17:45.851 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-12T12:17:45.852 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-12T12:17:45.853 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-12T12:17:45.854 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-12T12:17:45.856 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-12T12:17:45.857 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-12T12:17:45.858 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-12T12:17:45.859 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-12T12:17:45.859 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-12T12:17:45.861 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-12T12:17:45.862 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-12T12:17:45.862 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/ 2024-09-12T12:17:45.863 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-12T12:17:45.864 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-12T12:17:45.865 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-12T12:17:45.866 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-12T12:17:45.867 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-12T12:17:45.868 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-12T12:17:45.869 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-12T12:17:45.870 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-12T12:17:45.871 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-12T12:17:45.872 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-12T12:17:45.873 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-12T12:17:45.873 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-12T12:17:45.874 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-12T12:17:45.875 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-12T12:17:45.875 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-12T12:17:45.876 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-12T12:17:45.877 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-12T12:17:45.878 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-12T12:17:45.879 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-12T12:17:45.880 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-12T12:17:45.881 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-12T12:17:45.882 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-12T12:17:45.882 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-12T12:17:45.883 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-12T12:17:45.885 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-12T12:17:45.885 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-12T12:17:45.886 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-12T12:17:45.887 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-12T12:17:45.888 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-12T12:17:45.890 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-12T12:17:45.891 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-12T12:17:45.892 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-12T12:17:45.892 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-12T12:17:45.893 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-12T12:17:45.894 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-12T12:17:45.895 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-12T12:17:45.896 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-12T12:17:45.897 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-12T12:17:45.898 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-12T12:17:45.899 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-12T12:17:45.900 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-12T12:17:45.901 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-12T12:17:45.902 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-12T12:17:45.903 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-12T12:17:45.904 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-12T12:17:45.905 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-12T12:17:45.906 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-12T12:17:45.907 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-12T12:17:45.908 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-12T12:17:45.909 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-12T12:17:45.910 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-12T12:17:45.911 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-12T12:17:45.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-12T12:17:45.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-12T12:17:45.913 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-12T12:17:45.914 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-12T12:17:45.915 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-12T12:17:45.916 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-12T12:17:45.917 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-12T12:17:45.918 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-12T12:17:45.919 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-12T12:17:45.920 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-12T12:17:45.921 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-12T12:17:45.922 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-12T12:17:45.923 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-12T12:17:45.924 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/connector/ 2024-09-12T12:17:45.925 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-12T12:17:45.926 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-12T12:17:45.927 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-12T12:17:45.928 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-12T12:17:45.928 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-12T12:17:45.929 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/console/ 2024-09-12T12:17:45.931 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-12T12:17:45.931 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-12T12:17:45.932 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-12T12:17:45.933 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-12T12:17:45.934 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-12T12:17:45.935 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-12T12:17:45.935 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-12T12:17:45.936 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-12T12:17:45.937 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-12T12:17:45.938 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-12T12:17:45.939 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-12T12:17:45.940 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-12T12:17:45.940 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-12T12:17:45.941 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-12T12:17:45.942 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-12T12:17:45.943 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-12T12:17:45.944 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-12T12:17:45.944 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-12T12:17:45.945 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-12T12:17:45.946 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-12T12:17:45.947 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-12T12:17:45.948 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-12T12:17:45.949 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cris/ 2024-09-12T12:17:45.949 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/cris/README 2024-09-12T12:17:45.950 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-12T12:17:45.951 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-12T12:17:45.952 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-12T12:17:45.953 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-12T12:17:45.954 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-12T12:17:45.955 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-12T12:17:45.955 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-12T12:17:45.956 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-12T12:17:45.957 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-12T12:17:45.958 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-12T12:17:45.960 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-12T12:17:45.961 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-12T12:17:45.962 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-12T12:17:45.963 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-12T12:17:45.964 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-12T12:17:45.964 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-12T12:17:45.965 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-12T12:17:45.966 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-12T12:17:45.968 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-12T12:17:45.969 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-12T12:17:45.969 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-12T12:17:45.970 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-12T12:17:45.971 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-12T12:17:45.972 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-12T12:17:45.977 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-12T12:17:45.977 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-12T12:17:45.978 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-12T12:17:45.978 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-12T12:17:45.978 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-12T12:17:45.979 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-12T12:17:45.979 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-12T12:17:45.980 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-12T12:17:45.980 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-12T12:17:45.981 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-12T12:17:45.982 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-12T12:17:45.984 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-12T12:17:45.985 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-12T12:17:45.985 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-12T12:17:45.986 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-12T12:17:45.987 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-12T12:17:45.988 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-12T12:17:45.989 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-12T12:17:45.990 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-12T12:17:45.992 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-12T12:17:45.993 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-12T12:17:45.993 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-12T12:17:45.994 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-12T12:17:45.995 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-12T12:17:45.996 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-12T12:17:45.997 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-12T12:17:45.998 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-12T12:17:45.999 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-12T12:17:46.000 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-12T12:17:46.001 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-12T12:17:46.001 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-12T12:17:46.002 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-12T12:17:46.003 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-12T12:17:46.004 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-12T12:17:46.005 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-12T12:17:46.006 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-12T12:17:46.007 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-12T12:17:46.009 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-12T12:17:46.009 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-12T12:17:46.011 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-12T12:17:46.011 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-12T12:17:46.012 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-12T12:17:46.013 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-12T12:17:46.014 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-12T12:17:46.015 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-12T12:17:46.015 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-12T12:17:46.016 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-12T12:17:46.017 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-12T12:17:46.018 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-12T12:17:46.019 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-12T12:17:46.020 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-12T12:17:46.021 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-12T12:17:46.022 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-12T12:17:46.023 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-12T12:17:46.024 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-12T12:17:46.025 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-12T12:17:46.026 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-12T12:17:46.027 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-12T12:17:46.028 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-12T12:17:46.029 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-12T12:17:46.030 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-12T12:17:46.031 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-12T12:17:46.032 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-12T12:17:46.032 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-12T12:17:46.033 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-12T12:17:46.034 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-12T12:17:46.035 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-12T12:17:46.035 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-12T12:17:46.036 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-12T12:17:46.037 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-12T12:17:46.038 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-12T12:17:46.039 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-12T12:17:46.040 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-12T12:17:46.040 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-12T12:17:46.042 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-12T12:17:46.042 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-12T12:17:46.043 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-12T12:17:46.044 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-12T12:17:46.045 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-12T12:17:46.046 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-12T12:17:46.047 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-12T12:17:46.049 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-12T12:17:46.049 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-12T12:17:46.050 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-12T12:17:46.051 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-12T12:17:46.051 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-12T12:17:46.052 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-12T12:17:46.053 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-12T12:17:46.054 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-12T12:17:46.055 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-12T12:17:46.056 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-12T12:17:46.057 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-12T12:17:46.058 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-12T12:17:46.059 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-12T12:17:46.060 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-12T12:17:46.061 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-12T12:17:46.062 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-12T12:17:46.063 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-12T12:17:46.064 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-12T12:17:46.065 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-12T12:17:46.066 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-12T12:17:46.067 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-12T12:17:46.068 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-12T12:17:46.069 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-12T12:17:46.069 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-12T12:17:46.070 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-12T12:17:46.071 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-12T12:17:46.072 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-12T12:17:46.073 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-12T12:17:46.074 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-12T12:17:46.075 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-12T12:17:46.076 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-12T12:17:46.077 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-12T12:17:46.078 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-12T12:17:46.079 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-12T12:17:46.080 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-12T12:17:46.081 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-12T12:17:46.082 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-12T12:17:46.083 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-12T12:17:46.083 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-12T12:17:46.084 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-12T12:17:46.085 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-12T12:17:46.086 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-12T12:17:46.087 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-12T12:17:46.088 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-12T12:17:46.089 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-12T12:17:46.090 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-12T12:17:46.091 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-12T12:17:46.092 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-12T12:17:46.093 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-12T12:17:46.094 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-12T12:17:46.095 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-12T12:17:46.096 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-12T12:17:46.097 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-12T12:17:46.098 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-12T12:17:46.098 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-12T12:17:46.099 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-12T12:17:46.100 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-12T12:17:46.101 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-12T12:17:46.102 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-12T12:17:46.103 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-12T12:17:46.104 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-12T12:17:46.104 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-12T12:17:46.105 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-12T12:17:46.106 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-12T12:17:46.107 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-12T12:17:46.108 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-12T12:17:46.109 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-12T12:17:46.110 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-12T12:17:46.112 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-12T12:17:46.113 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-12T12:17:46.113 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-12T12:17:46.115 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-12T12:17:46.116 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-12T12:17:46.117 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-12T12:17:46.117 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-12T12:17:46.119 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-12T12:17:46.120 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-12T12:17:46.120 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-12T12:17:46.121 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-12T12:17:46.122 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-12T12:17:46.123 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-12T12:17:46.124 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-12T12:17:46.125 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-12T12:17:46.126 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-12T12:17:46.127 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-12T12:17:46.128 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-12T12:17:46.129 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-12T12:17:46.130 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-12T12:17:46.130 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-12T12:17:46.131 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-12T12:17:46.132 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-12T12:17:46.132 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-12T12:17:46.133 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-12T12:17:46.134 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-12T12:17:46.135 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-12T12:17:46.136 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-12T12:17:46.136 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-12T12:17:46.315 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-12T12:17:46.316 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-12T12:17:46.318 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-12T12:17:46.319 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-12T12:17:46.320 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-12T12:17:46.322 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-12T12:17:46.323 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-12T12:17:46.324 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-12T12:17:46.326 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-12T12:17:46.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-12T12:17:46.329 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-12T12:17:46.330 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-12T12:17:46.331 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-12T12:17:46.333 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-12T12:17:46.334 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-12T12:17:46.336 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-12T12:17:46.337 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-12T12:17:46.338 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-12T12:17:46.340 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-12T12:17:46.341 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-12T12:17:46.342 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-12T12:17:46.344 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-12T12:17:46.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-12T12:17:46.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-12T12:17:46.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-12T12:17:46.349 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-12T12:17:46.351 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-12T12:17:46.352 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-12T12:17:46.353 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-12T12:17:46.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-12T12:17:46.356 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-12T12:17:46.357 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-12T12:17:46.359 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-12T12:17:46.360 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-12T12:17:46.362 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-12T12:17:46.363 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-12T12:17:46.364 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-12T12:17:46.366 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-12T12:17:46.367 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-12T12:17:46.368 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-12T12:17:46.370 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-12T12:17:46.371 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-12T12:17:46.373 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-12T12:17:46.374 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-12T12:17:46.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-12T12:17:46.376 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-12T12:17:46.377 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-12T12:17:46.378 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-12T12:17:46.379 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-12T12:17:46.380 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-12T12:17:46.381 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-12T12:17:46.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-12T12:17:46.383 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-12T12:17:46.383 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-12T12:17:46.384 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-12T12:17:46.385 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-12T12:17:46.386 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-12T12:17:46.387 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-12T12:17:46.388 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-12T12:17:46.389 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-12T12:17:46.390 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-12T12:17:46.391 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-12T12:17:46.391 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-12T12:17:46.392 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-12T12:17:46.393 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-12T12:17:46.394 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-12T12:17:46.395 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-12T12:17:46.396 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-12T12:17:46.396 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-12T12:17:46.397 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-12T12:17:46.398 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-12T12:17:46.399 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-12T12:17:46.400 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-12T12:17:46.401 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-12T12:17:46.401 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-12T12:17:46.402 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-12T12:17:46.403 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-12T12:17:46.404 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-12T12:17:46.405 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-12T12:17:46.405 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-12T12:17:46.406 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-12T12:17:46.407 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-12T12:17:46.408 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-12T12:17:46.409 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-12T12:17:46.410 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-12T12:17:46.411 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-12T12:17:46.412 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-12T12:17:46.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-12T12:17:46.414 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-12T12:17:46.415 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-12T12:17:46.416 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-12T12:17:46.417 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-12T12:17:46.418 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-12T12:17:46.418 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-12T12:17:46.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-12T12:17:46.420 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-12T12:17:46.421 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-12T12:17:46.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-12T12:17:46.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-12T12:17:46.423 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-12T12:17:46.424 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-12T12:17:46.425 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-12T12:17:46.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-12T12:17:46.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-12T12:17:46.427 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-12T12:17:46.428 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-12T12:17:46.429 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-12T12:17:46.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-12T12:17:46.431 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-12T12:17:46.432 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-12T12:17:46.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-12T12:17:46.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-12T12:17:46.434 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-12T12:17:46.435 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-12T12:17:46.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-12T12:17:46.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-12T12:17:46.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-12T12:17:46.438 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-12T12:17:46.439 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-12T12:17:46.440 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-12T12:17:46.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-12T12:17:46.442 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-12T12:17:46.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-12T12:17:46.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-12T12:17:46.444 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-12T12:17:46.445 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-12T12:17:46.446 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-12T12:17:46.447 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-12T12:17:46.447 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-12T12:17:46.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-12T12:17:46.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-12T12:17:46.450 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-12T12:17:46.451 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-12T12:17:46.452 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-12T12:17:46.453 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-12T12:17:46.454 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-12T12:17:46.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-12T12:17:46.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-12T12:17:46.456 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-12T12:17:46.457 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-12T12:17:46.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-12T12:17:46.459 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-12T12:17:46.460 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-12T12:17:46.461 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-12T12:17:46.462 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-12T12:17:46.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-12T12:17:46.464 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-12T12:17:46.465 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-12T12:17:46.466 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-12T12:17:46.467 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-12T12:17:46.468 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-12T12:17:46.468 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-12T12:17:46.469 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-12T12:17:46.470 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-12T12:17:46.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-12T12:17:46.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-12T12:17:46.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-12T12:17:46.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-12T12:17:46.474 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-12T12:17:46.475 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-12T12:17:46.476 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-12T12:17:46.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-12T12:17:46.478 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-12T12:17:46.479 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-12T12:17:46.480 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-12T12:17:46.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-12T12:17:46.482 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-12T12:17:46.483 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-12T12:17:46.484 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-12T12:17:46.485 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-12T12:17:46.486 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-12T12:17:46.487 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-12T12:17:46.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-12T12:17:46.489 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-12T12:17:46.490 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-12T12:17:46.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-12T12:17:46.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-12T12:17:46.492 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-12T12:17:46.493 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-12T12:17:46.494 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-12T12:17:46.495 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-12T12:17:46.496 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-12T12:17:46.497 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-12T12:17:46.498 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-12T12:17:46.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-12T12:17:46.500 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-12T12:17:46.501 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-12T12:17:46.502 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-12T12:17:46.503 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-12T12:17:46.503 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-12T12:17:46.504 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-12T12:17:46.505 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-12T12:17:46.506 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-12T12:17:46.507 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-12T12:17:46.508 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-12T12:17:46.509 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-12T12:17:46.510 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-12T12:17:46.511 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-12T12:17:46.512 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-12T12:17:46.513 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-12T12:17:46.514 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-12T12:17:46.514 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-12T12:17:46.515 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-12T12:17:46.516 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-12T12:17:46.517 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-12T12:17:46.519 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-12T12:17:46.519 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-12T12:17:46.519 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-12T12:17:46.520 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-12T12:17:46.521 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-12T12:17:46.522 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-12T12:17:46.523 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-12T12:17:46.524 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-12T12:17:46.524 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-12T12:17:46.525 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-12T12:17:46.526 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-12T12:17:46.527 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-12T12:17:46.528 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-12T12:17:46.529 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-12T12:17:46.530 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-12T12:17:46.531 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-12T12:17:46.532 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-12T12:17:46.533 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-12T12:17:46.534 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-12T12:17:46.534 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-12T12:17:46.535 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-12T12:17:46.536 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-12T12:17:46.537 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-12T12:17:46.538 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-12T12:17:46.539 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-12T12:17:46.540 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-12T12:17:46.540 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-12T12:17:46.541 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-12T12:17:46.542 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-12T12:17:46.543 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-12T12:17:46.544 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-12T12:17:46.545 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-12T12:17:46.546 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-12T12:17:46.547 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-12T12:17:46.548 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-12T12:17:46.548 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-12T12:17:46.549 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-12T12:17:46.550 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-12T12:17:46.551 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-12T12:17:46.552 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-12T12:17:46.553 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-12T12:17:46.554 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-12T12:17:46.554 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-12T12:17:46.555 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-12T12:17:46.556 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-12T12:17:46.557 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-12T12:17:46.558 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-12T12:17:46.559 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-12T12:17:46.560 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-12T12:17:46.560 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-12T12:17:46.561 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-12T12:17:46.562 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-12T12:17:46.563 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-12T12:17:46.563 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-12T12:17:46.564 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-12T12:17:46.565 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-12T12:17:46.566 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-12T12:17:46.567 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-12T12:17:46.568 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-12T12:17:46.569 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-12T12:17:46.569 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-12T12:17:46.570 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-12T12:17:46.571 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-12T12:17:46.572 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-12T12:17:46.573 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-12T12:17:46.574 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-12T12:17:46.575 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-12T12:17:46.576 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-12T12:17:46.577 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-12T12:17:46.577 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-12T12:17:46.578 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-12T12:17:46.579 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-12T12:17:46.580 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-12T12:17:46.581 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-12T12:17:46.582 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-12T12:17:46.583 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-12T12:17:46.583 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-12T12:17:46.584 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-12T12:17:46.588 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-12T12:17:46.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-12T12:17:46.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-12T12:17:46.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-12T12:17:46.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-12T12:17:46.590 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-12T12:17:46.591 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-12T12:17:46.592 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-12T12:17:46.592 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-12T12:17:46.594 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-12T12:17:46.594 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-12T12:17:46.595 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-12T12:17:46.596 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-12T12:17:46.597 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-12T12:17:46.598 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-12T12:17:46.599 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-12T12:17:46.599 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-12T12:17:46.600 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-12T12:17:46.601 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-12T12:17:46.602 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-12T12:17:46.603 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-12T12:17:46.604 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-12T12:17:46.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-12T12:17:46.606 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-12T12:17:46.607 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-12T12:17:46.608 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-12T12:17:46.608 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-12T12:17:46.609 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-12T12:17:46.610 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-12T12:17:46.611 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-12T12:17:46.612 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-12T12:17:46.612 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-12T12:17:46.613 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-12T12:17:46.614 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-12T12:17:46.615 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-12T12:17:46.616 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-12T12:17:46.617 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-12T12:17:46.617 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-12T12:17:46.618 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-12T12:17:46.619 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-12T12:17:46.620 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-12T12:17:46.620 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-12T12:17:46.621 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-12T12:17:46.622 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-12T12:17:46.623 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-12T12:17:46.624 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-12T12:17:46.624 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-12T12:17:46.626 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-12T12:17:46.626 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-12T12:17:46.627 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-12T12:17:46.628 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-12T12:17:46.629 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-12T12:17:46.629 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-12T12:17:46.630 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-12T12:17:46.631 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-12T12:17:46.632 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-12T12:17:46.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-12T12:17:46.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-12T12:17:46.634 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-12T12:17:46.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-12T12:17:46.636 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-12T12:17:46.637 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-12T12:17:46.637 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-12T12:17:46.638 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-12T12:17:46.639 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-12T12:17:46.640 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-12T12:17:46.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-12T12:17:46.642 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-12T12:17:46.643 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-12T12:17:46.643 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-12T12:17:46.644 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-12T12:17:46.645 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-12T12:17:46.646 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-12T12:17:46.647 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-12T12:17:46.647 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-12T12:17:46.648 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-12T12:17:46.649 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-12T12:17:46.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-12T12:17:46.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-12T12:17:46.651 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-12T12:17:46.652 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-12T12:17:46.653 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-12T12:17:46.654 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-12T12:17:46.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-12T12:17:46.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-12T12:17:46.656 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-12T12:17:46.657 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-12T12:17:46.658 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-12T12:17:46.659 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-12T12:17:46.660 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-12T12:17:46.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-12T12:17:46.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-12T12:17:46.662 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-12T12:17:46.663 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-12T12:17:46.663 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-12T12:17:46.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-12T12:17:46.665 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-12T12:17:46.666 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-12T12:17:46.666 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-12T12:17:46.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-12T12:17:46.668 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-12T12:17:46.669 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-12T12:17:46.669 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-12T12:17:46.670 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-12T12:17:46.671 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-12T12:17:46.672 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-12T12:17:46.672 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-12T12:17:46.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-12T12:17:46.674 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-12T12:17:46.675 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-12T12:17:46.675 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-12T12:17:46.676 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-12T12:17:46.677 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-12T12:17:46.678 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-12T12:17:46.678 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-12T12:17:46.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-12T12:17:46.680 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-12T12:17:46.681 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-12T12:17:46.681 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-12T12:17:46.682 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-12T12:17:46.683 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-12T12:17:46.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-12T12:17:46.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-12T12:17:46.685 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-12T12:17:46.686 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-12T12:17:46.687 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-12T12:17:46.687 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-12T12:17:46.688 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-12T12:17:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 -- 172.21.15.81:0/3226329996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa41009b0 msgr2=0x7f1fa4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/3226329996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa41009b0 0x7f1fa4100e10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009930 tx=0x7f1f9402a420 comp rx=0 tx=0).stop 2024-09-12T12:17:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 -- 172.21.15.81:0/3226329996 shutdown_connections 2024-09-12T12:17:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/3226329996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa4101350 0x7f1fa410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/3226329996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa41009b0 0x7f1fa4100e10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/3226329996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa41069c0 0x7f1fa4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 -- 172.21.15.81:0/3226329996 >> 172.21.15.81:0/3226329996 conn(0x7f1fa4077990 msgr2=0x7f1fa40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 -- 172.21.15.81:0/3226329996 shutdown_connections 2024-09-12T12:17:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 -- 172.21.15.81:0/3226329996 wait complete. 2024-09-12T12:17:46.690 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-12T12:17:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 Processor -- start 2024-09-12T12:17:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.689+0000 7f1fab3d8640 1 -- start start 2024-09-12T12:17:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa41009b0 0x7f1fa40fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 0x7f1fa40fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa41069c0 0x7f1fa40fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4110f20 con 0x7f1fa4101350 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4110da0 con 0x7f1fa41069c0 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41110a0 con 0x7f1fa41009b0 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 0x7f1fa40fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 0x7f1fa40fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37656/0 (socket says 172.21.15.81:37656) 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 -- 172.21.15.81:0/4203541223 learned_addr learned my addr 172.21.15.81:0/4203541223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa9975640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa41069c0 0x7f1fa40fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa9174640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa41009b0 0x7f1fa40fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.692 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-12T12:17:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 -- 172.21.15.81:0/4203541223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa41009b0 msgr2=0x7f1fa40fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa41009b0 0x7f1fa40fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 -- 172.21.15.81:0/4203541223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa41069c0 msgr2=0x7f1fa40fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa41069c0 0x7f1fa40fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 -- 172.21.15.81:0/4203541223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa41a68d0 con 0x7f1fa4101350 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fa8973640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 0x7f1fa40fd320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009230 tx=0x7f1f94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1f9a7fc640 1 -- 172.21.15.81:0/4203541223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9403f030 con 0x7f1fa4101350 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa41a6b60 con 0x7f1fa4101350 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1f9a7fc640 1 -- 172.21.15.81:0/4203541223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f94003af0 con 0x7f1fa4101350 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.690+0000 7f1f9a7fc640 1 -- 172.21.15.81:0/4203541223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94035070 con 0x7f1fa4101350 2024-09-12T12:17:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.691+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa41a7050 con 0x7f1fa4101350 2024-09-12T12:17:46.695 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-12T12:17:46.695 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-12T12:17:46.695 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-12T12:17:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1f9a7fc640 1 -- 172.21.15.81:0/4203541223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 138066+0+0 (secure 0 0 0) 0x7f1f94042030 con 0x7f1fa4101350 2024-09-12T12:17:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 Processor -- start 2024-09-12T12:17:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 -- start start 2024-09-12T12:17:46.696 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e7a442e2f0 con 0x55e7a44ca410 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e7a43d6270 con 0x55e7a44d4cb0 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1fae24b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e7a442a2b0 con 0x55e7a44c9af0 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.693+0000 7f1f9a7fc640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1f900a2ec0 0x7f1f900a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa9174640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa9174640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37666/0 (socket says 172.21.15.81:37666) 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa9174640 1 -- 172.21.15.81:0/1872412251 learned_addr learned my addr 172.21.15.81:0/1872412251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa9975640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1f900a2ec0 0x7f1f900a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa9975640 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1f9a7fc640 1 -- 172.21.15.81:0/4203541223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1f940efc80 con 0x7f1fa4101350 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 -- 172.21.15.81:0/1872412251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 msgr2=0x55e7a44c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 -- 172.21.15.81:0/1872412251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 msgr2=0x55e7a44d4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 -- 172.21.15.81:0/1872412251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7a43d5340 con 0x55e7a44d4cb0 2024-09-12T12:17:46.699 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-12T12:17:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa9975640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1f900a2ec0 0x7f1f900a5380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005fd0 tx=0x7f1f9c009de0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1fa8973640 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d70a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f940ed2c0 tx=0x7f1f94009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84cd32f6e4673284 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1f8f7fe640 1 -- 172.21.15.81:0/1872412251 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94049070 con 0x55e7a44d4cb0 2024-09-12T12:17:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1f8f7fe640 1 -- 172.21.15.81:0/1872412251 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f940bc140 con 0x55e7a44d4cb0 2024-09-12T12:17:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.694+0000 7f1f8f7fe640 1 -- 172.21.15.81:0/1872412251 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94003ca0 con 0x55e7a44d4cb0 2024-09-12T12:17:46.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 -- 172.21.15.81:0/1872412251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 msgr2=0x55e7a44d70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d70a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f940ed2c0 tx=0x7f1f94009260 comp rx=0 tx=0).stop 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 -- 172.21.15.81:0/1872412251 shutdown_connections 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d70a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1872412251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 -- 172.21.15.81:0/1872412251 >> 172.21.15.81:0/1872412251 conn(0x55e7a44c6060 msgr2=0x55e7a44c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 -- 172.21.15.81:0/1872412251 shutdown_connections 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 -- 172.21.15.81:0/1872412251 wait complete. 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.695+0000 7f1fae24b740 1 -- start start 2024-09-12T12:17:46.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 Processor -- start 2024-09-12T12:17:46.703 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-12T12:17:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e7a44d7640 con 0x55e7a44ca410 2024-09-12T12:17:46.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e7a43b7290 con 0x55e7a44d4cb0 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e7a44d77c0 con 0x55e7a44c9af0 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fae24b740 10 client.0 _ll_register_callbacks cb 0x55e7a43e8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37668/0 (socket says 172.21.15.81:37668) 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 -- 172.21.15.81:0/4052567684 learned_addr learned my addr 172.21.15.81:0/4052567684 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa9975640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa9174640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 -- 172.21.15.81:0/4052567684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 msgr2=0x55e7a44d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 -- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 msgr2=0x55e7a44d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 -- 172.21.15.81:0/4052567684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7a4141210 con 0x55e7a44ca410 2024-09-12T12:17:46.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa9174640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:17:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1fa8973640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d2120 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1f940eda40 tx=0x7f1f9403b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a8b70eee7346d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.696+0000 7f1f8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:46.706 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-12T12:17:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1f8cff9640 1 -- 172.21.15.81:0/4052567684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f940d4020 con 0x55e7a44ca410 2024-09-12T12:17:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1f8cff9640 1 -- 172.21.15.81:0/4052567684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1f940c0110 con 0x55e7a44ca410 2024-09-12T12:17:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f940bc140 con 0x55e7a44ca410 2024-09-12T12:17:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1f8cff9640 1 -- 172.21.15.81:0/4052567684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1f94049040 con 0x55e7a44ca410 2024-09-12T12:17:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 10 client.15597 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e7a420d620 con 0x55e7a44ca410 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1f8cff9640 1 -- 172.21.15.81:0/4052567684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f940bc140 con 0x55e7a44ca410 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1f8cff9640 1 -- 172.21.15.81:0/4052567684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1f94003ca0 con 0x55e7a44ca410 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 10 client.15597 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 20 client.15597 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a44e4780 0x55e7a44e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 4 client.15597 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:17:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7a443ba20 con 0x55e7a44e4780 2024-09-12T12:17:46.708 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-12T12:17:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.697+0000 7f1fa9174640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a44e4780 0x55e7a44e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.698+0000 7f1f8cff9640 10 client.15597 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:46.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.698+0000 7f1fa9174640 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a44e4780 0x55e7a44e6b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7b9c0168934d88 server_cookie=b776bc114a921af0 in_seq=0 out_seq=0 2024-09-12T12:17:46.709 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-12T12:17:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1f8cff9640 1 -- 172.21.15.81:0/4052567684 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7a443ba20 con 0x55e7a44e4780 2024-09-12T12:17:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1f8cff9640 10 client.15597 handle_command_reply: tid=0 2024-09-12T12:17:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 client.15597 shutdown 2024-09-12T12:17:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 msgr2=0x55e7a44d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d2120 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1f940eda40 tx=0x7f1f9403b460 comp rx=0 tx=0).stop 2024-09-12T12:17:46.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 shutdown_connections 2024-09-12T12:17:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a44e4780 0x55e7a44e6b70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44ca410 0x55e7a44d2120 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 --2- 172.21.15.81:0/4052567684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44c9af0 0x55e7a44d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1f8cff9640 0 client.15597 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:46.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 >> 172.21.15.81:0/4052567684 conn(0x55e7a44c6060 msgr2=0x55e7a44cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.711 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-12T12:17:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 shutdown_connections 2024-09-12T12:17:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 1 -- 172.21.15.81:0/4052567684 wait complete. 2024-09-12T12:17:46.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.699+0000 7f1fae24b740 20 client.15597 trim_cache size 0 max 16384 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-12T12:17:46.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-12T12:17:46.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-12T12:17:46.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-12T12:17:46.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-12T12:17:46.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 Processor -- start 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 -- start start 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44c9af0 0x55e7a44cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44ca410 0x55e7a44d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41af910 con 0x55e7a44d4cb0 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41b1450 con 0x55e7a44c9af0 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fae24b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41affe0 con 0x55e7a44ca410 2024-09-12T12:17:46.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9174640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44c9af0 0x55e7a44cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37676/0 (socket says 172.21.15.81:37676) 2024-09-12T12:17:46.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 -- 172.21.15.81:0/3309609518 learned_addr learned my addr 172.21.15.81:0/3309609518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:46.717 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 -- 172.21.15.81:0/3309609518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44ca410 msgr2=0x55e7a44d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44ca410 0x55e7a44d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 -- 172.21.15.81:0/3309609518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44c9af0 msgr2=0x55e7a44cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44c9af0 0x55e7a44cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 -- 172.21.15.81:0/3309609518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7a44c6cf0 con 0x55e7a44d4cb0 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.714+0000 7f1fa9975640 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d3b50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c012680 tx=0x7f1f9c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30f600a809add94 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1f8effd640 1 -- 172.21.15.81:0/3309609518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c004030 con 0x55e7a44d4cb0 2024-09-12T12:17:46.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1f8effd640 1 -- 172.21.15.81:0/3309609518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f9c0046d0 con 0x55e7a44d4cb0 2024-09-12T12:17:46.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1f8effd640 1 -- 172.21.15.81:0/3309609518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c02ade0 con 0x55e7a44d4cb0 2024-09-12T12:17:46.719 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 -- 172.21.15.81:0/3309609518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 msgr2=0x55e7a44d3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d3b50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c012680 tx=0x7f1f9c01f000 comp rx=0 tx=0).stop 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 -- 172.21.15.81:0/3309609518 shutdown_connections 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44d4cb0 0x55e7a44d3b50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44ca410 0x55e7a44d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 --2- 172.21.15.81:0/3309609518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44c9af0 0x55e7a44cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 -- 172.21.15.81:0/3309609518 >> 172.21.15.81:0/3309609518 conn(0x55e7a44c6060 msgr2=0x55e7a44d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 -- 172.21.15.81:0/3309609518 shutdown_connections 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 -- 172.21.15.81:0/3309609518 wait complete. 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.715+0000 7f1fae24b740 1 -- start start 2024-09-12T12:17:46.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 Processor -- start 2024-09-12T12:17:46.721 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 0x55e7a44dd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44ca410 0x55e7a44ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44d4cb0 0x55e7a44cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41b0d80 con 0x55e7a44c9af0 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41b06b0 con 0x55e7a44ca410 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa41ad8f0 con 0x55e7a44d4cb0 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fae24b740 10 client.0 _ll_register_callbacks cb 0x7f1fa00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 0x55e7a44dd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.722 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 0x55e7a44dd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37680/0 (socket says 172.21.15.81:37680) 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 -- 172.21.15.81:0/1882226642 learned_addr learned my addr 172.21.15.81:0/1882226642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa8973640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44ca410 0x55e7a44ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9975640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44d4cb0 0x55e7a44cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 -- 172.21.15.81:0/1882226642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44d4cb0 msgr2=0x55e7a44cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44d4cb0 0x55e7a44cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 -- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44ca410 msgr2=0x55e7a44ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44ca410 0x55e7a44ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:46.723 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 -- 172.21.15.81:0/1882226642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7a44cf800 con 0x55e7a44c9af0 2024-09-12T12:17:46.723 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1fa9174640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 0x55e7a44dd1e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e7a44e72e0 tx=0x7f1fa0010a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e1634586f6b18b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.716+0000 7f1f8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1f8cff9640 1 -- 172.21.15.81:0/1882226642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa001e980 con 0x55e7a44c9af0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1f8cff9640 1 -- 172.21.15.81:0/1882226642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1fa001eb20 con 0x55e7a44c9af0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f9c0046d0 con 0x55e7a44c9af0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1f8cff9640 1 -- 172.21.15.81:0/1882226642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1fa001ed20 con 0x55e7a44c9af0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 10 client.15603 fetch_fsmap learned FSMap version 27 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e7a454f490 con 0x55e7a44c9af0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1f8cff9640 1 -- 172.21.15.81:0/1882226642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f9c0046d0 con 0x55e7a44c9af0 2024-09-12T12:17:46.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1f8cff9640 1 -- 172.21.15.81:0/1882226642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f1fa002f020 con 0x55e7a44c9af0 2024-09-12T12:17:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 10 client.15603 fetch_fsmap finished waiting for FSMap version 27 2024-09-12T12:17:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 10 client.15603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:17:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 20 client.15603 populate_metadata read hostname 'smithi081' 2024-09-12T12:17:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a454fb60 0x55e7a4551f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:17:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 4 client.15603 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:17:46.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7a44d7580 con 0x55e7a454fb60 2024-09-12T12:17:46.726 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-12T12:17:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.717+0000 7f1fa8973640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a454fb60 0x55e7a4551f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:17:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.718+0000 7f1fa8973640 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a454fb60 0x55e7a4551f80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a2738a8215703e0 server_cookie=1802b0c9513e9107 in_seq=0 out_seq=0 2024-09-12T12:17:46.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:46.718+0000 7f1f8cff9640 10 client.15603 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-12T12:17:46.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-12T12:17:46.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-12T12:17:46.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-12T12:17:46.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-12T12:17:46.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-12T12:17:46.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-12T12:17:46.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-12T12:17:46.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-12T12:17:46.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-12T12:17:46.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-12T12:17:46.735 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-12T12:17:46.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-12T12:17:46.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-12T12:17:46.738 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-12T12:17:46.739 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-12T12:17:46.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-12T12:17:46.741 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-12T12:17:46.742 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-12T12:17:46.743 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-12T12:17:46.745 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-12T12:17:46.746 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-12T12:17:46.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-12T12:17:46.748 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-12T12:17:46.749 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-12T12:17:46.750 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-12T12:17:46.751 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-12T12:17:46.752 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-12T12:17:46.753 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-12T12:17:46.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-12T12:17:46.755 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-12T12:17:46.756 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-12T12:17:46.757 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-12T12:17:46.758 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-12T12:17:46.760 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-12T12:17:46.761 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-12T12:17:46.762 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-12T12:17:46.763 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-12T12:17:46.764 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-12T12:17:46.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-12T12:17:46.766 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-12T12:17:46.767 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-12T12:17:46.768 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-12T12:17:46.769 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-12T12:17:46.770 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-12T12:17:46.771 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-12T12:17:46.772 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-12T12:17:46.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-12T12:17:46.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-12T12:17:46.775 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-12T12:17:46.776 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-12T12:17:46.777 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-12T12:17:46.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-12T12:17:46.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-12T12:17:46.780 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-12T12:17:46.781 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-12T12:17:46.782 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-12T12:17:46.783 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-12T12:17:46.785 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-12T12:17:46.786 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-12T12:17:46.787 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-12T12:17:46.788 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-12T12:17:46.789 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-12T12:17:46.790 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-12T12:17:46.791 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-12T12:17:46.792 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-12T12:17:46.793 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-12T12:17:46.794 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-12T12:17:46.795 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-12T12:17:46.796 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-12T12:17:46.797 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-12T12:17:46.798 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-12T12:17:46.799 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-12T12:17:46.800 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-12T12:17:46.801 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-12T12:17:46.802 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-12T12:17:46.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-12T12:17:46.804 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-12T12:17:46.805 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-12T12:17:46.806 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-12T12:17:46.807 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-12T12:17:46.808 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-12T12:17:46.809 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-12T12:17:46.810 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-12T12:17:46.811 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-12T12:17:46.812 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-12T12:17:46.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-12T12:17:46.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-12T12:17:46.816 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-12T12:17:46.817 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-12T12:17:46.818 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-12T12:17:46.819 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-12T12:17:46.820 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-12T12:17:46.821 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-12T12:17:46.822 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-12T12:17:46.823 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-12T12:17:46.824 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-12T12:17:46.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-12T12:17:46.826 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-12T12:17:46.827 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-12T12:17:46.828 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-12T12:17:46.829 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-12T12:17:46.830 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-12T12:17:46.831 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-12T12:17:46.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-12T12:17:46.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-12T12:17:46.834 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-12T12:17:46.835 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-12T12:17:46.837 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-12T12:17:46.837 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-12T12:17:46.838 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-12T12:17:46.839 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-12T12:17:46.841 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-12T12:17:46.841 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-12T12:17:46.843 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-12T12:17:46.844 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-12T12:17:46.845 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-12T12:17:46.846 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-12T12:17:46.847 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-12T12:17:46.848 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-12T12:17:46.849 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-12T12:17:46.850 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-12T12:17:46.851 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-12T12:17:46.852 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-12T12:17:46.853 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-12T12:17:46.854 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-12T12:17:46.855 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-12T12:17:46.857 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-12T12:17:46.857 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-12T12:17:46.858 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-12T12:17:46.859 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-12T12:17:46.861 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-12T12:17:46.862 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-12T12:17:46.863 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-12T12:17:46.864 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-12T12:17:46.865 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-12T12:17:46.866 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-12T12:17:46.867 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-12T12:17:46.868 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-12T12:17:46.869 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-12T12:17:46.870 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-12T12:17:46.871 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-12T12:17:46.872 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-12T12:17:46.873 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-12T12:17:46.874 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-12T12:17:46.876 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-12T12:17:46.877 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-12T12:17:46.878 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-12T12:17:46.879 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-12T12:17:46.880 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-12T12:17:46.881 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-12T12:17:46.882 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-12T12:17:46.883 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-12T12:17:46.884 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-12T12:17:46.885 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-12T12:17:46.886 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-12T12:17:46.887 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-12T12:17:46.888 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-12T12:17:46.889 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-12T12:17:46.890 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-12T12:17:46.891 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-12T12:17:46.892 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-12T12:17:46.893 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-12T12:17:46.894 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-12T12:17:46.895 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-12T12:17:46.896 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-12T12:17:46.897 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-12T12:17:46.898 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-12T12:17:46.899 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-12T12:17:46.900 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-12T12:17:46.901 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-12T12:17:46.902 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-12T12:17:46.903 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-12T12:17:46.904 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-12T12:17:46.905 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-12T12:17:46.906 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-12T12:17:46.907 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-12T12:17:46.908 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-12T12:17:46.909 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-12T12:17:46.910 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-12T12:17:46.911 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-12T12:17:46.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-12T12:17:46.913 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-12T12:17:46.914 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-12T12:17:46.915 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-12T12:17:46.916 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-12T12:17:46.917 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-12T12:17:46.918 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-12T12:17:46.919 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-12T12:17:46.921 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-12T12:17:46.921 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-12T12:17:46.922 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-12T12:17:46.924 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-12T12:17:46.924 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-12T12:17:46.925 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-12T12:17:46.926 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-12T12:17:46.928 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-12T12:17:46.929 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-12T12:17:46.930 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-12T12:17:46.930 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-12T12:17:46.931 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-12T12:17:46.933 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-12T12:17:46.934 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-12T12:17:46.935 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-12T12:17:46.936 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-12T12:17:46.936 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-12T12:17:46.938 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-12T12:17:46.939 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-12T12:17:46.940 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-12T12:17:46.941 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-12T12:17:46.942 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-12T12:17:46.943 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-12T12:17:46.943 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-12T12:17:46.945 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-12T12:17:46.946 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-12T12:17:46.946 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-12T12:17:46.948 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-12T12:17:46.949 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-12T12:17:46.950 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-12T12:17:46.951 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-12T12:17:46.952 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-12T12:17:46.953 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-12T12:17:46.954 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-12T12:17:46.956 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-12T12:17:46.957 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-12T12:17:46.958 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-12T12:17:46.958 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-12T12:17:46.959 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-12T12:17:46.961 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-12T12:17:46.962 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-12T12:17:46.962 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-12T12:17:46.963 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-12T12:17:46.965 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-12T12:17:46.966 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-12T12:17:46.967 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-12T12:17:46.968 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-12T12:17:46.969 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-12T12:17:46.970 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-12T12:17:46.971 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-12T12:17:46.972 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-12T12:17:46.973 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-12T12:17:46.974 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-12T12:17:46.975 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-12T12:17:46.977 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-12T12:17:46.979 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-12T12:17:46.980 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-12T12:17:46.981 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-12T12:17:46.982 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-12T12:17:46.983 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-12T12:17:46.984 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-12T12:17:46.985 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-12T12:17:46.986 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-12T12:17:46.987 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-12T12:17:46.988 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-12T12:17:46.989 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-12T12:17:46.990 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-12T12:17:46.991 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-12T12:17:46.992 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-12T12:17:46.997 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-12T12:17:46.997 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-12T12:17:46.997 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-12T12:17:46.997 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-12T12:17:46.999 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-12T12:17:47.000 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-12T12:17:47.001 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-12T12:17:47.002 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-12T12:17:47.003 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-12T12:17:47.004 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-12T12:17:47.005 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-12T12:17:47.006 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-12T12:17:47.007 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-12T12:17:47.008 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-12T12:17:47.009 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-12T12:17:47.010 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-12T12:17:47.011 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-12T12:17:47.012 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-12T12:17:47.013 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-12T12:17:47.014 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-12T12:17:47.015 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-12T12:17:47.016 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-12T12:17:47.017 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-12T12:17:47.019 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-12T12:17:47.019 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-12T12:17:47.021 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-12T12:17:47.022 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-12T12:17:47.023 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-12T12:17:47.024 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-12T12:17:47.025 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-12T12:17:47.027 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-12T12:17:47.029 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-12T12:17:47.030 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-12T12:17:47.031 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-12T12:17:47.033 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-12T12:17:47.035 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-12T12:17:47.036 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-12T12:17:47.038 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-12T12:17:47.039 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-12T12:17:47.041 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-12T12:17:47.043 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-12T12:17:47.044 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-12T12:17:47.046 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-12T12:17:47.047 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-12T12:17:47.049 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-12T12:17:47.050 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-12T12:17:47.052 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-12T12:17:47.053 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-12T12:17:47.055 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-12T12:17:47.056 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-12T12:17:47.058 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-12T12:17:47.060 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-12T12:17:47.061 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-12T12:17:47.063 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-12T12:17:47.065 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-12T12:17:47.066 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-12T12:17:47.068 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-12T12:17:47.069 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-12T12:17:47.071 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-12T12:17:47.072 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-12T12:17:47.074 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-12T12:17:47.075 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-12T12:17:47.077 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-12T12:17:47.079 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-12T12:17:47.080 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-12T12:17:47.082 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-12T12:17:47.083 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-12T12:17:47.085 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-12T12:17:47.086 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-12T12:17:47.088 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-12T12:17:47.089 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-12T12:17:47.091 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-12T12:17:47.093 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-12T12:17:47.094 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-12T12:17:47.096 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-12T12:17:47.098 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-12T12:17:47.099 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-12T12:17:47.101 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-12T12:17:47.102 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-12T12:17:47.104 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-12T12:17:47.105 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-12T12:17:47.107 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-12T12:17:47.108 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-12T12:17:47.109 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-12T12:17:47.110 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-12T12:17:47.112 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-12T12:17:47.113 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-12T12:17:47.114 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-12T12:17:47.115 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-12T12:17:47.116 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-12T12:17:47.117 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-12T12:17:47.118 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-12T12:17:47.119 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-12T12:17:47.120 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-12T12:17:47.121 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-12T12:17:47.122 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-12T12:17:47.123 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-12T12:17:47.124 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-12T12:17:47.125 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-12T12:17:47.127 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-12T12:17:47.129 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-12T12:17:47.130 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-12T12:17:47.132 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-12T12:17:47.133 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-12T12:17:47.135 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-12T12:17:47.136 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-12T12:17:47.138 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-12T12:17:47.140 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-12T12:17:47.141 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-12T12:17:47.143 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-12T12:17:47.144 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-12T12:17:47.146 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-12T12:17:47.148 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-12T12:17:47.149 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-12T12:17:47.151 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-12T12:17:47.152 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-12T12:17:47.154 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-12T12:17:47.156 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-12T12:17:47.158 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-12T12:17:47.159 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-12T12:17:47.160 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-12T12:17:47.161 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-12T12:17:47.162 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-12T12:17:47.164 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-12T12:17:47.165 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-12T12:17:47.166 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-12T12:17:47.167 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-12T12:17:47.168 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-12T12:17:47.169 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-12T12:17:47.170 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-12T12:17:47.171 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-12T12:17:47.172 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-12T12:17:47.173 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-12T12:17:47.174 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-12T12:17:47.176 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-12T12:17:47.177 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-12T12:17:47.178 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-12T12:17:47.179 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-12T12:17:47.180 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-12T12:17:47.181 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-12T12:17:47.182 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-12T12:17:47.183 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-12T12:17:47.184 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-12T12:17:47.185 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-12T12:17:47.187 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-12T12:17:47.188 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-12T12:17:47.189 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-12T12:17:47.190 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-12T12:17:47.191 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-12T12:17:47.192 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-12T12:17:47.193 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-12T12:17:47.194 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-12T12:17:47.196 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-12T12:17:47.197 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-12T12:17:47.198 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-12T12:17:47.199 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-12T12:17:47.200 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-12T12:17:47.201 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-12T12:17:47.202 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-12T12:17:47.203 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-12T12:17:47.205 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-12T12:17:47.206 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-12T12:17:47.207 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-12T12:17:47.208 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-12T12:17:47.209 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-12T12:17:47.211 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-12T12:17:47.212 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-12T12:17:47.213 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-12T12:17:47.214 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-12T12:17:47.215 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-12T12:17:47.216 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-12T12:17:47.218 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-12T12:17:47.218 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-12T12:17:47.220 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-12T12:17:47.221 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-12T12:17:47.222 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-12T12:17:47.223 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-12T12:17:47.224 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-12T12:17:47.225 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-12T12:17:47.227 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-12T12:17:47.229 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-12T12:17:47.230 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-12T12:17:47.232 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-12T12:17:47.233 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-12T12:17:47.235 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-12T12:17:47.237 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-12T12:17:47.238 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-12T12:17:47.240 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-12T12:17:47.241 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-12T12:17:47.242 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-12T12:17:47.243 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-12T12:17:47.244 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-12T12:17:47.245 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-12T12:17:47.246 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-12T12:17:47.248 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-12T12:17:47.249 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-12T12:17:47.250 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-12T12:17:47.251 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-12T12:17:47.252 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-12T12:17:47.253 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-12T12:17:47.254 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-12T12:17:47.255 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-12T12:17:47.256 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-12T12:17:47.257 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-12T12:17:47.259 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-12T12:17:47.260 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-12T12:17:47.262 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-12T12:17:47.264 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-12T12:17:47.265 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-12T12:17:47.267 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-12T12:17:47.268 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-12T12:17:47.269 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-12T12:17:47.270 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-12T12:17:47.271 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-12T12:17:47.273 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-12T12:17:47.273 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-12T12:17:47.275 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-12T12:17:47.277 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-12T12:17:47.278 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-12T12:17:47.279 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-12T12:17:47.280 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-12T12:17:47.281 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-12T12:17:47.283 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-12T12:17:47.284 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-12T12:17:47.285 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-12T12:17:47.286 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-12T12:17:47.287 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-12T12:17:47.288 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-12T12:17:47.289 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-12T12:17:47.290 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-12T12:17:47.291 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-12T12:17:47.292 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-12T12:17:47.293 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-12T12:17:47.295 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-12T12:17:47.296 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-12T12:17:47.297 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-12T12:17:47.298 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-12T12:17:47.299 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-12T12:17:47.300 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-12T12:17:47.301 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-12T12:17:47.303 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-12T12:17:47.304 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-12T12:17:47.305 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-12T12:17:47.307 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-12T12:17:47.307 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-12T12:17:47.308 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-12T12:17:47.309 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-12T12:17:47.310 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-12T12:17:47.311 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-12T12:17:47.312 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-12T12:17:47.313 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-12T12:17:47.314 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-12T12:17:47.315 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-12T12:17:47.317 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-12T12:17:47.318 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-12T12:17:47.319 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-12T12:17:47.320 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-12T12:17:47.321 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-12T12:17:47.322 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-12T12:17:47.323 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-12T12:17:47.324 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-12T12:17:47.326 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-12T12:17:47.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-12T12:17:47.328 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-12T12:17:47.329 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-12T12:17:47.330 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-12T12:17:47.331 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-12T12:17:47.333 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-12T12:17:47.333 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-12T12:17:47.334 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-12T12:17:47.335 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-12T12:17:47.336 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-12T12:17:47.338 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-12T12:17:47.339 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-12T12:17:47.340 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-12T12:17:47.341 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-12T12:17:47.342 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-12T12:17:47.343 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-12T12:17:47.344 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-12T12:17:47.345 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-12T12:17:47.347 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-12T12:17:47.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-12T12:17:47.349 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-12T12:17:47.350 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-12T12:17:47.351 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-12T12:17:47.352 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-12T12:17:47.353 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-12T12:17:47.354 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-12T12:17:47.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-12T12:17:47.356 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-12T12:17:47.358 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-12T12:17:47.359 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-12T12:17:47.360 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-12T12:17:47.361 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-12T12:17:47.362 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-12T12:17:47.363 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-12T12:17:47.365 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-12T12:17:47.366 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-12T12:17:47.367 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-12T12:17:47.368 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-12T12:17:47.370 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-12T12:17:47.371 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-12T12:17:47.373 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-12T12:17:47.374 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-12T12:17:47.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-12T12:17:47.376 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-12T12:17:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-12T12:17:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-12T12:17:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-12T12:17:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-12T12:17:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-12T12:17:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-12T12:17:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-12T12:17:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-12T12:17:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-12T12:17:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-12T12:17:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-12T12:17:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-12T12:17:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-12T12:17:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-12T12:17:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-12T12:17:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-12T12:17:47.396 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-12T12:17:47.397 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-12T12:17:47.398 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-12T12:17:47.399 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-12T12:17:47.401 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-12T12:17:47.402 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-12T12:17:47.403 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-12T12:17:47.404 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-12T12:17:47.405 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-12T12:17:47.406 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-12T12:17:47.407 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-12T12:17:47.408 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-12T12:17:47.410 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-12T12:17:47.411 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-12T12:17:47.412 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-12T12:17:47.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-12T12:17:47.417 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-12T12:17:47.418 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-12T12:17:47.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-12T12:17:47.420 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-12T12:17:47.421 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-12T12:17:47.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-12T12:17:47.423 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-12T12:17:47.424 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-12T12:17:47.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-12T12:17:47.427 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-12T12:17:47.428 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-12T12:17:47.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-12T12:17:47.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-12T12:17:47.432 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-12T12:17:47.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-12T12:17:47.434 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-12T12:17:47.435 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-12T12:17:47.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-12T12:17:47.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-12T12:17:47.438 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-12T12:17:47.440 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-12T12:17:47.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-12T12:17:47.442 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-12T12:17:47.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-12T12:17:47.444 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-12T12:17:47.445 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-12T12:17:47.446 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-12T12:17:47.447 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-12T12:17:47.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-12T12:17:47.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-12T12:17:47.451 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-12T12:17:47.452 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-12T12:17:47.453 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-12T12:17:47.454 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-12T12:17:47.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-12T12:17:47.456 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-12T12:17:47.457 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-12T12:17:47.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-12T12:17:47.459 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-12T12:17:47.461 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-12T12:17:47.462 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-12T12:17:47.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-12T12:17:47.464 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-12T12:17:47.465 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-12T12:17:47.466 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-12T12:17:47.467 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-12T12:17:47.468 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-12T12:17:47.470 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-12T12:17:47.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-12T12:17:47.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-12T12:17:47.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-12T12:17:47.474 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-12T12:17:47.475 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-12T12:17:47.476 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-12T12:17:47.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-12T12:17:47.478 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-12T12:17:47.479 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-12T12:17:47.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-12T12:17:47.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-12T12:17:47.483 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-12T12:17:47.484 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-12T12:17:47.485 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-12T12:17:47.486 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-12T12:17:47.487 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-12T12:17:47.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-12T12:17:47.489 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-12T12:17:47.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-12T12:17:47.492 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-12T12:17:47.493 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-12T12:17:47.494 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-12T12:17:47.495 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-12T12:17:47.496 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-12T12:17:47.497 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-12T12:17:47.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-12T12:17:47.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-12T12:17:47.500 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-12T12:17:47.501 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-12T12:17:47.502 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-12T12:17:47.503 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-12T12:17:47.504 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-12T12:17:47.505 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-12T12:17:47.505 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-12T12:17:47.506 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-12T12:17:47.507 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-12T12:17:47.508 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-12T12:17:47.508 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-12T12:17:47.509 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-12T12:17:47.510 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-12T12:17:47.511 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-12T12:17:47.512 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-12T12:17:47.512 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-12T12:17:47.513 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-12T12:17:47.514 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-12T12:17:47.515 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-12T12:17:47.516 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-12T12:17:47.516 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-12T12:17:47.517 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-12T12:17:47.518 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-12T12:17:47.519 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-12T12:17:47.520 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-12T12:17:47.521 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-12T12:17:47.522 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-12T12:17:47.522 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-12T12:17:47.523 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-12T12:17:47.524 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-12T12:17:47.525 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-12T12:17:47.526 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-12T12:17:47.526 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-12T12:17:47.527 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-12T12:17:47.528 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-12T12:17:47.529 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-12T12:17:47.530 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-12T12:17:47.531 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-12T12:17:47.532 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-12T12:17:47.532 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-12T12:17:47.533 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-12T12:17:47.534 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-12T12:17:47.535 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-12T12:17:47.535 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-12T12:17:47.537 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-12T12:17:47.538 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-12T12:17:47.539 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-12T12:17:47.541 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-12T12:17:47.542 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-12T12:17:47.543 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-12T12:17:47.545 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-12T12:17:47.546 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-12T12:17:47.547 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-12T12:17:47.549 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-12T12:17:47.550 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-12T12:17:47.551 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-12T12:17:47.553 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-12T12:17:47.554 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-12T12:17:47.555 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-12T12:17:47.557 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-12T12:17:47.558 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-12T12:17:47.559 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-12T12:17:47.561 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-12T12:17:47.562 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-12T12:17:47.563 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-12T12:17:47.565 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-12T12:17:47.566 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-12T12:17:47.567 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-12T12:17:47.569 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-12T12:17:47.570 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-12T12:17:47.571 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-12T12:17:47.572 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-12T12:17:47.574 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-12T12:17:47.575 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-12T12:17:47.576 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-12T12:17:47.577 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-12T12:17:47.579 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-12T12:17:47.579 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-12T12:17:47.580 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-12T12:17:47.581 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-12T12:17:47.582 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-12T12:17:47.583 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-12T12:17:47.584 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-12T12:17:47.585 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-12T12:17:47.585 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-12T12:17:47.586 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-12T12:17:47.587 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-12T12:17:47.588 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-12T12:17:47.588 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-12T12:17:47.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-12T12:17:47.590 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-12T12:17:47.591 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-12T12:17:47.592 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-12T12:17:47.593 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-12T12:17:47.593 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-12T12:17:47.594 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-12T12:17:47.595 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-12T12:17:47.596 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-12T12:17:47.597 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-12T12:17:47.597 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-12T12:17:47.598 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-12T12:17:47.599 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-12T12:17:47.600 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-12T12:17:47.600 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-12T12:17:47.601 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-12T12:17:47.602 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-12T12:17:47.603 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-12T12:17:47.604 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-12T12:17:47.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-12T12:17:47.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-12T12:17:47.606 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-12T12:17:47.607 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-12T12:17:47.608 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-12T12:17:47.609 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-12T12:17:47.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:47 smithi081 ceph-mon[30948]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-12T12:17:47.609 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-12T12:17:47.610 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-12T12:17:47.611 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-12T12:17:47.612 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-12T12:17:47.612 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-12T12:17:47.613 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-12T12:17:47.614 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-12T12:17:47.615 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-12T12:17:47.616 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-12T12:17:47.617 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-12T12:17:47.617 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-12T12:17:47.618 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-12T12:17:47.619 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-12T12:17:47.620 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-12T12:17:47.621 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-12T12:17:47.622 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-12T12:17:47.623 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-12T12:17:47.624 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-12T12:17:47.625 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-12T12:17:47.625 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-12T12:17:47.626 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-12T12:17:47.627 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-12T12:17:47.628 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-12T12:17:47.628 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-12T12:17:47.629 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-12T12:17:47.630 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-12T12:17:47.631 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-12T12:17:47.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-12T12:17:47.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-12T12:17:47.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-12T12:17:47.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-12T12:17:47.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-12T12:17:47.636 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-12T12:17:47.636 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-12T12:17:47.637 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-12T12:17:47.638 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-12T12:17:47.639 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-12T12:17:47.640 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-12T12:17:47.640 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-12T12:17:47.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-12T12:17:47.642 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-12T12:17:47.643 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-12T12:17:47.644 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-12T12:17:47.645 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-12T12:17:47.646 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-12T12:17:47.646 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-12T12:17:47.647 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-12T12:17:47.648 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-12T12:17:47.649 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-12T12:17:47.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-12T12:17:47.651 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-12T12:17:47.651 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-12T12:17:47.652 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-12T12:17:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:47 smithi173 ceph-mon[35326]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-12T12:17:47.653 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-12T12:17:47.654 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-12T12:17:47.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-12T12:17:47.656 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-12T12:17:47.657 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-12T12:17:47.657 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-12T12:17:47.658 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-12T12:17:47.659 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-12T12:17:47.660 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-12T12:17:47.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-12T12:17:47.662 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-12T12:17:47.662 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-12T12:17:47.663 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-12T12:17:47.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-12T12:17:47.665 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-12T12:17:47.666 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-12T12:17:47.666 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-12T12:17:47.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-12T12:17:47.668 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-12T12:17:47.669 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-12T12:17:47.670 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-12T12:17:47.671 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-12T12:17:47.672 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-12T12:17:47.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-12T12:17:47.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-12T12:17:47.674 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-12T12:17:47.675 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-12T12:17:47.676 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-12T12:17:47.677 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-12T12:17:47.678 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-12T12:17:47.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-12T12:17:47.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-12T12:17:47.680 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-12T12:17:47.681 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-12T12:17:47.682 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-12T12:17:47.683 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-12T12:17:47.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-12T12:17:47.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-12T12:17:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:47 smithi103 ceph-mon[35094]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-12T12:17:47.685 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-12T12:17:47.686 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-12T12:17:47.687 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-12T12:17:47.688 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-12T12:17:47.689 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-12T12:17:47.690 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-12T12:17:47.691 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-12T12:17:47.691 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-12T12:17:47.693 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-12T12:17:47.693 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-12T12:17:47.694 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-12T12:17:47.696 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-12T12:17:47.696 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-12T12:17:47.697 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-12T12:17:47.698 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-12T12:17:47.699 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-12T12:17:47.700 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-12T12:17:47.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-12T12:17:47.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-12T12:17:47.702 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-12T12:17:47.703 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-12T12:17:47.703 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-12T12:17:47.704 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-12T12:17:47.705 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-12T12:17:47.706 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-12T12:17:47.707 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-12T12:17:47.708 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-12T12:17:47.709 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-12T12:17:47.709 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-12T12:17:47.710 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-12T12:17:47.711 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-12T12:17:47.712 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-12T12:17:47.713 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-12T12:17:47.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-12T12:17:47.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-12T12:17:47.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-12T12:17:47.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-12T12:17:47.717 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-12T12:17:47.718 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-12T12:17:47.719 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-12T12:17:47.720 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-12T12:17:47.721 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-12T12:17:47.722 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-12T12:17:47.722 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-12T12:17:47.724 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-12T12:17:47.724 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-12T12:17:47.725 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-12T12:17:47.726 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-12T12:17:47.727 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-12T12:17:47.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-12T12:17:47.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-12T12:17:47.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-12T12:17:47.730 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-12T12:17:47.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-12T12:17:47.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-12T12:17:47.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-12T12:17:47.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-12T12:17:47.734 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-12T12:17:47.735 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-12T12:17:47.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-12T12:17:47.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-12T12:17:47.738 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-12T12:17:47.739 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-12T12:17:47.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-12T12:17:47.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-12T12:17:47.741 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-12T12:17:47.742 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-12T12:17:47.743 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-12T12:17:47.744 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-12T12:17:47.745 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-12T12:17:47.746 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-12T12:17:47.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-12T12:17:47.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-12T12:17:47.748 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-12T12:17:47.749 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-12T12:17:47.750 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-12T12:17:47.751 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-12T12:17:47.752 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-12T12:17:47.753 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-12T12:17:47.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-12T12:17:47.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-12T12:17:47.755 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-12T12:17:47.756 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-12T12:17:47.757 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-12T12:17:47.758 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-12T12:17:47.759 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-12T12:17:47.759 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-12T12:17:47.760 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-12T12:17:47.761 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-12T12:17:47.762 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-12T12:17:47.763 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-12T12:17:47.764 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-12T12:17:47.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-12T12:17:47.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-12T12:17:47.766 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-12T12:17:47.767 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-12T12:17:47.768 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-12T12:17:47.769 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-12T12:17:47.770 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-12T12:17:47.771 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-12T12:17:47.772 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-12T12:17:47.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-12T12:17:47.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-12T12:17:47.774 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-12T12:17:47.775 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-12T12:17:47.776 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-12T12:17:47.777 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-12T12:17:47.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-12T12:17:47.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-12T12:17:47.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-12T12:17:47.780 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-12T12:17:47.781 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-12T12:17:47.782 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-12T12:17:47.783 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-12T12:17:47.784 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-12T12:17:47.785 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-12T12:17:47.786 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-12T12:17:47.787 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-12T12:17:47.788 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-12T12:17:47.788 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-12T12:17:47.789 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-12T12:17:47.790 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-12T12:17:47.791 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-12T12:17:47.792 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-12T12:17:47.793 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-12T12:17:47.794 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-12T12:17:47.794 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-12T12:17:47.795 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-12T12:17:47.796 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-12T12:17:47.797 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-12T12:17:47.798 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-12T12:17:47.799 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-12T12:17:47.800 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-12T12:17:47.801 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-12T12:17:47.801 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-12T12:17:47.802 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-12T12:17:47.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-12T12:17:47.804 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-12T12:17:47.805 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-12T12:17:47.806 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-12T12:17:47.807 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-12T12:17:47.808 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-12T12:17:47.808 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-12T12:17:47.810 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-12T12:17:47.810 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-12T12:17:47.811 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-12T12:17:47.812 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-12T12:17:47.813 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-12T12:17:47.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-12T12:17:47.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-12T12:17:47.815 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-12T12:17:47.816 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-12T12:17:47.817 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-12T12:17:47.818 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-12T12:17:47.818 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-12T12:17:47.819 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-12T12:17:47.820 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-12T12:17:47.821 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-12T12:17:47.822 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-12T12:17:47.823 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-12T12:17:47.824 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-12T12:17:47.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-12T12:17:47.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-12T12:17:47.826 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-12T12:17:47.827 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-12T12:17:47.828 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-12T12:17:47.829 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-12T12:17:47.830 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-12T12:17:47.831 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-12T12:17:47.831 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-12T12:17:47.832 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-12T12:17:47.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-12T12:17:47.834 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-12T12:17:47.835 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-12T12:17:47.836 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-12T12:17:48.192 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-12T12:17:48.252 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-12T12:17:48.255 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-12T12:17:48.275 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-12T12:17:48.285 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-12T12:17:48.291 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-12T12:17:48.301 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-12T12:17:48.304 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-12T12:17:48.313 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-12T12:17:48.315 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-12T12:17:48.319 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-12T12:17:48.326 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-12T12:17:48.330 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-12T12:17:48.334 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-12T12:17:48.339 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-12T12:17:48.342 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-12T12:17:48.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-12T12:17:48.350 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-12T12:17:48.352 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-12T12:17:48.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-12T12:17:48.363 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-12T12:17:48.364 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-12T12:17:48.367 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-12T12:17:48.373 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-12T12:17:48.377 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-12T12:17:48.386 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-12T12:17:48.392 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-12T12:17:48.399 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-12T12:17:48.404 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-12T12:17:48.410 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-12T12:17:48.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-12T12:17:48.417 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-12T12:17:48.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-12T12:17:48.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-12T12:17:48.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-12T12:17:48.429 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-12T12:17:48.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-12T12:17:48.431 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-12T12:17:48.432 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-12T12:17:48.435 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-12T12:17:48.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-12T12:17:48.438 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-12T12:17:48.440 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-12T12:17:48.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-12T12:17:48.442 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-12T12:17:48.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-12T12:17:48.444 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-12T12:17:48.446 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-12T12:17:48.454 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-12T12:17:48.460 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-12T12:17:48.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-12T12:17:48.464 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-12T12:17:48.465 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-12T12:17:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1f8cff9640 1 -- 172.21.15.81:0/1882226642 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7a44d7580 con 0x55e7a454fb60 2024-09-12T12:17:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1f8cff9640 10 client.15603 handle_command_reply: tid=0 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 client.15603 shutdown 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 msgr2=0x55e7a44dd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 0x55e7a44dd1e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e7a44e72e0 tx=0x7f1fa0010a20 comp rx=0 tx=0).stop 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 shutdown_connections 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e7a454fb60 0x55e7a4551f80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e7a44d4cb0 0x55e7a44cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e7a44ca410 0x55e7a44ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 --2- 172.21.15.81:0/1882226642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e7a44c9af0 0x55e7a44dd1e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1f8cff9640 0 client.15603 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 >> 172.21.15.81:0/1882226642 conn(0x55e7a44c6060 msgr2=0x55e7a44d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 shutdown_connections 2024-09-12T12:17:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 1 -- 172.21.15.81:0/1882226642 wait complete. 2024-09-12T12:17:48.468 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-12T12:17:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.466+0000 7f1fae24b740 20 client.15603 trim_cache size 0 max 16384 2024-09-12T12:17:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:17:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:17:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:17:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1f900a2ec0 msgr2=0x7f1f900a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1f900a2ec0 0x7f1f900a5380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c005fd0 tx=0x7f1f9c009de0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 msgr2=0x7f1fa40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 0x7f1fa40fd320 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009230 tx=0x7f1f94004270 comp rx=0 tx=0).stop 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 shutdown_connections 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1f900a2ec0 0x7f1f900a5380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa41069c0 0x7f1fa40fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4101350 0x7f1fa40fd320 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 --2- 172.21.15.81:0/4203541223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1fa41009b0 0x7f1fa40fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 >> 172.21.15.81:0/4203541223 conn(0x7f1fa4077990 msgr2=0x7f1fa40699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 shutdown_connections 2024-09-12T12:17:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:17:48.467+0000 7f1fab3d8640 1 -- 172.21.15.81:0/4203541223 wait complete. 2024-09-12T12:17:48.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-12T12:17:48.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-12T12:17:48.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-12T12:17:48.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-12T12:17:48.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-12T12:17:48.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-12T12:17:48.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-12T12:17:48.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-12T12:17:48.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-12T12:17:48.474 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-12T12:17:48.475 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-12T12:17:48.476 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-12T12:17:48.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-12T12:17:48.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-12T12:17:48.479 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-12T12:17:48.479 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-12T12:17:48.480 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-12T12:17:48.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-12T12:17:48.482 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-12T12:17:48.482 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-12T12:17:48.483 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-12T12:17:48.484 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-12T12:17:48.485 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-12T12:17:48.485 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-12T12:17:48.486 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-12T12:17:48.487 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-12T12:17:48.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-12T12:17:48.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-12T12:17:48.489 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-12T12:17:48.490 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-12T12:17:48.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-12T12:17:48.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-12T12:17:48.492 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-12T12:17:48.493 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-12T12:17:48.494 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-12T12:17:48.495 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-12T12:17:48.495 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-12T12:17:48.496 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-12T12:17:48.497 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-12T12:17:48.498 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-12T12:17:48.498 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-12T12:17:48.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-12T12:17:48.500 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-12T12:17:48.501 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-12T12:17:48.502 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-12T12:17:48.502 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-12T12:17:48.503 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-12T12:17:48.504 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-12T12:17:48.505 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-12T12:17:48.506 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-12T12:17:48.506 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-12T12:17:48.507 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-12T12:17:48.508 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-12T12:17:48.509 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-12T12:17:48.510 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-12T12:17:48.510 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-12T12:17:48.511 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-12T12:17:48.512 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-12T12:17:48.513 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-12T12:17:48.514 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-12T12:17:48.515 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-12T12:17:48.515 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-12T12:17:48.516 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-12T12:17:48.517 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-12T12:17:48.518 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-12T12:17:48.518 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/ 2024-09-12T12:17:48.519 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-12T12:17:48.520 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-12T12:17:48.521 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-12T12:17:48.521 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-12T12:17:48.522 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-12T12:17:48.523 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-12T12:17:48.524 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-12T12:17:48.525 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-12T12:17:48.526 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-12T12:17:48.526 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-12T12:17:48.527 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-12T12:17:48.528 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-12T12:17:48.529 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-12T12:17:48.529 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-12T12:17:48.530 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-12T12:17:48.531 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-12T12:17:48.532 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-12T12:17:48.532 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-12T12:17:48.533 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-12T12:17:48.534 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-12T12:17:48.534 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-12T12:17:48.535 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-12T12:17:48.536 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-12T12:17:48.537 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-12T12:17:48.537 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-12T12:17:48.538 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-12T12:17:48.539 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-12T12:17:48.540 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-12T12:17:48.541 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-12T12:17:48.541 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-12T12:17:48.542 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-12T12:17:48.543 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-12T12:17:48.544 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-12T12:17:48.544 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-12T12:17:48.545 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-12T12:17:48.546 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-12T12:17:48.547 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-12T12:17:48.547 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-12T12:17:48.548 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-12T12:17:48.549 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-12T12:17:48.550 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-12T12:17:48.550 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-12T12:17:48.551 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-12T12:17:48.552 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-12T12:17:48.553 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-12T12:17:48.553 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-12T12:17:48.554 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-12T12:17:48.555 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-12T12:17:48.556 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-12T12:17:48.556 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-12T12:17:48.557 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-12T12:17:48.558 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-12T12:17:48.559 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-12T12:17:48.559 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-12T12:17:48.560 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-12T12:17:48.561 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-12T12:17:48.562 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-12T12:17:48.562 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-12T12:17:48.563 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-12T12:17:48.564 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-12T12:17:48.565 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-12T12:17:48.565 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-12T12:17:48.566 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-12T12:17:48.567 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-12T12:17:48.568 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-12T12:17:48.568 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-12T12:17:48.569 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-12T12:17:48.570 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-12T12:17:48.571 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-12T12:17:48.571 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-12T12:17:48.572 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-12T12:17:48.573 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-12T12:17:48.574 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-12T12:17:48.574 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-12T12:17:48.575 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-12T12:17:48.576 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-12T12:17:48.577 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-12T12:17:48.578 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-12T12:17:48.578 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-12T12:17:48.579 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-12T12:17:48.580 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-12T12:17:48.580 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-12T12:17:48.581 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-12T12:17:48.582 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-12T12:17:48.583 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-12T12:17:48.583 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-12T12:17:48.584 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-12T12:17:48.585 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-12T12:17:48.586 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-12T12:17:48.587 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-12T12:17:48.587 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-12T12:17:48.588 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-12T12:17:48.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-12T12:17:48.590 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-12T12:17:48.590 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-12T12:17:48.591 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-12T12:17:48.592 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-12T12:17:48.593 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-12T12:17:48.593 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-12T12:17:48.594 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-12T12:17:48.595 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-12T12:17:48.596 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-12T12:17:48.597 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-12T12:17:48.597 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-12T12:17:48.598 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-12T12:17:48.599 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-12T12:17:48.600 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-12T12:17:48.600 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-12T12:17:48.601 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-12T12:17:48.602 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-12T12:17:48.602 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-12T12:17:48.603 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-12T12:17:48.604 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-12T12:17:48.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-12T12:17:48.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-12T12:17:48.606 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-12T12:17:48.607 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-12T12:17:48.608 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-12T12:17:48.608 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-12T12:17:48.609 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-12T12:17:48.610 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-12T12:17:48.611 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-12T12:17:48.611 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-12T12:17:48.612 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-12T12:17:48.613 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-12T12:17:48.614 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-12T12:17:48.614 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-12T12:17:48.615 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-12T12:17:48.616 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-12T12:17:48.617 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-12T12:17:48.618 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-12T12:17:48.619 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-12T12:17:48.619 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-12T12:17:48.620 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-12T12:17:48.621 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-12T12:17:48.622 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-12T12:17:48.623 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-12T12:17:48.623 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-12T12:17:48.624 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-12T12:17:48.625 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-12T12:17:48.626 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-12T12:17:48.627 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-12T12:17:48.627 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-12T12:17:48.628 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-12T12:17:48.629 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-12T12:17:48.630 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-12T12:17:48.631 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-12T12:17:48.631 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-12T12:17:48.632 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-12T12:17:48.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-12T12:17:48.634 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-12T12:17:48.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-12T12:17:48.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-12T12:17:48.636 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-12T12:17:48.637 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-12T12:17:48.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-12T12:17:48.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-12T12:17:48.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-12T12:17:48.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-12T12:17:48.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-12T12:17:48.642 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-12T12:17:48.643 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-12T12:17:48.643 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-12T12:17:48.644 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-12T12:17:48.645 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-12T12:17:48.646 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-12T12:17:48.646 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-12T12:17:48.647 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/ 2024-09-12T12:17:48.648 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-12T12:17:48.649 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-12T12:17:48.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-12T12:17:48.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-12T12:17:48.651 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-12T12:17:48.652 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-12T12:17:48.653 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-12T12:17:48.653 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-12T12:17:48.654 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-12T12:17:48.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-12T12:17:48.656 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-12T12:17:48.657 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-12T12:17:48.657 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-12T12:17:48.658 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-12T12:17:48.659 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-12T12:17:48.660 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-12T12:17:48.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-12T12:17:48.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-12T12:17:48.662 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-12T12:17:48.663 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-12T12:17:48.663 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-12T12:17:48.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hid/ 2024-09-12T12:17:48.665 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-12T12:17:48.666 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-12T12:17:48.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-12T12:17:48.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-12T12:17:48.668 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-12T12:17:48.669 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-12T12:17:48.670 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-12T12:17:48.671 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-12T12:17:48.672 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-12T12:17:48.672 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-12T12:17:48.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-12T12:17:48.674 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-12T12:17:48.675 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-12T12:17:48.675 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-12T12:17:48.676 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-12T12:17:48.677 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-12T12:17:48.678 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-12T12:17:48.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-12T12:17:48.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-12T12:17:48.680 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-12T12:17:48.681 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-12T12:17:48.682 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-12T12:17:48.683 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-12T12:17:48.683 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-12T12:17:48.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-12T12:17:48.685 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-12T12:17:48.686 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-12T12:17:48.686 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-12T12:17:48.687 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-12T12:17:48.688 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-12T12:17:48.689 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-12T12:17:48.690 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-12T12:17:48.691 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-12T12:17:48.691 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-12T12:17:48.692 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-12T12:17:48.693 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-12T12:17:48.694 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-12T12:17:48.694 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-12T12:17:48.695 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-12T12:17:48.696 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-12T12:17:48.697 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-12T12:17:48.698 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-12T12:17:48.699 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-12T12:17:48.699 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-12T12:17:48.700 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-12T12:17:48.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-12T12:17:48.702 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-12T12:17:48.702 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-12T12:17:48.703 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-12T12:17:48.704 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-12T12:17:48.705 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-12T12:17:48.706 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-12T12:17:48.706 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-12T12:17:48.707 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-12T12:17:48.708 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-12T12:17:48.709 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-12T12:17:48.710 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-12T12:17:48.710 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-12T12:17:48.711 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-12T12:17:48.712 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-12T12:17:48.713 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-12T12:17:48.714 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-12T12:17:48.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-12T12:17:48.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-12T12:17:48.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-12T12:17:48.717 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-12T12:17:48.718 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-12T12:17:48.718 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-12T12:17:48.719 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-12T12:17:48.720 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-12T12:17:48.721 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-12T12:17:48.722 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-12T12:17:48.722 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-12T12:17:48.723 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-12T12:17:48.724 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-12T12:17:48.725 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-12T12:17:48.726 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-12T12:17:48.726 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-12T12:17:48.727 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-12T12:17:48.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-12T12:17:48.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-12T12:17:48.730 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-12T12:17:48.731 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-12T12:17:48.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-12T12:17:48.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-12T12:17:48.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-12T12:17:48.734 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-12T12:17:48.735 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-12T12:17:48.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-12T12:17:48.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-12T12:17:48.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-12T12:17:48.738 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-12T12:17:48.739 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-12T12:17:48.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-12T12:17:48.740 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-12T12:17:48.741 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-12T12:17:48.742 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-12T12:17:48.743 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-12T12:17:48.744 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-12T12:17:48.744 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-12T12:17:48.745 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-12T12:17:48.746 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-12T12:17:48.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-12T12:17:48.748 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-12T12:17:48.749 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-12T12:17:48.749 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-12T12:17:48.750 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-12T12:17:48.751 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-12T12:17:48.752 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-12T12:17:48.752 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-12T12:17:48.753 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-12T12:17:48.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-12T12:17:48.755 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-12T12:17:48.756 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-12T12:17:48.756 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-12T12:17:48.757 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-12T12:17:48.758 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-12T12:17:48.759 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-12T12:17:48.760 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-12T12:17:48.761 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-12T12:17:48.761 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-12T12:17:48.762 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-12T12:17:48.763 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-12T12:17:48.764 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-12T12:17:48.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-12T12:17:48.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-12T12:17:48.766 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-12T12:17:48.767 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-12T12:17:48.768 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-12T12:17:48.769 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-12T12:17:48.770 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-12T12:17:48.770 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-12T12:17:48.771 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-12T12:17:48.772 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-12T12:17:48.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-12T12:17:48.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-12T12:17:48.774 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-12T12:17:48.775 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-12T12:17:48.776 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-12T12:17:48.777 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-12T12:17:48.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-12T12:17:48.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-12T12:17:48.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-12T12:17:48.780 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-12T12:17:48.781 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-12T12:17:48.781 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-12T12:17:48.782 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-12T12:17:48.783 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-12T12:17:48.784 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-12T12:17:48.785 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-12T12:17:48.785 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-12T12:17:48.786 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-12T12:17:48.787 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-12T12:17:48.788 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-12T12:17:48.789 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-12T12:17:48.789 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-12T12:17:48.790 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-12T12:17:48.791 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-12T12:17:48.792 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-12T12:17:48.792 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-12T12:17:48.793 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-12T12:17:48.794 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-12T12:17:48.795 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-12T12:17:48.796 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-12T12:17:48.796 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-12T12:17:48.797 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-12T12:17:48.798 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-12T12:17:48.799 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-12T12:17:48.799 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-12T12:17:48.800 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-12T12:17:48.801 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-12T12:17:48.802 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-12T12:17:48.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-12T12:17:48.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-12T12:17:48.804 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-12T12:17:48.805 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-12T12:17:48.806 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-12T12:17:48.806 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-12T12:17:48.807 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-12T12:17:48.808 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-12T12:17:48.809 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-12T12:17:48.809 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-12T12:17:48.810 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-12T12:17:48.811 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-12T12:17:48.812 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-12T12:17:48.812 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-12T12:17:48.813 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-12T12:17:48.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-12T12:17:48.815 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-12T12:17:48.816 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-12T12:17:48.817 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-12T12:17:48.818 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-12T12:17:48.819 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-12T12:17:48.819 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-12T12:17:48.820 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-12T12:17:48.821 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-12T12:17:48.822 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-12T12:17:48.823 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-12T12:17:48.824 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-12T12:17:48.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/ 2024-09-12T12:17:48.826 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-12T12:17:48.826 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-12T12:17:48.827 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-12T12:17:48.828 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-12T12:17:48.829 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-12T12:17:48.830 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-12T12:17:48.831 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-12T12:17:48.832 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-12T12:17:48.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-12T12:17:48.834 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-12T12:17:48.835 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-12T12:17:48.835 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-12T12:17:48.836 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-12T12:17:48.837 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/init.txt 2024-09-12T12:17:48.838 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-12T12:17:48.839 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/ 2024-09-12T12:17:48.840 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-12T12:17:48.841 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-12T12:17:48.842 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-12T12:17:48.843 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-12T12:17:48.844 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-12T12:17:48.845 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-12T12:17:48.846 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-12T12:17:48.847 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-12T12:17:48.847 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-12T12:17:48.848 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-12T12:17:48.849 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-12T12:17:48.850 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-12T12:17:48.851 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-12T12:17:48.852 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-12T12:17:48.853 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-12T12:17:48.854 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-12T12:17:48.854 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-12T12:17:48.855 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-12T12:17:48.856 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-12T12:17:48.857 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-12T12:17:48.858 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-12T12:17:48.859 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-12T12:17:48.860 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-12T12:17:48.861 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-12T12:17:48.861 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-12T12:17:48.862 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-12T12:17:48.863 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-12T12:17:48.864 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-12T12:17:48.865 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-12T12:17:48.866 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-12T12:17:48.867 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-12T12:17:48.868 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-12T12:17:48.869 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-12T12:17:48.870 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-12T12:17:48.871 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-12T12:17:48.871 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-12T12:17:48.872 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-12T12:17:48.873 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-12T12:17:48.874 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-12T12:17:48.875 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-12T12:17:48.876 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-12T12:17:48.877 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-12T12:17:48.877 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-12T12:17:48.878 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-12T12:17:48.879 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-12T12:17:48.881 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-12T12:17:48.883 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-12T12:17:48.883 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-12T12:17:48.883 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-12T12:17:48.884 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-12T12:17:48.885 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-12T12:17:48.886 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-12T12:17:48.887 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-12T12:17:48.888 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-12T12:17:48.889 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-12T12:17:48.890 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-12T12:17:48.891 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-12T12:17:48.892 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-12T12:17:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-12T12:17:48.893 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-12T12:17:48.894 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-12T12:17:48.895 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-12T12:17:48.896 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-12T12:17:48.897 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-12T12:17:48.898 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-12T12:17:48.899 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-12T12:17:48.900 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-12T12:17:48.901 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-12T12:17:48.902 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-12T12:17:48.903 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-12T12:17:48.904 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-12T12:17:48.905 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-12T12:17:48.906 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-12T12:17:48.906 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-12T12:17:48.908 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-12T12:17:48.909 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-12T12:17:48.910 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/java.txt 2024-09-12T12:17:48.911 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-12T12:17:48.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-12T12:17:48.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-12T12:17:48.913 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-12T12:17:48.915 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-12T12:17:48.915 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-12T12:17:48.916 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-12T12:17:48.917 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-12T12:17:48.918 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-12T12:17:48.919 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-12T12:17:48.920 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-12T12:17:48.921 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-12T12:17:48.922 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-12T12:17:48.923 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-12T12:17:48.923 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-12T12:17:48.925 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-12T12:17:48.926 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-12T12:17:48.927 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-12T12:17:48.928 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-12T12:17:48.929 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-12T12:17:48.930 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-12T12:17:48.931 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-12T12:17:48.932 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-12T12:17:48.933 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-12T12:17:48.934 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-12T12:17:48.935 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-12T12:17:48.936 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-12T12:17:48.937 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-12T12:17:48.937 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-12T12:17:48.938 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-12T12:17:48.939 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-12T12:17:48.940 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-12T12:17:48.941 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-12T12:17:48.942 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-12T12:17:48.943 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-12T12:17:48.943 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-12T12:17:48.944 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-12T12:17:48.946 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-12T12:17:48.946 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-12T12:17:48.947 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/ 2024-09-12T12:17:48.948 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-12T12:17:48.949 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-12T12:17:48.950 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-12T12:17:48.951 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-12T12:17:48.952 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-12T12:17:48.953 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-12T12:17:48.954 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-12T12:17:48.955 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-12T12:17:48.955 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-12T12:17:48.956 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-12T12:17:48.957 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-12T12:17:48.958 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-12T12:17:48.959 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/ 2024-09-12T12:17:48.960 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-12T12:17:48.961 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-12T12:17:48.961 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-12T12:17:48.962 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-12T12:17:48.963 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-12T12:17:48.965 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-12T12:17:48.965 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-12T12:17:48.966 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-12T12:17:48.967 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-12T12:17:48.968 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-12T12:17:48.969 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-12T12:17:48.970 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-12T12:17:48.971 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-12T12:17:48.971 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-12T12:17:48.972 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-12T12:17:48.973 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-12T12:17:48.974 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-12T12:17:48.975 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-12T12:17:48.976 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-12T12:17:48.977 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-12T12:17:48.978 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/md.txt 2024-09-12T12:17:48.979 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-12T12:17:48.980 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-12T12:17:49.238 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-12T12:17:49.238 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-12T12:17:49.239 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-12T12:17:49.240 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/metag/ 2024-09-12T12:17:49.241 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-12T12:17:49.245 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-12T12:17:49.245 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/ 2024-09-12T12:17:49.246 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-12T12:17:49.246 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-12T12:17:49.246 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-12T12:17:49.246 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-12T12:17:49.247 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-12T12:17:49.248 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-12T12:17:49.248 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-12T12:17:49.249 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-12T12:17:49.250 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-12T12:17:49.251 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-12T12:17:49.252 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mips/ 2024-09-12T12:17:49.253 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-12T12:17:49.254 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-12T12:17:49.255 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-12T12:17:49.256 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-12T12:17:49.257 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-12T12:17:49.258 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-12T12:17:49.259 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-12T12:17:49.260 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-12T12:17:49.261 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-12T12:17:49.262 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-12T12:17:49.263 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-12T12:17:49.263 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-12T12:17:49.265 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-12T12:17:49.265 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-12T12:17:49.266 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-12T12:17:49.267 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-12T12:17:49.268 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-12T12:17:49.269 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-12T12:17:49.270 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-12T12:17:49.271 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-12T12:17:49.272 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-12T12:17:49.273 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-12T12:17:49.274 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-12T12:17:49.275 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-12T12:17:49.276 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-12T12:17:49.276 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-12T12:17:49.277 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-12T12:17:49.278 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-12T12:17:49.279 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-12T12:17:49.279 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-12T12:17:49.280 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-12T12:17:49.281 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-12T12:17:49.282 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-12T12:17:49.283 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-12T12:17:49.284 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-12T12:17:49.285 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-12T12:17:49.286 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-12T12:17:49.286 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-12T12:17:49.287 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-12T12:17:49.288 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-12T12:17:49.289 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-12T12:17:49.290 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-12T12:17:49.291 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-12T12:17:49.291 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-12T12:17:49.292 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-12T12:17:49.293 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ 2024-09-12T12:17:49.294 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-12T12:17:49.294 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-12T12:17:49.295 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-12T12:17:49.296 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-12T12:17:49.297 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-12T12:17:49.297 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-12T12:17:49.298 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-12T12:17:49.299 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-12T12:17:49.300 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-12T12:17:49.301 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-12T12:17:49.301 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-12T12:17:49.302 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-12T12:17:49.303 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-12T12:17:49.304 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-12T12:17:49.305 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-12T12:17:49.306 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-12T12:17:49.307 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-12T12:17:49.308 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-12T12:17:49.309 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-12T12:17:49.309 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-12T12:17:49.311 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-12T12:17:49.312 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-12T12:17:49.313 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-12T12:17:49.313 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-12T12:17:49.314 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-12T12:17:49.315 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-12T12:17:49.316 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-12T12:17:49.317 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-12T12:17:49.318 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-12T12:17:49.319 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-12T12:17:49.320 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-12T12:17:49.321 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-12T12:17:49.322 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-12T12:17:49.323 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-12T12:17:49.324 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-12T12:17:49.325 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-12T12:17:49.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-12T12:17:49.327 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-12T12:17:49.328 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-12T12:17:49.329 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-12T12:17:49.330 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-12T12:17:49.331 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-12T12:17:49.332 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-12T12:17:49.332 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-12T12:17:49.333 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-12T12:17:49.334 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-12T12:17:49.335 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-12T12:17:49.335 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-12T12:17:49.336 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-12T12:17:49.337 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-12T12:17:49.338 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-12T12:17:49.339 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-12T12:17:49.339 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-12T12:17:49.340 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-12T12:17:49.341 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-12T12:17:49.341 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-12T12:17:49.342 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-12T12:17:49.343 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-12T12:17:49.343 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-12T12:17:49.345 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-12T12:17:49.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-12T12:17:49.346 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-12T12:17:49.347 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-12T12:17:49.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-12T12:17:49.348 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-12T12:17:49.349 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-12T12:17:49.350 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-12T12:17:49.351 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-12T12:17:49.351 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-12T12:17:49.352 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-12T12:17:49.353 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-12T12:17:49.354 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-12T12:17:49.355 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-12T12:17:49.356 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-12T12:17:49.357 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-12T12:17:49.357 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-12T12:17:49.358 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-12T12:17:49.359 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-12T12:17:49.360 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-12T12:17:49.361 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-12T12:17:49.362 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-12T12:17:49.362 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-12T12:17:49.363 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-12T12:17:49.364 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-12T12:17:49.365 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-12T12:17:49.366 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-12T12:17:49.367 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-12T12:17:49.368 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-12T12:17:49.369 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-12T12:17:49.370 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-12T12:17:49.371 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-12T12:17:49.372 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-12T12:17:49.373 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-12T12:17:49.374 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-12T12:17:49.375 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-12T12:17:49.376 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-12T12:17:49.377 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-12T12:17:49.378 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-12T12:17:49.379 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-12T12:17:49.380 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-12T12:17:49.381 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-12T12:17:49.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-12T12:17:49.382 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-12T12:17:49.383 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-12T12:17:49.384 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-12T12:17:49.385 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-12T12:17:49.386 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-12T12:17:49.387 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-12T12:17:49.388 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-12T12:17:49.389 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-12T12:17:49.390 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-12T12:17:49.391 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-12T12:17:49.392 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-12T12:17:49.393 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-12T12:17:49.393 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-12T12:17:49.394 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-12T12:17:49.395 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-12T12:17:49.396 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-12T12:17:49.397 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-12T12:17:49.398 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-12T12:17:49.399 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-12T12:17:49.400 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-12T12:17:49.400 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-12T12:17:49.401 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-12T12:17:49.402 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-12T12:17:49.403 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-12T12:17:49.404 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-12T12:17:49.405 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-12T12:17:49.406 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-12T12:17:49.407 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-12T12:17:49.408 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-12T12:17:49.409 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-12T12:17:49.409 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-12T12:17:49.410 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-12T12:17:49.411 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-12T12:17:49.412 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-12T12:17:49.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-12T12:17:49.413 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-12T12:17:49.414 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-12T12:17:49.415 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-12T12:17:49.416 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-12T12:17:49.417 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-12T12:17:49.418 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-12T12:17:49.419 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-12T12:17:49.420 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-12T12:17:49.421 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-12T12:17:49.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-12T12:17:49.422 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-12T12:17:49.423 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-12T12:17:49.424 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-12T12:17:49.425 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-12T12:17:49.426 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-12T12:17:49.427 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-12T12:17:49.428 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-12T12:17:49.429 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-12T12:17:49.430 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-12T12:17:49.431 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-12T12:17:49.431 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-12T12:17:49.432 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-12T12:17:49.433 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-12T12:17:49.434 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/phy/ 2024-09-12T12:17:49.435 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-12T12:17:49.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-12T12:17:49.436 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-12T12:17:49.437 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/platform/ 2024-09-12T12:17:49.438 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-12T12:17:49.439 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-12T12:17:49.440 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/ 2024-09-12T12:17:49.441 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-12T12:17:49.442 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-12T12:17:49.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-12T12:17:49.443 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-12T12:17:49.444 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-12T12:17:49.445 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-12T12:17:49.446 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-12T12:17:49.448 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-12T12:17:49.448 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-12T12:17:49.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-12T12:17:49.449 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-12T12:17:49.450 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-12T12:17:49.452 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-12T12:17:49.452 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-12T12:17:49.453 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-12T12:17:49.454 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-12T12:17:49.455 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-12T12:17:49.456 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-12T12:17:49.457 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-12T12:17:49.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-12T12:17:49.458 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-12T12:17:49.459 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-12T12:17:49.460 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-12T12:17:49.461 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-12T12:17:49.462 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-12T12:17:49.462 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-12T12:17:49.463 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-12T12:17:49.464 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-12T12:17:49.465 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-12T12:17:49.466 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-12T12:17:49.467 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-12T12:17:49.468 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-12T12:17:49.469 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-12T12:17:49.470 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-12T12:17:49.471 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-12T12:17:49.472 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-12T12:17:49.473 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-12T12:17:49.474 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-12T12:17:49.475 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-12T12:17:49.476 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-12T12:17:49.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-12T12:17:49.477 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-12T12:17:49.478 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-12T12:17:49.479 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-12T12:17:49.480 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-12T12:17:49.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-12T12:17:49.481 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pps/ 2024-09-12T12:17:49.482 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-12T12:17:49.483 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-12T12:17:49.484 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-12T12:17:49.485 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-12T12:17:49.486 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-12T12:17:49.487 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-12T12:17:49.488 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-12T12:17:49.489 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-12T12:17:49.489 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-12T12:17:49.490 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-12T12:17:49.491 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-12T12:17:49.492 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pti/ 2024-09-12T12:17:49.493 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-12T12:17:49.494 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-12T12:17:49.495 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-12T12:17:49.496 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-12T12:17:49.497 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-12T12:17:49.497 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-12T12:17:49.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-12T12:17:49.499 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-12T12:17:49.500 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-12T12:17:49.501 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-12T12:17:49.502 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-12T12:17:49.503 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-12T12:17:49.504 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-12T12:17:49.505 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-12T12:17:49.506 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-12T12:17:49.507 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-12T12:17:49.507 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-12T12:17:49.508 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-12T12:17:49.509 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-12T12:17:49.510 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-12T12:17:49.511 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/ 2024-09-12T12:17:49.512 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-12T12:17:49.513 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-12T12:17:49.513 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-12T12:17:49.514 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-12T12:17:49.515 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-12T12:17:49.516 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-12T12:17:49.517 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-12T12:17:49.518 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-12T12:17:49.519 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-12T12:17:49.520 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-12T12:17:49.520 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-12T12:17:49.521 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-12T12:17:49.522 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-12T12:17:49.523 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-12T12:17:49.524 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-12T12:17:49.525 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-12T12:17:49.526 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-12T12:17:49.527 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-12T12:17:49.528 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-12T12:17:49.529 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-12T12:17:49.529 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-12T12:17:49.530 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-12T12:17:49.531 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-12T12:17:49.532 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-12T12:17:49.533 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-12T12:17:49.534 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-12T12:17:49.535 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-12T12:17:49.536 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-12T12:17:49.537 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-12T12:17:49.538 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-12T12:17:49.538 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-12T12:17:49.539 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-12T12:17:49.540 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-12T12:17:49.541 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-12T12:17:49.542 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-12T12:17:49.543 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-12T12:17:49.544 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-12T12:17:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-12T12:17:49.545 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-12T12:17:49.546 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-12T12:17:49.547 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-12T12:17:49.548 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-12T12:17:49.549 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-12T12:17:49.550 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-12T12:17:49.551 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-12T12:17:49.552 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-12T12:17:49.553 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-12T12:17:49.554 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-12T12:17:49.554 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-12T12:17:49.555 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-12T12:17:49.556 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-12T12:17:49.557 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-12T12:17:49.558 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-12T12:17:49.559 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-12T12:17:49.560 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-12T12:17:49.561 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-12T12:17:49.562 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-12T12:17:49.564 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-12T12:17:49.565 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-12T12:17:49.566 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-12T12:17:49.567 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-12T12:17:49.567 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-12T12:17:49.568 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-12T12:17:49.569 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-12T12:17:49.570 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-12T12:17:49.572 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-12T12:17:49.573 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-12T12:17:49.574 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-12T12:17:49.574 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-12T12:17:49.575 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-12T12:17:49.576 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-12T12:17:49.577 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-12T12:17:49.578 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-12T12:17:49.579 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-12T12:17:49.580 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-12T12:17:49.581 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-12T12:17:49.582 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-12T12:17:49.583 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-12T12:17:49.584 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-12T12:17:49.585 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-12T12:17:49.586 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-12T12:17:49.587 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-12T12:17:49.588 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-12T12:17:49.589 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-12T12:17:49.590 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-12T12:17:49.591 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/ 2024-09-12T12:17:49.592 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-12T12:17:49.592 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-12T12:17:49.593 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-12T12:17:49.594 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-12T12:17:49.595 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-12T12:17:49.596 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-12T12:17:49.596 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-12T12:17:49.597 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-12T12:17:49.598 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-12T12:17:49.599 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-12T12:17:49.600 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-12T12:17:49.601 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-12T12:17:49.602 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-12T12:17:49.603 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-12T12:17:49.604 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/ 2024-09-12T12:17:49.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-12T12:17:49.605 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-12T12:17:49.606 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-12T12:17:49.607 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-12T12:17:49.608 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-12T12:17:49.609 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-12T12:17:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:49 smithi081 ceph-mon[30948]: pgmap v44: 97 pgs: 97 active+clean; 83 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-09-12T12:17:49.610 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-12T12:17:49.610 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-12T12:17:49.611 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-12T12:17:49.612 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sh/ 2024-09-12T12:17:49.613 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-12T12:17:49.614 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-12T12:17:49.615 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-12T12:17:49.615 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/ 2024-09-12T12:17:49.616 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-12T12:17:49.617 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-12T12:17:49.618 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-12T12:17:49.619 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-12T12:17:49.620 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-12T12:17:49.621 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-12T12:17:49.622 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-12T12:17:49.622 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-12T12:17:49.623 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-12T12:17:49.624 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-12T12:17:49.625 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-12T12:17:49.626 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-12T12:17:49.626 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-12T12:17:49.627 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-12T12:17:49.628 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-12T12:17:49.629 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-12T12:17:49.630 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-12T12:17:49.631 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-12T12:17:49.632 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-12T12:17:49.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-12T12:17:49.633 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-12T12:17:49.634 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-12T12:17:49.635 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-12T12:17:49.636 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-12T12:17:49.637 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-12T12:17:49.638 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-12T12:17:49.639 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-12T12:17:49.639 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-12T12:17:49.640 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-12T12:17:49.641 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-12T12:17:49.642 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-12T12:17:49.643 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-12T12:17:49.644 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-12T12:17:49.645 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-12T12:17:49.646 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-12T12:17:49.647 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-12T12:17:49.648 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-12T12:17:49.649 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-12T12:17:49.650 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-12T12:17:49.651 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-12T12:17:49.652 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-12T12:17:49.653 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-12T12:17:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:49 smithi173 ceph-mon[35326]: pgmap v44: 97 pgs: 97 active+clean; 83 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-09-12T12:17:49.654 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-12T12:17:49.655 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-12T12:17:49.656 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-12T12:17:49.657 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-12T12:17:49.658 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-12T12:17:49.659 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-12T12:17:49.660 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-12T12:17:49.661 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-12T12:17:49.662 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-12T12:17:49.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-12T12:17:49.664 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-12T12:17:49.665 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-12T12:17:49.666 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-12T12:17:49.667 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-12T12:17:49.668 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-12T12:17:49.669 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-12T12:17:49.671 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-12T12:17:49.672 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-12T12:17:49.673 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-12T12:17:49.674 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-12T12:17:49.675 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-12T12:17:49.676 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/ 2024-09-12T12:17:49.677 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-12T12:17:49.678 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-12T12:17:49.679 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-12T12:17:49.680 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-12T12:17:49.681 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-12T12:17:49.682 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-12T12:17:49.683 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-12T12:17:49.684 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-12T12:17:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:49 smithi103 ceph-mon[35094]: pgmap v44: 97 pgs: 97 active+clean; 83 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 6.8 MiB/s wr, 36 op/s 2024-09-12T12:17:49.685 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-12T12:17:49.686 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-12T12:17:49.687 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-12T12:17:49.688 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-12T12:17:49.689 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-12T12:17:49.690 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-12T12:17:49.692 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-12T12:17:49.693 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-12T12:17:49.694 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-12T12:17:49.695 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-12T12:17:49.696 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-12T12:17:49.697 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-12T12:17:49.698 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-12T12:17:49.699 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-12T12:17:49.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-12T12:17:49.701 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-12T12:17:49.702 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-12T12:17:49.703 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-12T12:17:49.704 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-12T12:17:49.705 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/target/ 2024-09-12T12:17:49.706 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-12T12:17:49.707 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-12T12:17:49.708 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-12T12:17:49.709 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-12T12:17:49.710 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-12T12:17:49.711 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-12T12:17:49.712 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-12T12:17:49.713 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-12T12:17:49.715 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-12T12:17:49.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-12T12:17:49.716 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-12T12:17:49.717 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-12T12:17:49.718 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/ 2024-09-12T12:17:49.719 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-12T12:17:49.720 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-12T12:17:49.721 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-12T12:17:49.722 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-12T12:17:49.723 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-12T12:17:49.724 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-12T12:17:49.725 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-12T12:17:49.726 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-12T12:17:49.727 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-12T12:17:49.728 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-12T12:17:49.729 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-12T12:17:49.730 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-12T12:17:49.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-12T12:17:49.732 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/ 2024-09-12T12:17:49.733 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-12T12:17:49.734 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-12T12:17:49.735 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-12T12:17:49.736 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-12T12:17:49.737 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-12T12:17:49.738 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-12T12:17:49.739 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-12T12:17:49.741 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-12T12:17:49.742 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-12T12:17:49.743 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-12T12:17:49.744 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-12T12:17:49.745 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-12T12:17:49.746 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-12T12:17:49.747 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-12T12:17:49.749 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-12T12:17:49.750 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-12T12:17:49.751 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-12T12:17:49.752 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-12T12:17:49.752 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-12T12:17:49.754 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-12T12:17:49.755 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/ 2024-09-12T12:17:49.756 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-12T12:17:49.757 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-12T12:17:49.758 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-12T12:17:49.759 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-12T12:17:49.761 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-12T12:17:49.762 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-12T12:17:49.763 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-12T12:17:49.764 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-12T12:17:49.765 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-12T12:17:49.766 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-12T12:17:49.768 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-12T12:17:49.769 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-12T12:17:49.770 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-12T12:17:49.772 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-12T12:17:49.773 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-12T12:17:49.774 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-12T12:17:49.776 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-12T12:17:49.778 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-12T12:17:49.779 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-12T12:17:49.781 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-12T12:17:49.782 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-12T12:17:49.783 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-12T12:17:49.785 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-12T12:17:49.787 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-12T12:17:49.788 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-12T12:17:49.789 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-12T12:17:49.791 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-12T12:17:49.792 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-12T12:17:49.794 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-12T12:17:49.795 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-12T12:17:49.797 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-12T12:17:49.798 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-12T12:17:49.800 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-12T12:17:49.801 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-12T12:17:49.803 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-12T12:17:49.804 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-12T12:17:49.806 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-12T12:17:49.807 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-12T12:17:49.808 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-12T12:17:49.810 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-12T12:17:49.811 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-12T12:17:49.813 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-12T12:17:49.814 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-12T12:17:49.816 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-12T12:17:49.817 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-12T12:17:49.819 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-12T12:17:49.820 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-12T12:17:49.822 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-12T12:17:49.823 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-12T12:17:49.825 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-12T12:17:49.826 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-12T12:17:49.827 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-12T12:17:49.829 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-12T12:17:49.830 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-12T12:17:49.832 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-12T12:17:49.833 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-12T12:17:49.835 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-12T12:17:49.836 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-12T12:17:49.838 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-12T12:17:49.839 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-12T12:17:49.841 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-12T12:17:49.842 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-12T12:17:49.843 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-12T12:17:49.845 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-12T12:17:49.846 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-12T12:17:49.848 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-12T12:17:49.849 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-12T12:17:49.851 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-12T12:17:49.852 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-12T12:17:49.854 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-12T12:17:49.855 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-12T12:17:49.857 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-12T12:17:49.859 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-12T12:17:49.860 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-12T12:17:49.861 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-12T12:17:49.862 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-12T12:17:49.863 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-12T12:17:49.864 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-12T12:17:49.865 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-12T12:17:49.866 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-12T12:17:49.867 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-12T12:17:49.868 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-12T12:17:49.869 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-12T12:17:49.870 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-12T12:17:49.871 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-12T12:17:49.872 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-12T12:17:49.873 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-12T12:17:49.874 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-12T12:17:49.876 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-12T12:17:49.876 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-12T12:17:49.877 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-12T12:17:49.878 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-12T12:17:49.879 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-12T12:17:49.880 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-12T12:17:49.881 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-12T12:17:49.882 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-12T12:17:49.884 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-12T12:17:49.885 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-12T12:17:49.886 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-12T12:17:49.887 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-12T12:17:49.888 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-12T12:17:49.888 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-12T12:17:49.889 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-12T12:17:49.890 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-12T12:17:49.891 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-12T12:17:49.892 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-12T12:17:49.893 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-12T12:17:49.894 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-12T12:17:49.895 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-12T12:17:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-12T12:17:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-12T12:17:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-12T12:17:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-12T12:17:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-12T12:17:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-12T12:17:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-12T12:17:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-12T12:17:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-12T12:17:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-12T12:17:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-12T12:17:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-12T12:17:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-12T12:17:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-12T12:17:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-12T12:17:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-12T12:17:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-12T12:17:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-12T12:17:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-12T12:17:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-12T12:17:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-12T12:17:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-12T12:17:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-12T12:17:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-12T12:17:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-12T12:17:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-12T12:17:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-12T12:17:49.925 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-12T12:17:49.926 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-12T12:17:49.927 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-12T12:17:49.927 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-12T12:17:49.928 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-12T12:17:49.929 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-12T12:17:49.930 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-12T12:17:49.931 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-12T12:17:49.932 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-12T12:17:49.933 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-12T12:17:49.934 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-12T12:17:49.935 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-12T12:17:49.936 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-12T12:17:49.937 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-12T12:17:49.939 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/ 2024-09-12T12:17:49.940 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-12T12:17:49.941 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-12T12:17:49.942 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-12T12:17:49.943 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-12T12:17:49.944 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-12T12:17:49.945 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-12T12:17:49.946 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-12T12:17:49.947 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-12T12:17:49.948 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-12T12:17:49.949 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-12T12:17:49.950 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-12T12:17:49.951 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-12T12:17:49.952 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-12T12:17:49.953 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-12T12:17:49.954 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-12T12:17:49.955 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-12T12:17:49.956 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-12T12:17:49.957 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-12T12:17:49.959 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-12T12:17:49.960 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-12T12:17:49.961 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-12T12:17:49.962 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-12T12:17:49.964 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-12T12:17:49.965 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-12T12:17:49.966 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-12T12:17:49.967 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/ 2024-09-12T12:17:49.969 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-12T12:17:49.970 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-12T12:17:49.971 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-12T12:17:49.973 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-12T12:17:49.974 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-12T12:17:49.975 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-12T12:17:49.976 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-12T12:17:49.977 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-12T12:17:49.979 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-12T12:17:49.980 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-12T12:17:49.981 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-12T12:17:49.982 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-12T12:17:49.983 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-12T12:17:49.984 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-12T12:17:49.985 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-12T12:17:49.986 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-12T12:17:49.987 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-12T12:17:49.988 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-12T12:17:49.989 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-12T12:17:49.990 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-12T12:17:49.991 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-12T12:17:49.992 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-12T12:17:49.993 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-12T12:17:49.995 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-12T12:17:49.996 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-12T12:17:49.997 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-12T12:17:49.998 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-12T12:17:49.999 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-12T12:17:50.000 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-12T12:17:50.001 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-12T12:17:50.001 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-12T12:17:50.002 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-12T12:17:50.004 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-12T12:17:50.004 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-12T12:17:50.005 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/ 2024-09-12T12:17:50.007 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-12T12:17:50.008 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-12T12:17:50.009 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-12T12:17:50.010 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-12T12:17:50.011 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-12T12:17:50.012 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-12T12:17:50.013 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-12T12:17:50.013 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-12T12:17:50.014 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-12T12:17:50.015 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-12T12:17:50.016 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-12T12:17:50.017 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-12T12:17:50.019 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-12T12:17:50.019 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-12T12:17:50.020 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-12T12:17:50.021 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-12T12:17:50.022 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-12T12:17:50.023 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-12T12:17:50.025 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-12T12:17:50.026 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-12T12:17:50.027 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-12T12:17:50.028 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-12T12:17:50.029 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-12T12:17:50.030 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-12T12:17:50.031 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-12T12:17:50.032 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-12T12:17:50.033 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-12T12:17:50.034 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-12T12:17:50.035 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-12T12:17:50.037 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-12T12:17:50.038 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-12T12:17:50.039 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-12T12:17:50.039 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-12T12:17:50.040 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-12T12:17:50.041 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-12T12:17:50.043 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-12T12:17:50.043 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-12T12:17:50.044 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-12T12:17:50.045 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-12T12:17:50.046 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-12T12:17:50.047 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-12T12:17:50.048 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-12T12:17:50.049 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-12T12:17:50.050 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-12T12:17:50.051 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-12T12:17:50.052 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-12T12:17:50.053 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-12T12:17:50.054 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-12T12:17:50.055 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-12T12:17:50.056 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-12T12:17:50.057 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-12T12:17:50.058 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-12T12:17:50.059 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-12T12:17:50.061 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-12T12:17:50.061 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-12T12:17:50.062 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-12T12:17:50.063 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-12T12:17:50.065 INFO:tasks.workunit.client.0.smithi081.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-12T12:17:51.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:51 smithi081 ceph-mon[30948]: pgmap v45: 97 pgs: 97 active+clean; 83 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 6.8 MiB/s wr, 31 op/s 2024-09-12T12:17:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:51 smithi173 ceph-mon[35326]: pgmap v45: 97 pgs: 97 active+clean; 83 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 6.8 MiB/s wr, 31 op/s 2024-09-12T12:17:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:51 smithi103 ceph-mon[35094]: pgmap v45: 97 pgs: 97 active+clean; 83 MiB data, 604 MiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 6.8 MiB/s wr, 31 op/s 2024-09-12T12:17:52.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:52 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:17:52.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:52 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:17:52.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:52 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:17:53.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:53 smithi081 ceph-mon[30948]: pgmap v46: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 7.5 MiB/s wr, 352 op/s 2024-09-12T12:17:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:53 smithi173 ceph-mon[35326]: pgmap v46: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 7.5 MiB/s wr, 352 op/s 2024-09-12T12:17:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:53 smithi103 ceph-mon[35094]: pgmap v46: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 752 KiB/s rd, 7.5 MiB/s wr, 352 op/s 2024-09-12T12:17:54.826 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-12T12:17:55.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:55 smithi081 ceph-mon[30948]: pgmap v47: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 7.4 MiB/s wr, 346 op/s 2024-09-12T12:17:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:55 smithi173 ceph-mon[35326]: pgmap v47: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 7.4 MiB/s wr, 346 op/s 2024-09-12T12:17:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:55 smithi103 ceph-mon[35094]: pgmap v47: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 7.4 MiB/s wr, 346 op/s 2024-09-12T12:17:55.917 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar xf doc.tar 2024-09-12T12:17:57.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:57 smithi081 ceph-mon[30948]: pgmap v48: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 7.4 MiB/s wr, 346 op/s 2024-09-12T12:17:57.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:57 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:17:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:57 smithi173 ceph-mon[35326]: pgmap v48: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 7.4 MiB/s wr, 346 op/s 2024-09-12T12:17:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:57 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:17:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:57 smithi103 ceph-mon[35094]: pgmap v48: 97 pgs: 97 active+clean; 89 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 7.4 MiB/s wr, 346 op/s 2024-09-12T12:17:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:57 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:17:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:59 smithi081 ceph-mon[30948]: pgmap v49: 97 pgs: 97 active+clean; 91 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 7.7 MiB/s wr, 388 op/s 2024-09-12T12:17:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:17:59 smithi081 ceph-mon[30948]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T12:17:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:59 smithi173 ceph-mon[35326]: pgmap v49: 97 pgs: 97 active+clean; 91 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 7.7 MiB/s wr, 388 op/s 2024-09-12T12:17:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:17:59 smithi173 ceph-mon[35326]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T12:17:59.688 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:59 smithi103 ceph-mon[35094]: pgmap v49: 97 pgs: 97 active+clean; 91 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 7.7 MiB/s wr, 388 op/s 2024-09-12T12:17:59.689 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:17:59 smithi103 ceph-mon[35094]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 -- 172.21.15.81:0/2427984324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178105fa0 msgr2=0x7f717810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 --2- 172.21.15.81:0/2427984324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178105fa0 0x7f717810daf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7170009ca0 tx=0x7f717002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 -- 172.21.15.81:0/2427984324 shutdown_connections 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 --2- 172.21.15.81:0/2427984324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178105fa0 0x7f717810daf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 --2- 172.21.15.81:0/2427984324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7178101d20 0x7f7178105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 --2- 172.21.15.81:0/2427984324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7178101370 0x7f7178101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.561 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 -- 172.21.15.81:0/2427984324 >> 172.21.15.81:0/2427984324 conn(0x7f7178077160 msgr2=0x7f71780fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 -- 172.21.15.81:0/2427984324 shutdown_connections 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 -- 172.21.15.81:0/2427984324 wait complete. 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 Processor -- start 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.559+0000 7f717d645640 1 -- start start 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7178101370 0x7f7178199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7178105fa0 0x7f71781999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 0x7f71781a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7178111120 con 0x7f7178199f40 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7178110fa0 con 0x7f7178105fa0 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71781112a0 con 0x7f7178101370 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 0x7f71781a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 0x7f71781a44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57022/0 (socket says 172.21.15.81:57022) 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 -- 172.21.15.81:0/806739536 learned_addr learned my addr 172.21.15.81:0/806739536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f7176ffd640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7178101370 0x7f7178199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71767fc640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7178105fa0 0x7f71781999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 -- 172.21.15.81:0/806739536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7178101370 msgr2=0x7f7178199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7178101370 0x7f7178199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 -- 172.21.15.81:0/806739536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7178105fa0 msgr2=0x7f71781999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7178105fa0 0x7f71781999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 -- 172.21.15.81:0/806739536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71781a4cc0 con 0x7f7178199f40 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f71777fe640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 0x7f71781a44f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7170006010 tx=0x7f71700319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f715ffff640 1 -- 172.21.15.81:0/806739536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717002fa20 con 0x7f7178199f40 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f715ffff640 1 -- 172.21.15.81:0/806739536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f717002fbc0 con 0x7f7178199f40 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71781a4f50 con 0x7f7178199f40 2024-09-12T12:18:01.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.560+0000 7f715ffff640 1 -- 172.21.15.81:0/806739536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71700466c0 con 0x7f7178199f40 2024-09-12T12:18:01.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.561+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71781a5460 con 0x7f7178199f40 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.563+0000 7f715ffff640 1 -- 172.21.15.81:0/806739536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f717002fd70 con 0x7f7178199f40 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.563+0000 7f71803da740 1 Processor -- start 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.563+0000 7f71803da740 1 -- start start 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71803da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c629d0 0x55edd5c62db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71803da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 0x55edd5c71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71803da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c720c0 0x55edd5c744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71803da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edd5bc72f0 con 0x55edd5c632f0 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71803da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55edd5b6f270 con 0x55edd5c629d0 2024-09-12T12:18:01.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71803da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edd5bc32b0 con 0x55edd5c720c0 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 0x55edd5c71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 0x55edd5c71b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57036/0 (socket says 172.21.15.81:57036) 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 -- 172.21.15.81:0/2888646486 learned_addr learned my addr 172.21.15.81:0/2888646486 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71767fc640 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c629d0 0x55edd5c62db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71767fc640 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c720c0 0x55edd5c744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f715ffff640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f71600a2da0 0x7f71600a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 -- 172.21.15.81:0/2888646486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c720c0 msgr2=0x55edd5c744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c720c0 0x55edd5c744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 -- 172.21.15.81:0/2888646486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c629d0 msgr2=0x55edd5c62db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c629d0 0x55edd5c62db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 -- 172.21.15.81:0/2888646486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd5b6e340 con 0x55edd5c632f0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f71777fe640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f71600a2da0 0x7f71600a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f715ffff640 1 -- 172.21.15.81:0/806739536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f71700f0580 con 0x7f7178199f40 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f7176ffd640 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 0x55edd5c71b80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7168009d20 tx=0x7f7168011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0da7c56cce5922 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f715d7fa640 1 -- 172.21.15.81:0/2888646486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168004230 con 0x55edd5c632f0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f715d7fa640 1 -- 172.21.15.81:0/2888646486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7168009e10 con 0x55edd5c632f0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.564+0000 7f715d7fa640 1 -- 172.21.15.81:0/2888646486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168019940 con 0x55edd5c632f0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71777fe640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f71600a2da0 0x7f71600a5260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71700edf00 tx=0x7f717002a8c0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 -- 172.21.15.81:0/2888646486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 msgr2=0x55edd5c71b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 0x55edd5c71b80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7168009d20 tx=0x7f7168011810 comp rx=0 tx=0).stop 2024-09-12T12:18:01.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 -- 172.21.15.81:0/2888646486 shutdown_connections 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c720c0 0x55edd5c744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c632f0 0x55edd5c71b80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 --2- 172.21.15.81:0/2888646486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c629d0 0x55edd5c62db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 -- 172.21.15.81:0/2888646486 >> 172.21.15.81:0/2888646486 conn(0x55edd5c5f060 msgr2=0x55edd5c5f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 -- 172.21.15.81:0/2888646486 shutdown_connections 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.565+0000 7f71803da740 1 -- 172.21.15.81:0/2888646486 wait complete. 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 -- start start 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 Processor -- start 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c71a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c6ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.572 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55edd5c74cf0 con 0x55edd5c720c0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55edd5b50290 con 0x55edd5c632f0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edd5c74e70 con 0x55edd5c629d0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71803da740 10 client.0 _ll_register_callbacks cb 0x55edd5b81140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71767fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71767fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c6f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57050/0 (socket says 172.21.15.81:57050) 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71767fc640 1 -- 172.21.15.81:0/3065534428 learned_addr learned my addr 172.21.15.81:0/3065534428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c6ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f71767fc640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c71a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f7176ffd640 1 -- 172.21.15.81:0/3065534428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 msgr2=0x55edd5c71a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c71a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f7176ffd640 1 -- 172.21.15.81:0/3065534428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 msgr2=0x55edd5c6f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.573 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c6f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.566+0000 7f7176ffd640 1 -- 172.21.15.81:0/3065534428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd58da210 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c6ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7168009d20 tx=0x7f71680194c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d5210bbf84b775 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f715aff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f715aff5640 1 -- 172.21.15.81:0/3065534428 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168027070 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7168009e10 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f715aff5640 1 -- 172.21.15.81:0/3065534428 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f7168005450 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f715aff5640 1 -- 172.21.15.81:0/3065534428 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7168033050 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 10 client.25142 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55edd59a6620 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f715aff5640 1 -- 172.21.15.81:0/3065534428 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7168009e10 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f715aff5640 1 -- 172.21.15.81:0/3065534428 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f7168019980 con 0x55edd5c632f0 2024-09-12T12:18:01.574 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 10 client.25142 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 10 client.25142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 20 client.25142 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5c86420 0x55edd5c88810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 4 client.25142 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.567+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edd5bd4a20 con 0x55edd5c86420 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.568+0000 7f71767fc640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5c86420 0x55edd5c88810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.568+0000 7f715aff5640 10 client.25142 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:01.575 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.568+0000 7f71767fc640 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5c86420 0x55edd5c88810 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200531b0e9ee52a9 server_cookie=9b9a0c11ceb71e5b in_seq=0 out_seq=0 2024-09-12T12:18:01.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f715aff5640 1 -- 172.21.15.81:0/3065534428 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edd5bd4a20 con 0x55edd5c86420 2024-09-12T12:18:01.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f715aff5640 10 client.25142 handle_command_reply: tid=0 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 client.25142 shutdown 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 msgr2=0x55edd5c6ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c6ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7168009d20 tx=0x7f71680194c0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 shutdown_connections 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5c86420 0x55edd5c88810 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c6f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f715aff5640 0 client.25142 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c6ef70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 --2- 172.21.15.81:0/3065534428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c71a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 >> 172.21.15.81:0/3065534428 conn(0x55edd5c5f060 msgr2=0x55edd5c64d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 shutdown_connections 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 1 -- 172.21.15.81:0/3065534428 wait complete. 2024-09-12T12:18:01.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.570+0000 7f71803da740 20 client.25142 trim_cache size 0 max 16384 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.584+0000 7f71803da740 1 Processor -- start 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 -- start start 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c5e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c8e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71781ab4e0 con 0x55edd5c720c0 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71781ad0e0 con 0x55edd5c632f0 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71803da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71781abbb0 con 0x55edd5c629d0 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c8e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c8e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57052/0 (socket says 172.21.15.81:57052) 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 -- 172.21.15.81:0/1889076154 learned_addr learned my addr 172.21.15.81:0/1889076154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f7176ffd640 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c5e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 -- 172.21.15.81:0/1889076154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 msgr2=0x55edd5c717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 -- 172.21.15.81:0/1889076154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 msgr2=0x55edd5c5e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c5e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 -- 172.21.15.81:0/1889076154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd5c5ee90 con 0x55edd5c720c0 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f71767fc640 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c8e040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f716c009700 tx=0x7f716c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6ad4ca75c582e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f715cff9640 1 -- 172.21.15.81:0/1889076154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c003af0 con 0x55edd5c720c0 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f715cff9640 1 -- 172.21.15.81:0/1889076154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f716c02b040 con 0x55edd5c720c0 2024-09-12T12:18:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.585+0000 7f715cff9640 1 -- 172.21.15.81:0/1889076154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c0203c0 con 0x55edd5c720c0 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 -- 172.21.15.81:0/1889076154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 msgr2=0x55edd5c8e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c8e040 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f716c009700 tx=0x7f716c0046c0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 -- 172.21.15.81:0/1889076154 shutdown_connections 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c8e040 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c5e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 --2- 172.21.15.81:0/1889076154 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 -- 172.21.15.81:0/1889076154 >> 172.21.15.81:0/1889076154 conn(0x55edd5c5f060 msgr2=0x55edd5c5d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 -- 172.21.15.81:0/1889076154 shutdown_connections 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 -- 172.21.15.81:0/1889076154 wait complete. 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 -- start start 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.586+0000 7f71803da740 1 Processor -- start 2024-09-12T12:18:01.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c7dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c7e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c7e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71781ac950 con 0x55edd5c720c0 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71781ac280 con 0x55edd5c632f0 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71781a9560 con 0x55edd5c629d0 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 10 client.0 _ll_register_callbacks cb 0x7f716c009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f7176ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c7e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f7176ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c7e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:47960/0 (socket says 172.21.15.81:47960) 2024-09-12T12:18:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f7176ffd640 1 -- 172.21.15.81:0/3184532636 learned_addr learned my addr 172.21.15.81:0/3184532636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c7e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c7dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 -- 172.21.15.81:0/3184532636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 msgr2=0x55edd5c7dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c7dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 -- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 msgr2=0x55edd5c7e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c7e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 -- 172.21.15.81:0/3184532636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd5cef220 con 0x55edd5c720c0 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c7e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71767fc640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c7e540 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f716c0057c0 tx=0x7f716c021d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56618721e058d508 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f715aff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:01.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f715aff5640 1 -- 172.21.15.81:0/3184532636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c034070 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f715aff5640 1 -- 172.21.15.81:0/3184532636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f716c01a040 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.587+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f716c02b040 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f715aff5640 1 -- 172.21.15.81:0/3184532636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f716c005020 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 10 client.15621 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55edd5cf0530 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f715aff5640 1 -- 172.21.15.81:0/3184532636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f716c02b040 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f715aff5640 1 -- 172.21.15.81:0/3184532636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f716c021430 con 0x55edd5c720c0 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 10 client.15621 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 20 client.15621 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5cf0cb0 0x55edd5cf30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 4 client.15621 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:18:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55edd5bced70 con 0x55edd5cf0cb0 2024-09-12T12:18:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5cf0cb0 0x55edd5cf30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f715aff5640 10 client.15621 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:01.588+0000 7f7176ffd640 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5cf0cb0 0x55edd5cf30d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923321176cb8f8cd server_cookie=cea401a02840bcb3 in_seq=0 out_seq=0 2024-09-12T12:18:01.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:01 smithi081 ceph-mon[30948]: pgmap v50: 97 pgs: 97 active+clean; 91 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 863 KiB/s wr, 362 op/s 2024-09-12T12:18:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:01 smithi173 ceph-mon[35326]: pgmap v50: 97 pgs: 97 active+clean; 91 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 863 KiB/s wr, 362 op/s 2024-09-12T12:18:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:01 smithi103 ceph-mon[35094]: pgmap v50: 97 pgs: 97 active+clean; 91 MiB data, 640 MiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 863 KiB/s wr, 362 op/s 2024-09-12T12:18:02.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:02 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:02.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:02 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:02.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:02 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:03.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:03 smithi081 ceph-mon[30948]: pgmap v51: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 386 op/s 2024-09-12T12:18:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:03 smithi173 ceph-mon[35326]: pgmap v51: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 386 op/s 2024-09-12T12:18:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:03 smithi103 ceph-mon[35094]: pgmap v51: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 386 op/s 2024-09-12T12:18:05.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:05 smithi081 ceph-mon[30948]: pgmap v52: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-12T12:18:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:05 smithi173 ceph-mon[35326]: pgmap v52: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-12T12:18:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:05 smithi103 ceph-mon[35094]: pgmap v52: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-12T12:18:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:07 smithi081 ceph-mon[30948]: pgmap v53: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-12T12:18:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:07 smithi173 ceph-mon[35326]: pgmap v53: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-12T12:18:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:07 smithi103 ceph-mon[35094]: pgmap v53: 97 pgs: 97 active+clean; 103 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-09-12T12:18:09.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:09 smithi081 ceph-mon[30948]: pgmap v54: 97 pgs: 97 active+clean; 108 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 673 op/s 2024-09-12T12:18:09.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:09 smithi173 ceph-mon[35326]: pgmap v54: 97 pgs: 97 active+clean; 108 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 673 op/s 2024-09-12T12:18:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:09 smithi103 ceph-mon[35094]: pgmap v54: 97 pgs: 97 active+clean; 108 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 673 op/s 2024-09-12T12:18:11.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:11 smithi081 ceph-mon[30948]: pgmap v55: 97 pgs: 97 active+clean; 108 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 631 op/s 2024-09-12T12:18:11.706 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:11 smithi103 ceph-mon[35094]: pgmap v55: 97 pgs: 97 active+clean; 108 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 631 op/s 2024-09-12T12:18:11.706 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:11 smithi173 ceph-mon[35326]: pgmap v55: 97 pgs: 97 active+clean; 108 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 631 op/s 2024-09-12T12:18:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f715aff5640 1 -- 172.21.15.81:0/3184532636 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55edd5bced70 con 0x55edd5cf0cb0 2024-09-12T12:18:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f715aff5640 10 client.15621 handle_command_reply: tid=0 2024-09-12T12:18:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 client.15621 shutdown 2024-09-12T12:18:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 msgr2=0x55edd5c7e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c7e540 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f716c0057c0 tx=0x7f716c021d70 comp rx=0 tx=0).stop 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 shutdown_connections 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55edd5cf0cb0 0x55edd5cf30d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f715aff5640 0 client.15621 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55edd5c720c0 0x55edd5c7e540 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55edd5c632f0 0x55edd5c7e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 --2- 172.21.15.81:0/3184532636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edd5c629d0 0x55edd5c7dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.485+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 >> 172.21.15.81:0/3184532636 conn(0x55edd5c5f060 msgr2=0x55edd5c67f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 shutdown_connections 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f71803da740 1 -- 172.21.15.81:0/3184532636 wait complete. 2024-09-12T12:18:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f71803da740 20 client.15621 trim_cache size 0 max 16384 2024-09-12T12:18:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:18:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:18:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:18:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f71600a2da0 msgr2=0x7f71600a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f71600a2da0 0x7f71600a5260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71700edf00 tx=0x7f717002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 msgr2=0x7f71781a44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 0x7f71781a44f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7170006010 tx=0x7f71700319f0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 shutdown_connections 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f71600a2da0 0x7f71600a5260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7178199f40 0x7f71781a44f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7178105fa0 0x7f71781999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.486+0000 7f717d645640 1 --2- 172.21.15.81:0/806739536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7178101370 0x7f7178199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.487+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 >> 172.21.15.81:0/806739536 conn(0x7f7178077160 msgr2=0x7f7178105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.487+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 shutdown_connections 2024-09-12T12:18:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:12.487+0000 7f717d645640 1 -- 172.21.15.81:0/806739536 wait complete. 2024-09-12T12:18:13.612 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:13 smithi081 ceph-mon[30948]: pgmap v56: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 971 op/s 2024-09-12T12:18:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:13 smithi173 ceph-mon[35326]: pgmap v56: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 971 op/s 2024-09-12T12:18:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:13 smithi103 ceph-mon[35094]: pgmap v56: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.5 MiB/s wr, 971 op/s 2024-09-12T12:18:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:15 smithi081 ceph-mon[30948]: pgmap v57: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 947 op/s 2024-09-12T12:18:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:15 smithi173 ceph-mon[35326]: pgmap v57: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 947 op/s 2024-09-12T12:18:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:15 smithi103 ceph-mon[35094]: pgmap v57: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 947 op/s 2024-09-12T12:18:16.694 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.4 2024-09-12T12:18:16.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:18:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:18:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.418+0000 7fd4cb498640 1 -- 172.21.15.81:0/3442281382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100de0 msgr2=0x7fd4c4104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.418+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3442281382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100de0 0x7fd4c4104e30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009900 tx=0x7fd4b802a410 comp rx=0 tx=0).stop 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.419+0000 7fd4cb498640 1 -- 172.21.15.81:0/3442281382 shutdown_connections 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.419+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3442281382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c4105560 0x7fd4c410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.419+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3442281382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100de0 0x7fd4c4104e30 secure :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009900 tx=0x7fd4b802a410 comp rx=0 tx=0).stop 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.419+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3442281382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c4100430 0x7fd4c4100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.419+0000 7fd4cb498640 1 -- 172.21.15.81:0/3442281382 >> 172.21.15.81:0/3442281382 conn(0x7fd4c4077230 msgr2=0x7fd4c40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.420+0000 7fd4cb498640 1 -- 172.21.15.81:0/3442281382 shutdown_connections 2024-09-12T12:18:17.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.420+0000 7fd4cb498640 1 -- 172.21.15.81:0/3442281382 wait complete. 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.421+0000 7fd4cb498640 1 Processor -- start 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.421+0000 7fd4cb498640 1 -- start start 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4cb498640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 0x7fd4c410b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4cb498640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c4105560 0x7fd4c410b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c9234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 0x7fd4c410b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4cb498640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410bd80 0x7fd4c41aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4cb498640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4110f60 con 0x7fd4c4100430 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4cb498640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4110de0 con 0x7fd4c410bd80 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4cb498640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41110e0 con 0x7fd4c4105560 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c9234640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 0x7fd4c410b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36846/0 (socket says 172.21.15.81:36846) 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c9234640 1 -- 172.21.15.81:0/3671451782 learned_addr learned my addr 172.21.15.81:0/3671451782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:17.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c9a35640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410bd80 0x7fd4c41aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c8a33640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c4105560 0x7fd4c410b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c9234640 1 -- 172.21.15.81:0/3671451782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c4105560 msgr2=0x7fd4c410b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.422+0000 7fd4c9234640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c4105560 0x7fd4c410b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4c9234640 1 -- 172.21.15.81:0/3671451782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410bd80 msgr2=0x7fd4c41aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4c9234640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410bd80 0x7fd4c41aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4c9234640 1 -- 172.21.15.81:0/3671451782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c41ab3e0 con 0x7fd4c4100430 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4c9234640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 0x7fd4c410b300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000d950 tx=0x7fd4c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0017070 con 0x7fd4c4100430 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd4c0009c30 con 0x7fd4c4100430 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c000f740 con 0x7fd4c4100430 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c41ab6d0 con 0x7fd4c4100430 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.423+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41abb90 con 0x7fd4c4100430 2024-09-12T12:18:17.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.425+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c4101910 con 0x7fd4c4100430 2024-09-12T12:18:17.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.426+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fd4c0010a80 con 0x7fd4c4100430 2024-09-12T12:18:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.427+0000 7fd4b67fc640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd4b00a2d70 0x7fd4b00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.427+0000 7fd4c8a33640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd4b00a2d70 0x7fd4b00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:17.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.427+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fd4c00cef40 con 0x7fd4c4100430 2024-09-12T12:18:17.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.428+0000 7fd4c8a33640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd4b00a2d70 0x7fd4b00a5230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8005940 tx=0x7fd4b80058d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:17.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.436+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4c0009de0 con 0x7fd4c4100430 2024-09-12T12:18:17.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:17 smithi081 ceph-mon[30948]: pgmap v58: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 947 op/s 2024-09-12T12:18:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:17 smithi173 ceph-mon[35326]: pgmap v58: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 947 op/s 2024-09-12T12:18:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:17 smithi103 ceph-mon[35094]: pgmap v58: 97 pgs: 97 active+clean; 163 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 947 op/s 2024-09-12T12:18:17.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.688+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4c41abe80 con 0x7fd4c4100430 2024-09-12T12:18:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.689+0000 7fd4b67fc640 1 -- 172.21.15.81:0/3671451782 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11989 (secure 0 0 0) 0x7fd4c009b580 con 0x7fd4c4100430 2024-09-12T12:18:17.689 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:18:17.689 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-12T12:18:01:322948+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:18:00.528315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:18:17.689 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-12T12:18:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd4b00a2d70 msgr2=0x7fd4b00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd4b00a2d70 0x7fd4b00a5230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8005940 tx=0x7fd4b80058d0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 msgr2=0x7fd4c410b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 0x7fd4c410b300 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000d950 tx=0x7fd4c000de10 comp rx=0 tx=0).stop 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 shutdown_connections 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fd4b00a2d70 0x7fd4b00a5230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4c410bd80 0x7fd4c41aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4c4105560 0x7fd4c410b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 --2- 172.21.15.81:0/3671451782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c4100430 0x7fd4c410b300 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 >> 172.21.15.81:0/3671451782 conn(0x7fd4c4077230 msgr2=0x7fd4c41020d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 shutdown_connections 2024-09-12T12:18:17.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:17.691+0000 7fd4cb498640 1 -- 172.21.15.81:0/3671451782 wait complete. 2024-09-12T12:18:18.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:18 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3671451782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:18:18.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:18 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3671451782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:18:18.771 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:18 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3671451782' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:18:18.800 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0' 2024-09-12T12:18:18.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 133.4 --await-for 45.0 2024-09-12T12:18:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:18:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:19 smithi081 ceph-mon[30948]: pgmap v59: 97 pgs: 97 active+clean; 164 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 1.29k op/s 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 -- 172.21.15.81:0/1174418896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100e20 msgr2=0x7f4678101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1174418896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100e20 0x7f4678101200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4668009900 tx=0x7f466802a480 comp rx=0 tx=0).stop 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 -- 172.21.15.81:0/1174418896 shutdown_connections 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1174418896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678102ef0 0x7f467810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1174418896 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f46781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1174418896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678100e20 0x7f4678101200 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 -- 172.21.15.81:0/1174418896 >> 172.21.15.81:0/1174418896 conn(0x7f46780fc7d0 msgr2=0x7f46780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:19.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 -- 172.21.15.81:0/1174418896 shutdown_connections 2024-09-12T12:18:19.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.614+0000 7f467ccd1640 1 -- 172.21.15.81:0/1174418896 wait complete. 2024-09-12T12:18:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 Processor -- start 2024-09-12T12:18:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 -- start start 2024-09-12T12:18:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678100e20 0x7f4678198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f4678198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 0x7f467819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46781121a0 con 0x7f4678102ef0 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4678112020 con 0x7f4678100e20 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f467ccd1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4678112320 con 0x7f4678102570 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f4676d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 0x7f467819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f4678198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f4678198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.81:46040/0 (socket says 172.21.15.81:46040) 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f4676d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 0x7f467819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36860/0 (socket says 172.21.15.81:36860) 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.615+0000 7f4675d9b640 1 -- 172.21.15.81:0/1081402587 learned_addr learned my addr 172.21.15.81:0/1081402587 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:19.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f467659c640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678100e20 0x7f4678198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4676d9d640 1 -- 172.21.15.81:0/1081402587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 msgr2=0x7f4678198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4676d9d640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f4678198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4676d9d640 1 -- 172.21.15.81:0/1081402587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678100e20 msgr2=0x7f4678198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4676d9d640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678100e20 0x7f4678198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4676d9d640 1 -- 172.21.15.81:0/1081402587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467819d4e0 con 0x7f4678102ef0 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f467659c640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678100e20 0x7f4678198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4675d9b640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f4678198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f4676d9d640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 0x7f467819ce00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f467000cab0 tx=0x7f467000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f46677fe640 1 -- 172.21.15.81:0/1081402587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467000ae20 con 0x7f4678102ef0 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467819d7d0 con 0x7f4678102ef0 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f46677fe640 1 -- 172.21.15.81:0/1081402587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f467000f950 con 0x7f4678102ef0 2024-09-12T12:18:19.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f46677fe640 1 -- 172.21.15.81:0/1081402587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670018bd0 con 0x7f4678102ef0 2024-09-12T12:18:19.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.616+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46781a50b0 con 0x7f4678102ef0 2024-09-12T12:18:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.618+0000 7f46677fe640 1 -- 172.21.15.81:0/1081402587 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f467000fb00 con 0x7f4678102ef0 2024-09-12T12:18:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 Processor -- start 2024-09-12T12:18:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 -- start start 2024-09-12T12:18:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b1080 0x55f1ea5bb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1ea5162a0 con 0x55f1ea5bb940 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f1ea4bdb10 con 0x55f1ea5b1080 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467f0aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f1ea512260 con 0x55f1ea5b0760 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f46677fe640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f46600a2cf0 0x7f46600a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f4676d9d640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f46600a2cf0 0x7f46600a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f467659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b1080 0x55f1ea5bb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.81:46044/0 (socket says 172.21.15.81:46044) 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f4675d9b640 1 -- 172.21.15.81:0/4262929829 learned_addr learned my addr 172.21.15.81:0/4262929829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:19.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.619+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f46677fe640 1 -- 172.21.15.81:0/1081402587 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f46700cfab0 con 0x7f4678102ef0 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4675d9b640 1 -- 172.21.15.81:0/4262929829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b1080 msgr2=0x55f1ea5bb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b1080 0x55f1ea5bb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4675d9b640 1 -- 172.21.15.81:0/4262929829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 msgr2=0x55f1ea5bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5bdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4675d9b640 1 -- 172.21.15.81:0/4262929829 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ea287b90 con 0x55f1ea5b0760 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f467659c640 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b1080 0x55f1ea5bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4676d9d640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f46600a2cf0 0x7f46600a51b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f467000ca80 tx=0x7f467006af70 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b0b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f466c012c10 tx=0x7f466c00bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d978a205981ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4664ff9640 1 -- 172.21.15.81:0/4262929829 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c012d00 con 0x55f1ea5b0760 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4664ff9640 1 -- 172.21.15.81:0/4262929829 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f466c010c00 con 0x55f1ea5b0760 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.620+0000 7f4664ff9640 1 -- 172.21.15.81:0/4262929829 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c01d590 con 0x55f1ea5b0760 2024-09-12T12:18:19.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 -- 172.21.15.81:0/4262929829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 msgr2=0x55f1ea5b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b0b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f466c012c10 tx=0x7f466c00bc10 comp rx=0 tx=0).stop 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 -- 172.21.15.81:0/4262929829 shutdown_connections 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b1080 0x55f1ea5bb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4262929829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b0b40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 -- 172.21.15.81:0/4262929829 >> 172.21.15.81:0/4262929829 conn(0x55f1ea5accf0 msgr2=0x55f1ea5ad0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 -- 172.21.15.81:0/4262929829 shutdown_connections 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 -- 172.21.15.81:0/4262929829 wait complete. 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.621+0000 7f467f0aa740 1 -- start start 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 Processor -- start 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55f1ea5c2920 con 0x55f1ea5bb940 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f1ea49e6e0 con 0x55f1ea5b0760 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f1ea5c2aa0 con 0x55f1ea5b1080 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467f0aa740 10 client.0 _ll_register_callbacks cb 0x55f1ea4c2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5b8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.81:46052/0 (socket says 172.21.15.81:46052) 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 -- 172.21.15.81:0/4013859617 learned_addr learned my addr 172.21.15.81:0/4013859617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36888/0 (socket says 172.21.15.81:36888) 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 -- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b0760 msgr2=0x55f1ea5b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 -- 172.21.15.81:0/4013859617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 msgr2=0x55f1ea5b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5b91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.622+0000 7f467659c640 1 -- 172.21.15.81:0/4013859617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ea5cbd90 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467659c640 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5b8c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46680096c0 tx=0x7f46680319d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32e694df34d61e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f465dffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f465dffb640 1 -- 172.21.15.81:0/4013859617 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668035070 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f465dffb640 1 -- 172.21.15.81:0/4013859617 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f4668004240 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466c010c00 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f465dffb640 1 -- 172.21.15.81:0/4013859617 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4668004440 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 10 client.25096 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f1ea5ce6c0 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f465dffb640 1 -- 172.21.15.81:0/4013859617 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f466c010c00 con 0x55f1ea5b1080 2024-09-12T12:18:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f465dffb640 1 -- 172.21.15.81:0/4013859617 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f466804c020 con 0x55f1ea5b1080 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 10 client.25096 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 10 client.25096 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 20 client.25096 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.623+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea5cfb90 0x55f1ea5d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.624+0000 7f467f0aa740 4 client.25096 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.624+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1ea5239d0 con 0x55f1ea5cfb90 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.624+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea5cfb90 0x55f1ea5d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.624+0000 7f4675d9b640 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea5cfb90 0x55f1ea5d1fa0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28d3ddb3b7b19d90 server_cookie=3f222cb1bcc0c583 in_seq=0 out_seq=0 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.624+0000 7f465dffb640 10 client.25096 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f465dffb640 1 -- 172.21.15.81:0/4013859617 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1ea5239d0 con 0x55f1ea5cfb90 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f465dffb640 10 client.25096 handle_command_reply: tid=0 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 client.25096 shutdown 2024-09-12T12:18:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 msgr2=0x55f1ea5b8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5b8c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46680096c0 tx=0x7f46680319d0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 shutdown_connections 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea5cfb90 0x55f1ea5d1fa0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5bb940 0x55f1ea5b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5b8c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 --2- 172.21.15.81:0/4013859617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 >> 172.21.15.81:0/4013859617 conn(0x55f1ea5accf0 msgr2=0x55f1ea5b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f465dffb640 0 client.25096 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 shutdown_connections 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 1 -- 172.21.15.81:0/4013859617 wait complete. 2024-09-12T12:18:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.625+0000 7f467f0aa740 20 client.25096 trim_cache size 0 max 16384 2024-09-12T12:18:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 Processor -- start 2024-09-12T12:18:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 -- start start 2024-09-12T12:18:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5d7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46781ab3f0 con 0x55f1ea5b0760 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46781acff0 con 0x55f1ea5bb940 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.642+0000 7f467f0aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f46781abac0 con 0x55f1ea5b1080 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36900/0 (socket says 172.21.15.81:36900) 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 -- 172.21.15.81:0/223499562 learned_addr learned my addr 172.21.15.81:0/223499562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f467659c640 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 -- 172.21.15.81:0/223499562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 msgr2=0x55f1ea5abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 -- 172.21.15.81:0/223499562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 msgr2=0x55f1ea5d7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5d7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 -- 172.21.15.81:0/223499562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ea5acb20 con 0x55f1ea5b0760 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f4675d9b640 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b9010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f466c01efd0 tx=0x7f466c01ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897c7235ec6cfe2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f465ffff640 1 -- 172.21.15.81:0/223499562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c030070 con 0x55f1ea5b0760 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f465ffff640 1 -- 172.21.15.81:0/223499562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f466c016070 con 0x55f1ea5b0760 2024-09-12T12:18:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.643+0000 7f465ffff640 1 -- 172.21.15.81:0/223499562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466c01e620 con 0x55f1ea5b0760 2024-09-12T12:18:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 -- 172.21.15.81:0/223499562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 msgr2=0x55f1ea5b9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b9010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f466c01efd0 tx=0x7f466c01ed70 comp rx=0 tx=0).stop 2024-09-12T12:18:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 -- 172.21.15.81:0/223499562 shutdown_connections 2024-09-12T12:18:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5d7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- 172.21.15.81:0/223499562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5b9010 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 -- 172.21.15.81:0/223499562 >> 172.21.15.81:0/223499562 conn(0x55f1ea5accf0 msgr2=0x55f1ea5ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 -- 172.21.15.81:0/223499562 shutdown_connections 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 -- 172.21.15.81:0/223499562 wait complete. 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 -- start start 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 Processor -- start 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5c8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.644+0000 7f467f0aa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467f0aa740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46781ac860 con 0x55f1ea5b0760 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467f0aa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46781ac190 con 0x55f1ea5bb940 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467f0aa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f46781a9410 con 0x55f1ea5b1080 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467f0aa740 10 client.0 _ll_register_callbacks cb 0x7f4668031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f4675d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36916/0 (socket says 172.21.15.81:36916) 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f4675d9b640 1 -- 172.21.15.81:0/46872851 learned_addr learned my addr 172.21.15.81:0/46872851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f4675d9b640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 -- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 msgr2=0x55f1ea5c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 -- 172.21.15.81:0/46872851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 msgr2=0x55f1ea5c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 -- 172.21.15.81:0/46872851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ea5bda00 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f4675d9b640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467659c640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5c8240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4668009900 tx=0x7f4668031540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=465b4ed00fba86e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f465dffb640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f465dffb640 1 -- 172.21.15.81:0/46872851 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668035040 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f466c016070 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.645+0000 7f465dffb640 1 -- 172.21.15.81:0/46872851 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f4668005200 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f465dffb640 1 -- 172.21.15.81:0/46872851 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4668009520 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 10 client.25102 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f1ea63ad00 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f465dffb640 1 -- 172.21.15.81:0/46872851 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f466c016070 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f465dffb640 1 -- 172.21.15.81:0/46872851 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f466804c040 con 0x55f1ea5b1080 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 10 client.25102 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 10 client.25102 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:18:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 20 client.25102 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea63b600 0x55f1ea63da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 4 client.25102 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}] 2024-09-12T12:18:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.4, "await_for": 45.0}) -- 0x55f1ea51dd20 con 0x55f1ea63b600 2024-09-12T12:18:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.646+0000 7f4675d9b640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea63b600 0x55f1ea63da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.647+0000 7f4675d9b640 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea63b600 0x55f1ea63da20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7f1c9b5661fff6e server_cookie=3da9615cffc97e6e in_seq=0 out_seq=0 2024-09-12T12:18:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:19.647+0000 7f465dffb640 10 client.25102 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:19.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:19 smithi173 ceph-mon[35326]: pgmap v59: 97 pgs: 97 active+clean; 164 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 1.29k op/s 2024-09-12T12:18:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:19 smithi103 ceph-mon[35094]: pgmap v59: 97 pgs: 97 active+clean; 164 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.5 MiB/s wr, 1.29k op/s 2024-09-12T12:18:21.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:21 smithi173 ceph-mon[35326]: pgmap v60: 97 pgs: 97 active+clean; 164 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 687 op/s 2024-09-12T12:18:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:21 smithi103 ceph-mon[35094]: pgmap v60: 97 pgs: 97 active+clean; 164 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 687 op/s 2024-09-12T12:18:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f465dffb640 1 -- 172.21.15.81:0/46872851 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55f1ea51dd20 con 0x55f1ea63b600 2024-09-12T12:18:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f465dffb640 10 client.25102 handle_command_reply: tid=0 2024-09-12T12:18:21.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 client.25102 shutdown 2024-09-12T12:18:21.798 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:21 smithi081 ceph-mon[30948]: pgmap v60: 97 pgs: 97 active+clean; 164 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 687 op/s 2024-09-12T12:18:21.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 msgr2=0x55f1ea5c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5c8240 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4668009900 tx=0x7f4668031540 comp rx=0 tx=0).stop 2024-09-12T12:18:21.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 shutdown_connections 2024-09-12T12:18:21.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55f1ea63b600 0x55f1ea63da20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f1ea5bb940 0x55f1ea5c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f1ea5b1080 0x55f1ea5c8240 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f465dffb640 0 client.25102 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 --2- 172.21.15.81:0/46872851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1ea5b0760 0x55f1ea5c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 >> 172.21.15.81:0/46872851 conn(0x55f1ea5accf0 msgr2=0x55f1ea5abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 shutdown_connections 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 1 -- 172.21.15.81:0/46872851 wait complete. 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.798+0000 7f467f0aa740 20 client.25102 trim_cache size 0 max 16384 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:18:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 30, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 6, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "6bd02cee": { 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 6, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T12:18:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 133.4, 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:21.802 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f46600a2cf0 msgr2=0x7f46600a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f46600a2cf0 0x7f46600a51b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f467000ca80 tx=0x7f467006af70 comp rx=0 tx=0).stop 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 msgr2=0x7f467819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 0x7f467819ce00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f467000cab0 tx=0x7f467000cf70 comp rx=0 tx=0).stop 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 shutdown_connections 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f46600a2cf0 0x7f46600a51b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4678102ef0 0x7f467819ce00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4678102570 0x7f4678198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 --2- 172.21.15.81:0/1081402587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4678100e20 0x7f4678198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 >> 172.21.15.81:0/1081402587 conn(0x7f46780fc7d0 msgr2=0x7f4678106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 shutdown_connections 2024-09-12T12:18:21.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:21.799+0000 7f467ccd1640 1 -- 172.21.15.81:0/1081402587 wait complete. 2024-09-12T12:18:22.458 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6bd02cee', quiesce took 5.8 seconds. Will release after: 7.6000000000000005 2024-09-12T12:18:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:23 smithi173 ceph-mon[35326]: pgmap v61: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 1.05k op/s 2024-09-12T12:18:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:23 smithi103 ceph-mon[35094]: pgmap v61: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 1.05k op/s 2024-09-12T12:18:23.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:23 smithi081 ceph-mon[30948]: pgmap v61: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 1.05k op/s 2024-09-12T12:18:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 -- 172.21.15.81:0/2965985413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 msgr2=0x7fb3d810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2965985413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d810d8a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0009cd0 tx=0x7fb3d002a8e0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 -- 172.21.15.81:0/2965985413 shutdown_connections 2024-09-12T12:18:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2965985413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d810d8a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2965985413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3d81009d0 0x7fb3d8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2965985413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d81069e0 0x7fb3d8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 -- 172.21.15.81:0/2965985413 >> 172.21.15.81:0/2965985413 conn(0x7fb3d80fc6f0 msgr2=0x7fb3d80feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 -- 172.21.15.81:0/2965985413 shutdown_connections 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.584+0000 7fb3dee04640 1 -- 172.21.15.81:0/2965985413 wait complete. 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 Processor -- start 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 -- start start 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d81009d0 0x7fb3d80fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d80fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3d81069e0 0x7fb3d80fd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d8110f40 con 0x7fb3d8101370 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d8110dc0 con 0x7fb3d81069e0 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dee04640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81110c0 con 0x7fb3d81009d0 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d80fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d80fd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43148/0 (socket says 172.21.15.81:43148) 2024-09-12T12:18:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 -- 172.21.15.81:0/2800265324 learned_addr learned my addr 172.21.15.81:0/2800265324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3d81069e0 0x7fb3d80fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d81009d0 0x7fb3d80fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 -- 172.21.15.81:0/2800265324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d81009d0 msgr2=0x7fb3d80fcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d81009d0 0x7fb3d80fcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 -- 172.21.15.81:0/2800265324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3d81069e0 msgr2=0x7fb3d80fd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3d81069e0 0x7fb3d80fd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.585+0000 7fb3cffff640 1 -- 172.21.15.81:0/2800265324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d81a6920 con 0x7fb3d8101370 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.586+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d80fd0e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800d950 tx=0x7fb3c800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.586+0000 7fb3cdffb640 1 -- 172.21.15.81:0/2800265324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8017070 con 0x7fb3d8101370 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.586+0000 7fb3cdffb640 1 -- 172.21.15.81:0/2800265324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3c800de80 con 0x7fb3d8101370 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.586+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d81a6c10 con 0x7fb3d8101370 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.586+0000 7fb3cdffb640 1 -- 172.21.15.81:0/2800265324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800f620 con 0x7fb3d8101370 2024-09-12T12:18:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.586+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d81a7160 con 0x7fb3d8101370 2024-09-12T12:18:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.588+0000 7fb3cdffb640 1 -- 172.21.15.81:0/2800265324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fb3c8009c30 con 0x7fb3d8101370 2024-09-12T12:18:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 Processor -- start 2024-09-12T12:18:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 -- start start 2024-09-12T12:18:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3cdffb640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fb3c00a2da0 0x7fb3c00a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddaaaf0 0x55b50ddaaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b50dd0f2f0 con 0x55b50ddab410 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b50dcb7270 con 0x55b50ddb5cb0 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b50dd0b2b0 con 0x55b50ddaaaf0 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fb3c00a2da0 0x7fb3c00a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3cdffb640 1 -- 172.21.15.81:0/2800265324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fb3c80cf0b0 con 0x7fb3d8101370 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43158/0 (socket says 172.21.15.81:43158) 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3cffff640 1 -- 172.21.15.81:0/2718809768 learned_addr learned my addr 172.21.15.81:0/2718809768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.589+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddaaaf0 0x55b50ddaaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3cffff640 1 -- 172.21.15.81:0/2718809768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddaaaf0 msgr2=0x55b50ddaaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddaaaf0 0x55b50ddaaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3cffff640 1 -- 172.21.15.81:0/2718809768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddb5cb0 msgr2=0x55b50ddb80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3cffff640 1 -- 172.21.15.81:0/2718809768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50dcb6340 con 0x55b50ddab410 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fb3c00a2da0 0x7fb3c00a5260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0006010 tx=0x7fb3d0031720 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb5770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80cc870 tx=0x7fb3c809b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bed152ec47aeae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3beffd640 1 -- 172.21.15.81:0/2718809768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8020070 con 0x55b50ddab410 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3beffd640 1 -- 172.21.15.81:0/2718809768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3c80a4250 con 0x55b50ddab410 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.590+0000 7fb3beffd640 1 -- 172.21.15.81:0/2718809768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8082b00 con 0x55b50ddab410 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2718809768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 msgr2=0x55b50ddb5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb5770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80cc870 tx=0x7fb3c809b250 comp rx=0 tx=0).stop 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2718809768 shutdown_connections 2024-09-12T12:18:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb5770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2718809768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddaaaf0 0x55b50ddaaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2718809768 >> 172.21.15.81:0/2718809768 conn(0x55b50dda7060 msgr2=0x55b50dda7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2718809768 shutdown_connections 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2718809768 wait complete. 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 -- start start 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.591+0000 7fb3e1c79740 1 Processor -- start 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddb3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b50ddb8880 con 0x55b50ddaaaf0 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b50dc98290 con 0x55b50ddab410 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b50ddb8a00 con 0x55b50ddb5cb0 2024-09-12T12:18:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 10 client.0 _ll_register_callbacks cb 0x55b50dcc9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43170/0 (socket says 172.21.15.81:43170) 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 -- 172.21.15.81:0/435964109 learned_addr learned my addr 172.21.15.81:0/435964109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3cffff640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddb3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 -- 172.21.15.81:0/435964109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 msgr2=0x55b50ddb3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 -- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 msgr2=0x55b50ddb3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddb3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 -- 172.21.15.81:0/435964109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50da22210 con 0x55b50ddaaaf0 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3cffff640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddb3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb2bd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4012800 tx=0x7fb3d4012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a52d8bbc10ea19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3b7fff640 1 -- 172.21.15.81:0/435964109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d401f060 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3b7fff640 1 -- 172.21.15.81:0/435964109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fb3d4010dc0 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.592+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c80a4250 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3b7fff640 1 -- 172.21.15.81:0/435964109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb3d4024440 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 10 client.15657 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b50daee620 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3b7fff640 1 -- 172.21.15.81:0/435964109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3c80a4250 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3b7fff640 1 -- 172.21.15.81:0/435964109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb3d4022020 con 0x55b50ddaaaf0 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 10 client.15657 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 20 client.15657 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50ddc5d90 0x55b50ddc8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 4 client.15657 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b50dd1ca20 con 0x55b50ddc5d90 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.593+0000 7fb3cffff640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50ddc5d90 0x55b50ddc8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.594+0000 7fb3b7fff640 10 client.15657 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.594+0000 7fb3cffff640 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50ddc5d90 0x55b50ddc8230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b5fa5179b57dd0 server_cookie=607592b10c0ea55a in_seq=0 out_seq=0 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.594+0000 7fb3b7fff640 1 -- 172.21.15.81:0/435964109 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b50dd1ca20 con 0x55b50ddc5d90 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.594+0000 7fb3b7fff640 10 client.15657 handle_command_reply: tid=0 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.594+0000 7fb3e1c79740 1 client.15657 shutdown 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 msgr2=0x55b50ddb2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb2bd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4012800 tx=0x7fb3d4012cc0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 shutdown_connections 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50ddc5d90 0x55b50ddc8230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddb3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3b7fff640 0 client.15657 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/435964109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb2bd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 >> 172.21.15.81:0/435964109 conn(0x55b50dda7060 msgr2=0x55b50ddacdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 shutdown_connections 2024-09-12T12:18:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 1 -- 172.21.15.81:0/435964109 wait complete. 2024-09-12T12:18:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.595+0000 7fb3e1c79740 20 client.15657 trim_cache size 0 max 16384 2024-09-12T12:18:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 Processor -- start 2024-09-12T12:18:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 -- start start 2024-09-12T12:18:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddcdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81af8a0 con 0x55b50ddaaaf0 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81b14a0 con 0x55b50ddab410 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.609+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81aff70 con 0x55b50ddb5cb0 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43180/0 (socket says 172.21.15.81:43180) 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 -- 172.21.15.81:0/641993756 learned_addr learned my addr 172.21.15.81:0/641993756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3cffff640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddcdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 -- 172.21.15.81:0/641993756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 msgr2=0x55b50ddce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 -- 172.21.15.81:0/641993756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 msgr2=0x55b50ddcdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddcdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 -- 172.21.15.81:0/641993756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50dda6e90 con 0x55b50ddaaaf0 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3cffff640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddcdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb3480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4001eb0 tx=0x7fb3d4005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9480190e7a07228 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3be7fc640 1 -- 172.21.15.81:0/641993756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4010dc0 con 0x55b50ddaaaf0 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3be7fc640 1 -- 172.21.15.81:0/641993756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3d4022e00 con 0x55b50ddaaaf0 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.610+0000 7fb3be7fc640 1 -- 172.21.15.81:0/641993756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40056b0 con 0x55b50ddaaaf0 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 -- 172.21.15.81:0/641993756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 msgr2=0x55b50ddb3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb3480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4001eb0 tx=0x7fb3d4005b90 comp rx=0 tx=0).stop 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 -- 172.21.15.81:0/641993756 shutdown_connections 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddab410 0x55b50ddcdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/641993756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddaaaf0 0x55b50ddb3480 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 -- 172.21.15.81:0/641993756 >> 172.21.15.81:0/641993756 conn(0x55b50dda7060 msgr2=0x55b50ddb4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 -- 172.21.15.81:0/641993756 shutdown_connections 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 -- 172.21.15.81:0/641993756 wait complete. 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 -- start start 2024-09-12T12:18:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.611+0000 7fb3e1c79740 1 Processor -- start 2024-09-12T12:18:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddaaaf0 0x55b50ddbe370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81b0d10 con 0x55b50ddab410 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81b0640 con 0x55b50ddaaaf0 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d81ad8a0 con 0x55b50ddb5cb0 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 10 client.0 _ll_register_callbacks cb 0x7fb3d400a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43186/0 (socket says 172.21.15.81:43186) 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 -- 172.21.15.81:0/2204843709 learned_addr learned my addr 172.21.15.81:0/2204843709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddaaaf0 0x55b50ddbe370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 -- 172.21.15.81:0/2204843709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 msgr2=0x55b50ddb9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 -- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddaaaf0 msgr2=0x55b50ddbe370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddaaaf0 0x55b50ddbe370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 -- 172.21.15.81:0/2204843709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50dda7cf0 con 0x55b50ddab410 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3dd3a1640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3cffff640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb9690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb3c809b570 tx=0x7fb3c8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2c2ce749c3473f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3b7fff640 1 -- 172.21.15.81:0/2204843709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8020040 con 0x55b50ddab410 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3b7fff640 1 -- 172.21.15.81:0/2204843709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fb3c8082a60 con 0x55b50ddab410 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.612+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3d4022e00 con 0x55b50ddab410 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3b7fff640 1 -- 172.21.15.81:0/2204843709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb3c809b3b0 con 0x55b50ddab410 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 10 client.15663 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b50de30860 con 0x55b50ddab410 2024-09-12T12:18:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3b7fff640 1 -- 172.21.15.81:0/2204843709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3d4022e00 con 0x55b50ddab410 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3b7fff640 1 -- 172.21.15.81:0/2204843709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb3c809aa30 con 0x55b50ddab410 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 10 client.15663 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 20 client.15663 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50de30c60 0x55b50de33050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 4 client.15663 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b50dd16d70 con 0x55b50de30c60 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.613+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50de30c60 0x55b50de33050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.614+0000 7fb3dcba0640 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50de30c60 0x55b50de33050 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5442675cd617d4e9 server_cookie=796d0c8466ef3099 in_seq=0 out_seq=0 2024-09-12T12:18:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.614+0000 7fb3b7fff640 10 client.15663 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:25 smithi173 ceph-mon[35326]: pgmap v62: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 712 op/s 2024-09-12T12:18:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:25 smithi103 ceph-mon[35094]: pgmap v62: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 712 op/s 2024-09-12T12:18:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3b7fff640 1 -- 172.21.15.81:0/2204843709 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b50dd16d70 con 0x55b50de30c60 2024-09-12T12:18:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3b7fff640 10 client.15663 handle_command_reply: tid=0 2024-09-12T12:18:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 client.15663 shutdown 2024-09-12T12:18:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 msgr2=0x55b50ddb9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb9690 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb3c809b570 tx=0x7fb3c8005f90 comp rx=0 tx=0).stop 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 shutdown_connections 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55b50de30c60 0x55b50de33050 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3b7fff640 0 client.15663 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b50ddb5cb0 0x55b50ddb9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b50ddab410 0x55b50ddb9690 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 --2- 172.21.15.81:0/2204843709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b50ddaaaf0 0x55b50ddbe370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 >> 172.21.15.81:0/2204843709 conn(0x55b50dda7060 msgr2=0x55b50ddac550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 shutdown_connections 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 1 -- 172.21.15.81:0/2204843709 wait complete. 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.705+0000 7fb3e1c79740 20 client.15663 trim_cache size 0 max 16384 2024-09-12T12:18:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:18:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:18:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:18:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:18:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fb3c00a2da0 msgr2=0x7fb3c00a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fb3c00a2da0 0x7fb3c00a5260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0006010 tx=0x7fb3d0031720 comp rx=0 tx=0).stop 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 msgr2=0x7fb3d80fd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d80fd0e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800d950 tx=0x7fb3c800dd50 comp rx=0 tx=0).stop 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 shutdown_connections 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fb3c00a2da0 0x7fb3c00a5260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3d81069e0 0x7fb3d80fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d8101370 0x7fb3d80fd0e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 --2- 172.21.15.81:0/2800265324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d81009d0 0x7fb3d80fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 >> 172.21.15.81:0/2800265324 conn(0x7fb3d80fc6f0 msgr2=0x7fb3d806a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 shutdown_connections 2024-09-12T12:18:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:25.706+0000 7fb3dee04640 1 -- 172.21.15.81:0/2800265324 wait complete. 2024-09-12T12:18:25.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:25 smithi081 ceph-mon[30948]: pgmap v62: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 712 op/s 2024-09-12T12:18:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:27 smithi173 ceph-mon[35326]: pgmap v63: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 712 op/s 2024-09-12T12:18:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:27 smithi103 ceph-mon[35094]: pgmap v63: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 712 op/s 2024-09-12T12:18:27.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:27 smithi081 ceph-mon[30948]: pgmap v63: 97 pgs: 97 active+clean; 184 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.8 MiB/s wr, 712 op/s 2024-09-12T12:18:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:29 smithi173 ceph-mon[35326]: pgmap v64: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 771 op/s 2024-09-12T12:18:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:29 smithi103 ceph-mon[35094]: pgmap v64: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 771 op/s 2024-09-12T12:18:29.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:29 smithi081 ceph-mon[30948]: pgmap v64: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 771 op/s 2024-09-12T12:18:30.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:18:30.317 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 -- 172.21.15.81:0/3658401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 msgr2=0x7f1180103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 --2- 172.21.15.81:0/3658401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180103110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1170009ca0 tx=0x7f117002a950 comp rx=0 tx=0).stop 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 -- 172.21.15.81:0/3658401587 shutdown_connections 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 --2- 172.21.15.81:0/3658401587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f118010c160 0x7f118010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 --2- 172.21.15.81:0/3658401587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1180103650 0x7f118010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 --2- 172.21.15.81:0/3658401587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180103110 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 -- 172.21.15.81:0/3658401587 >> 172.21.15.81:0/3658401587 conn(0x7f11800fc790 msgr2=0x7f11800febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 -- 172.21.15.81:0/3658401587 shutdown_connections 2024-09-12T12:18:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 -- 172.21.15.81:0/3658401587 wait complete. 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.780+0000 7f118548a640 1 Processor -- start 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 -- start start 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1180103650 0x7f1180100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118010c160 0x7f1180101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1180112080 con 0x7f1180102d30 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1180111f00 con 0x7f1180103650 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f118548a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1180112200 con 0x7f118010c160 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43198/0 (socket says 172.21.15.81:43198) 2024-09-12T12:18:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 -- 172.21.15.81:0/3333533164 learned_addr learned my addr 172.21.15.81:0/3333533164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117e7fc640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1180103650 0x7f1180100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117f7fe640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118010c160 0x7f1180101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 -- 172.21.15.81:0/3333533164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118010c160 msgr2=0x7f1180101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118010c160 0x7f1180101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 -- 172.21.15.81:0/3333533164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1180103650 msgr2=0x7f1180100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1180103650 0x7f1180100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.781+0000 7f117effd640 1 -- 172.21.15.81:0/3333533164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11801a6a20 con 0x7f1180102d30 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.782+0000 7f117effd640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180100990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1170005cc0 tx=0x7f117002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.782+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170034040 con 0x7f1180102d30 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.782+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11801a6cb0 con 0x7f1180102d30 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.782+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1170003e40 con 0x7f1180102d30 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.782+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170039430 con 0x7f1180102d30 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.782+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11801a7190 con 0x7f1180102d30 2024-09-12T12:18:30.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.783+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1180103110 con 0x7f1180102d30 2024-09-12T12:18:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.784+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1170037020 con 0x7f1180102d30 2024-09-12T12:18:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.785+0000 7f1177fff640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f116c0a2d70 0x7f116c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.785+0000 7f117e7fc640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f116c0a2d70 0x7f116c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.785+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f11700f0350 con 0x7f1180102d30 2024-09-12T12:18:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.785+0000 7f117e7fc640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f116c0a2d70 0x7f116c0a5230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1180102420 tx=0x7f116800b2e0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:30.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:30.789+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11700bd090 con 0x7f1180102d30 2024-09-12T12:18:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.009+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f118002d7c0 con 0x7f1180102d30 2024-09-12T12:18:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.010+0000 7f1177fff640 1 -- 172.21.15.81:0/3333533164 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11989 (secure 0 0 0) 0x7f11700bc990 con 0x7f1180102d30 2024-09-12T12:18:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:18:31.011 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":30,"btime":"2024-09-12T12:18:01:322948+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:18:00.528315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:18:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 30 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f116c0a2d70 msgr2=0x7f116c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f116c0a2d70 0x7f116c0a5230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1180102420 tx=0x7f116800b2e0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 msgr2=0x7f1180100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180100990 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1170005cc0 tx=0x7f117002f790 comp rx=0 tx=0).stop 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 shutdown_connections 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f116c0a2d70 0x7f116c0a5230 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f118010c160 0x7f1180101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1180103650 0x7f1180100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 --2- 172.21.15.81:0/3333533164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1180102d30 0x7f1180100990 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 >> 172.21.15.81:0/3333533164 conn(0x7f11800fc790 msgr2=0x7f11800fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 shutdown_connections 2024-09-12T12:18:31.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:31.013+0000 7f118548a640 1 -- 172.21.15.81:0/3333533164 wait complete. 2024-09-12T12:18:31.589 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: pgmap v65: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 422 op/s 2024-09-12T12:18:31.589 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:31.589 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.589 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.589 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.589 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3333533164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:18:31.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:31.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:31.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.618 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id 6bd02cee --release --await' 2024-09-12T12:18:31.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id 6bd02cee --release --await 2024-09-12T12:18:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: pgmap v65: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 422 op/s 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3333533164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:31.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: pgmap v65: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 422 op/s 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3333533164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:18:31.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:18:31.863 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:18:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 -- 172.21.15.81:0/559599752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90103780 msgr2=0x7f8f90107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 --2- 172.21.15.81:0/559599752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90103780 0x7f8f90107bc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8f80009930 tx=0x7f8f8002a420 comp rx=0 tx=0).stop 2024-09-12T12:18:32.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 -- 172.21.15.81:0/559599752 shutdown_connections 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 --2- 172.21.15.81:0/559599752 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90108300 0x7f8f9010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 --2- 172.21.15.81:0/559599752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90103780 0x7f8f90107bc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 --2- 172.21.15.81:0/559599752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f90102dd0 0x7f8f901031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 -- 172.21.15.81:0/559599752 >> 172.21.15.81:0/559599752 conn(0x7f8f900fc7d0 msgr2=0x7f8f900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 -- 172.21.15.81:0/559599752 shutdown_connections 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.321+0000 7f8f97880640 1 -- 172.21.15.81:0/559599752 wait complete. 2024-09-12T12:18:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 Processor -- start 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 -- start start 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f90102dd0 0x7f8f9019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103780 0x7f8f9019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 0x7f8f901985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f90112210 con 0x7f8f90108300 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f90112090 con 0x7f8f90102dd0 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f97880640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f90112390 con 0x7f8f90103780 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 0x7f8f901985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 0x7f8f901985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49694/0 (socket says 172.21.15.81:49694) 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 -- 172.21.15.81:0/2335069578 learned_addr learned my addr 172.21.15.81:0/2335069578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f9561c640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f90102dd0 0x7f8f9019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103780 0x7f8f9019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 -- 172.21.15.81:0/2335069578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103780 msgr2=0x7f8f9019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103780 0x7f8f9019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 -- 172.21.15.81:0/2335069578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f90102dd0 msgr2=0x7f8f9019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f90102dd0 0x7f8f9019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.322+0000 7f8f95e1d640 1 -- 172.21.15.81:0/2335069578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f90198cf0 con 0x7f8f90108300 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.323+0000 7f8f95e1d640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 0x7f8f901985c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800b970 tx=0x7f8f8800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.323+0000 7f8f867fc640 1 -- 172.21.15.81:0/2335069578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88019070 con 0x7f8f90108300 2024-09-12T12:18:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.323+0000 7f8f867fc640 1 -- 172.21.15.81:0/2335069578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f8800cb40 con 0x7f8f90108300 2024-09-12T12:18:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.323+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f90198fe0 con 0x7f8f90108300 2024-09-12T12:18:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.323+0000 7f8f867fc640 1 -- 172.21.15.81:0/2335069578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88007700 con 0x7f8f90108300 2024-09-12T12:18:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.323+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f901a52d0 con 0x7f8f90108300 2024-09-12T12:18:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.325+0000 7f8f867fc640 1 -- 172.21.15.81:0/2335069578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8f8801c070 con 0x7f8f90108300 2024-09-12T12:18:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.325+0000 7f8f99c59740 1 Processor -- start 2024-09-12T12:18:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.325+0000 7f8f99c59740 1 -- start start 2024-09-12T12:18:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fd2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd2880 0x5616f4fe1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f4fe3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f99c59740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616f4f37620 con 0x5616f4fe1650 2024-09-12T12:18:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f99c59740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616f4edee50 con 0x5616f4fd1f60 2024-09-12T12:18:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f99c59740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616f4f335e0 con 0x5616f4fd2880 2024-09-12T12:18:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f867fc640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8f7c0a2cf0 0x7f8f7c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f4fe3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f4fe3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49700/0 (socket says 172.21.15.81:49700) 2024-09-12T12:18:32.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 -- 172.21.15.81:0/826841429 learned_addr learned my addr 172.21.15.81:0/826841429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f95e1d640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8f7c0a2cf0 0x7f8f7c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fd2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f867fc640 1 -- 172.21.15.81:0/2335069578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f8f880ce8c0 con 0x7f8f90108300 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f9561c640 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd2880 0x5616f4fe1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 -- 172.21.15.81:0/826841429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd2880 msgr2=0x5616f4fe1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd2880 0x5616f4fe1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 -- 172.21.15.81:0/826841429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 msgr2=0x5616f4fd2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fd2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 -- 172.21.15.81:0/826841429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616f4ecfd40 con 0x5616f4fe1650 2024-09-12T12:18:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f95e1d640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8f7c0a2cf0 0x7f8f7c0a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f8809afa0 tx=0x7f8f880972b0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.326+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f4fe3a40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006010 tx=0x7f8f800058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453c98e305c1a83c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f7b7fe640 1 -- 172.21.15.81:0/826841429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80035040 con 0x5616f4fe1650 2024-09-12T12:18:32.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f7b7fe640 1 -- 172.21.15.81:0/826841429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f80004030 con 0x5616f4fe1650 2024-09-12T12:18:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f7b7fe640 1 -- 172.21.15.81:0/826841429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80003c60 con 0x5616f4fe1650 2024-09-12T12:18:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 -- 172.21.15.81:0/826841429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 msgr2=0x5616f4fe3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f4fe3a40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8f80006010 tx=0x7f8f800058b0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 -- 172.21.15.81:0/826841429 shutdown_connections 2024-09-12T12:18:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f4fe3a40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd2880 0x5616f4fe1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 --2- 172.21.15.81:0/826841429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fd2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 -- 172.21.15.81:0/826841429 >> 172.21.15.81:0/826841429 conn(0x5616f4fce5f0 msgr2=0x5616f4fce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 -- 172.21.15.81:0/826841429 shutdown_connections 2024-09-12T12:18:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.327+0000 7f8f99c59740 1 -- 172.21.15.81:0/826841429 wait complete. 2024-09-12T12:18:32.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 -- start start 2024-09-12T12:18:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 Processor -- start 2024-09-12T12:18:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fde580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 0x5616f4fdeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5616f4fe4220 con 0x5616f4fd2880 2024-09-12T12:18:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616f4ebff10 con 0x5616f4fd1f60 2024-09-12T12:18:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5616f4fe43a0 con 0x5616f4fe1650 2024-09-12T12:18:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.328+0000 7f8f99c59740 10 client.0 _ll_register_callbacks cb 0x5616f4ee3db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 0x5616f4fdeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 0x5616f4fdeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49704/0 (socket says 172.21.15.81:49704) 2024-09-12T12:18:32.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 -- 172.21.15.81:0/3833842813 learned_addr learned my addr 172.21.15.81:0/3833842813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fde580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 -- 172.21.15.81:0/3833842813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 msgr2=0x5616f4fdf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 -- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 msgr2=0x5616f4fde580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fde580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 -- 172.21.15.81:0/3833842813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616f4c46580 con 0x5616f4fd2880 2024-09-12T12:18:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 0x5616f4fdeac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00ba50 tx=0x7f8f8c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c985754d8c6bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3833842813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c01b440 con 0x5616f4fd2880 2024-09-12T12:18:32.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3833842813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f8f8c01b5e0 con 0x5616f4fd2880 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f80004030 con 0x5616f4fd2880 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3833842813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8f8c01b7e0 con 0x5616f4fd2880 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f99c59740 10 client.15681 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.329+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616f4d10960 con 0x5616f4fd2880 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3833842813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f80004030 con 0x5616f4fd2880 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3833842813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f8f8c023020 con 0x5616f4fd2880 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f99c59740 10 client.15681 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:32.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f99c59740 10 client.15681 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f99c59740 20 client.15681 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f4ff12f0 0x5616f4ff3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f99c59740 4 client.15681 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616f4f44b90 con 0x5616f4ff12f0 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f4ff12f0 0x5616f4ff3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f78ff9640 10 client.15681 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.330+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f4ff12f0 0x5616f4ff3770 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5595abc2545358d server_cookie=dfdcf60347c65da1 in_seq=0 out_seq=0 2024-09-12T12:18:32.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3833842813 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616f4f44b90 con 0x5616f4ff12f0 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f78ff9640 10 client.15681 handle_command_reply: tid=0 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 client.15681 shutdown 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 msgr2=0x5616f4fdeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 0x5616f4fdeac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00ba50 tx=0x7f8f8c00bf10 comp rx=0 tx=0).stop 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 shutdown_connections 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f4ff12f0 0x5616f4ff3770 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd2880 0x5616f4fdeac0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3833842813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd1f60 0x5616f4fde580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 >> 172.21.15.81:0/3833842813 conn(0x5616f4fce5f0 msgr2=0x5616f4fd4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:32.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f78ff9640 0 client.15681 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:32.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 shutdown_connections 2024-09-12T12:18:32.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.331+0000 7f8f99c59740 1 -- 172.21.15.81:0/3833842813 wait complete. 2024-09-12T12:18:32.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.332+0000 7f8f99c59740 20 client.15681 trim_cache size 0 max 16384 2024-09-12T12:18:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 Processor -- start 2024-09-12T12:18:32.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 -- start start 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 0x5616f4ff9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4ff95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901ab590 con 0x5616f4fd1f60 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901ad190 con 0x5616f4fd2880 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f99c59740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901abc60 con 0x5616f4fe1650 2024-09-12T12:18:32.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f94e1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 0x5616f4ff9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f94e1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 0x5616f4ff9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49714/0 (socket says 172.21.15.81:49714) 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.348+0000 7f8f94e1b640 1 -- 172.21.15.81:0/1439161225 learned_addr learned my addr 172.21.15.81:0/1439161225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f9561c640 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4ff95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 -- 172.21.15.81:0/1439161225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 msgr2=0x5616f4fdb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 -- 172.21.15.81:0/1439161225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 msgr2=0x5616f4ff95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4ff95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 -- 172.21.15.81:0/1439161225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616f4fccbb0 con 0x5616f4fd1f60 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 0x5616f4ff9080 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8f800057c0 tx=0x7f8f80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb553790c23d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f7affd640 1 -- 172.21.15.81:0/1439161225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80035040 con 0x5616f4fd1f60 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f7affd640 1 -- 172.21.15.81:0/1439161225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f800042e0 con 0x5616f4fd1f60 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f7affd640 1 -- 172.21.15.81:0/1439161225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80003fe0 con 0x5616f4fd1f60 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f99c59740 1 -- 172.21.15.81:0/1439161225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 msgr2=0x5616f4ff9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.349+0000 7f8f99c59740 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 0x5616f4ff9080 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8f800057c0 tx=0x7f8f80000bc0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- 172.21.15.81:0/1439161225 shutdown_connections 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fe1650 0x5616f4fdb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4ff95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 --2- 172.21.15.81:0/1439161225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fd1f60 0x5616f4ff9080 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- 172.21.15.81:0/1439161225 >> 172.21.15.81:0/1439161225 conn(0x5616f4fce5f0 msgr2=0x5616f4fdce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- 172.21.15.81:0/1439161225 shutdown_connections 2024-09-12T12:18:32.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- 172.21.15.81:0/1439161225 wait complete. 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- start start 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 Processor -- start 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd1f60 0x5616f4fe5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4fe60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f505b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901aca00 con 0x5616f4fe1650 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901ac330 con 0x5616f4fd2880 2024-09-12T12:18:32.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901a9590 con 0x5616f4fd1f60 2024-09-12T12:18:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.350+0000 7f8f99c59740 10 client.0 _ll_register_callbacks cb 0x7f8f8c0044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f94e1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f505b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f94e1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f505b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49720/0 (socket says 172.21.15.81:49720) 2024-09-12T12:18:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f94e1b640 1 -- 172.21.15.81:0/3426338216 learned_addr learned my addr 172.21.15.81:0/3426338216 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4fe60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd1f60 0x5616f4fe5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 -- 172.21.15.81:0/3426338216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd1f60 msgr2=0x5616f4fe5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd1f60 0x5616f4fe5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 -- 172.21.15.81:0/3426338216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 msgr2=0x5616f505b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f505b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 -- 172.21.15.81:0/3426338216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616f505b5c0 con 0x5616f4fd2880 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f505b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f9561c640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4fe60b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c025de0 tx=0x7f8f8c00b5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e5c3e1dfab40e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3426338216 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c01bb80 con 0x5616f4fd2880 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f800042e0 con 0x5616f4fd2880 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3426338216 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f8f8c01bd20 con 0x5616f4fd2880 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3426338216 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8f8c005070 con 0x5616f4fd2880 2024-09-12T12:18:32.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f99c59740 10 client.25196 fetch_fsmap learned FSMap version 30 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.351+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616f505c8e0 con 0x5616f4fd2880 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3426338216 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f800042e0 con 0x5616f4fd2880 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3426338216 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f8f8c023030 con 0x5616f4fd2880 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f99c59740 10 client.25196 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f99c59740 10 client.25196 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f99c59740 20 client.25196 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f505d1a0 0x5616f505f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f99c59740 4 client.25196 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6bd02cee", "release": true, "await": true}] 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6bd02cee", "release": true, "await": true}) -- 0x5616f4f3f0a0 con 0x5616f505d1a0 2024-09-12T12:18:32.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f505d1a0 0x5616f505f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:32.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f78ff9640 10 client.25196 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:32.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.352+0000 7f8f94e1b640 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f505d1a0 0x5616f505f5c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996c186d29c18112 server_cookie=b0d4b7eaf79d2d81 in_seq=0 out_seq=0 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.492+0000 7f8f78ff9640 1 -- 172.21.15.81:0/3426338216 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5616f4f3f0a0 con 0x5616f505d1a0 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.492+0000 7f8f78ff9640 10 client.25196 handle_command_reply: tid=0 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.492+0000 7f8f99c59740 1 client.25196 shutdown 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 msgr2=0x5616f4fe60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4fe60b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c025de0 tx=0x7f8f8c00b5e0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 shutdown_connections 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5616f505d1a0 0x5616f505f5c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616f4fe1650 0x5616f505b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616f4fd2880 0x5616f4fe60b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f78ff9640 0 client.25196 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 --2- 172.21.15.81:0/3426338216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5616f4fd1f60 0x5616f4fe5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 >> 172.21.15.81:0/3426338216 conn(0x5616f4fce5f0 msgr2=0x5616f4fde4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 shutdown_connections 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 1 -- 172.21.15.81:0/3426338216 wait complete. 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.493+0000 7f8f99c59740 20 client.25196 trim_cache size 0 max 16384 2024-09-12T12:18:32.496 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:18:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 30, 2024-09-12T12:18:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:18:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 8, 2024-09-12T12:18:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T12:18:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "6bd02cee": { 2024-09-12T12:18:32.497 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 8, 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 133.4, 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T12:18:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:18:32.499 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8f7c0a2cf0 msgr2=0x7f8f7c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8f7c0a2cf0 0x7f8f7c0a51b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8f8809afa0 tx=0x7f8f880972b0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 msgr2=0x7f8f901985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 0x7f8f901985c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800b970 tx=0x7f8f8800be30 comp rx=0 tx=0).stop 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 shutdown_connections 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8f7c0a2cf0 0x7f8f7c0a51b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f90108300 0x7f8f901985c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103780 0x7f8f9019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 --2- 172.21.15.81:0/2335069578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f90102dd0 0x7f8f9019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:32.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 >> 172.21.15.81:0/2335069578 conn(0x7f8f900fc7d0 msgr2=0x7f8f901063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:32.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 shutdown_connections 2024-09-12T12:18:32.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:32.494+0000 7f8f97880640 1 -- 172.21.15.81:0/2335069578 wait complete. 2024-09-12T12:18:32.501 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2024-09-12T12:18:33.348 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar c linux-4.0.5 2024-09-12T12:18:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:33 smithi173 ceph-mon[35326]: pgmap v66: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 428 op/s 2024-09-12T12:18:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:33 smithi103 ceph-mon[35094]: pgmap v66: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 428 op/s 2024-09-12T12:18:33.702 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:33 smithi081 ceph-mon[30948]: pgmap v66: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 428 op/s 2024-09-12T12:18:33.937 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -rf linux-4.0.5 2024-09-12T12:18:33.991 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6bd02cee', total seconds elapsed: 17.3 2024-09-12T12:18:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:35 smithi173 ceph-mon[35326]: pgmap v67: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 146 KiB/s wr, 64 op/s 2024-09-12T12:18:35.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:35 smithi103 ceph-mon[35094]: pgmap v67: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 146 KiB/s wr, 64 op/s 2024-09-12T12:18:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:35 smithi081 ceph-mon[30948]: pgmap v67: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 146 KiB/s wr, 64 op/s 2024-09-12T12:18:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:37 smithi173 ceph-mon[35326]: pgmap v68: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 146 KiB/s wr, 64 op/s 2024-09-12T12:18:37.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:37 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:37 smithi103 ceph-mon[35094]: pgmap v68: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 146 KiB/s wr, 64 op/s 2024-09-12T12:18:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:37 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:37.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:37 smithi081 ceph-mon[30948]: pgmap v68: 97 pgs: 97 active+clean; 169 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 146 KiB/s wr, 64 op/s 2024-09-12T12:18:37.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:37 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:38.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.795+0000 7f22ecf72640 1 -- 172.21.15.81:0/4068939654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8030b10 con 0x7f22e81011e0 2024-09-12T12:18:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 -- 172.21.15.81:0/4068939654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e81011e0 msgr2=0x7f22e8104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 --2- 172.21.15.81:0/4068939654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e81011e0 0x7f22e8104dc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f22d800aa10 tx=0x7f22d802b720 comp rx=0 tx=0).stop 2024-09-12T12:18:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 -- 172.21.15.81:0/4068939654 shutdown_connections 2024-09-12T12:18:38.796 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 --2- 172.21.15.81:0/4068939654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8105520 0x7f22e810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 --2- 172.21.15.81:0/4068939654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e81011e0 0x7f22e8104dc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 --2- 172.21.15.81:0/4068939654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e8100830 0x7f22e8100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 -- 172.21.15.81:0/4068939654 >> 172.21.15.81:0/4068939654 conn(0x7f22e8075ec0 msgr2=0x7f22e80762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 -- 172.21.15.81:0/4068939654 shutdown_connections 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 -- 172.21.15.81:0/4068939654 wait complete. 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.796+0000 7f22f01d8640 1 Processor -- start 2024-09-12T12:18:38.797 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 -- start start 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8100830 0x7f22e81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e81011e0 0x7f22e81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 0x7f22e819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810fe10 con 0x7f22e8105520 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810fc90 con 0x7f22e8100830 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22e810ff90 con 0x7f22e81011e0 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 0x7f22e819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 0x7f22e819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49740/0 (socket says 172.21.15.81:49740) 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 -- 172.21.15.81:0/2069271789 learned_addr learned my addr 172.21.15.81:0/2069271789 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:38.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ed773640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e81011e0 0x7f22e81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22edf74640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8100830 0x7f22e81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 -- 172.21.15.81:0/2069271789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e81011e0 msgr2=0x7f22e81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e81011e0 0x7f22e81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 -- 172.21.15.81:0/2069271789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8100830 msgr2=0x7f22e81984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8100830 0x7f22e81984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 -- 172.21.15.81:0/2069271789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e819d4a0 con 0x7f22e8105520 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22edf74640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8100830 0x7f22e81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22ee775640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 0x7f22e819cd70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f22e000efd0 tx=0x7f22e000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22deffd640 1 -- 172.21.15.81:0/2069271789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0003b70 con 0x7f22e8105520 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22deffd640 1 -- 172.21.15.81:0/2069271789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22e0003d10 con 0x7f22e8105520 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e819d790 con 0x7f22e8105520 2024-09-12T12:18:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22deffd640 1 -- 172.21.15.81:0/2069271789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0010a90 con 0x7f22e8105520 2024-09-12T12:18:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.797+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e81a5020 con 0x7f22e8105520 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.800+0000 7f22f3048740 1 Processor -- start 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.800+0000 7f22deffd640 1 -- 172.21.15.81:0/2069271789 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f22e0004020 con 0x7f22e8105520 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 -- start start 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 0x555e38985ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38986410 0x555e38990770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e389930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e388ea2f0 con 0x555e38985af0 2024-09-12T12:18:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555e38892270 con 0x555e38990cb0 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22f3048740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555e388e62b0 con 0x555e38986410 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 0x555e38985ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 0x555e38985ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49752/0 (socket says 172.21.15.81:49752) 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 -- 172.21.15.81:0/501494058 learned_addr learned my addr 172.21.15.81:0/501494058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22edf74640 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38986410 0x555e38990770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e389930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 -- 172.21.15.81:0/501494058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38986410 msgr2=0x555e38990770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38986410 0x555e38990770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 -- 172.21.15.81:0/501494058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 msgr2=0x555e389930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e389930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 -- 172.21.15.81:0/501494058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e38891340 con 0x555e38985af0 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22deffd640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f22d40a2da0 0x7f22d40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22edf74640 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38986410 0x555e38990770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22ed773640 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 0x555e38985ed0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005dc0 tx=0x7f22d8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f931e97192e6610e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.801+0000 7f22edf74640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f22d40a2da0 0x7f22d40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22deffd640 1 -- 172.21.15.81:0/2069271789 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f22e00cf870 con 0x7f22e8105520 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22d3fff640 1 -- 172.21.15.81:0/501494058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8036040 con 0x555e38985af0 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22d3fff640 1 -- 172.21.15.81:0/501494058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22d8030a90 con 0x555e38985af0 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22d3fff640 1 -- 172.21.15.81:0/501494058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004750 con 0x555e38985af0 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22f3048740 1 -- 172.21.15.81:0/501494058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 msgr2=0x555e38985ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22edf74640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f22d40a2da0 0x7f22d40a5260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x555e38982ec0 tx=0x7f22e4005f90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.802+0000 7f22f3048740 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 0x555e38985ed0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005dc0 tx=0x7f22d8005d50 comp rx=0 tx=0).stop 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- 172.21.15.81:0/501494058 shutdown_connections 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e389930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38986410 0x555e38990770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 --2- 172.21.15.81:0/501494058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38985af0 0x555e38985ed0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- 172.21.15.81:0/501494058 >> 172.21.15.81:0/501494058 conn(0x555e38982060 msgr2=0x555e38982440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- 172.21.15.81:0/501494058 shutdown_connections 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- 172.21.15.81:0/501494058 wait complete. 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- start start 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 Processor -- start 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e3898db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e3898e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555e38993880 con 0x555e38986410 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555e38873290 con 0x555e38990cb0 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555e38993a00 con 0x555e38985af0 2024-09-12T12:18:38.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.803+0000 7f22f3048740 10 client.0 _ll_register_callbacks cb 0x555e388a4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49766/0 (socket says 172.21.15.81:49766) 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 -- 172.21.15.81:0/4214063295 learned_addr learned my addr 172.21.15.81:0/4214063295 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22edf74640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e3898db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ee775640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e3898e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 -- 172.21.15.81:0/4214063295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 msgr2=0x555e3898db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e3898db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 -- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 msgr2=0x555e3898e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e3898e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 -- 172.21.15.81:0/4214063295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e385fd210 con 0x555e38986410 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ee775640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e3898e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22edf74640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e3898db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22ed773640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f22d80056a0 tx=0x7f22d8030c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2327fe4ea0b2558d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22d17fa640 1 -- 172.21.15.81:0/4214063295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8036030 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d8030a90 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22d17fa640 1 -- 172.21.15.81:0/4214063295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f22d8004230 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22d17fa640 1 -- 172.21.15.81:0/4214063295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f22d8005850 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22f3048740 10 client.15699 fetch_fsmap learned FSMap version 31 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.804+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555e386c9620 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22d17fa640 1 -- 172.21.15.81:0/4214063295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22d8030a90 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22d17fa640 1 -- 172.21.15.81:0/4214063295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f22d800b040 con 0x555e38986410 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22f3048740 10 client.15699 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22f3048740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22f3048740 20 client.15699 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22f3048740 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e389a0ab0 0x555e389a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22f3048740 4 client.15699 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e388f7a20 con 0x555e389a0ab0 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.805+0000 7f22edf74640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e389a0ab0 0x555e389a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22edf74640 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e389a0ab0 0x555e389a2ea0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664302d259d1f7d7 server_cookie=f15ac66cb7caaa91 in_seq=0 out_seq=0 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22d17fa640 10 client.15699 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22d17fa640 1 -- 172.21.15.81:0/4214063295 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e388f7a20 con 0x555e389a0ab0 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22d17fa640 10 client.15699 handle_command_reply: tid=0 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 client.15699 shutdown 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 msgr2=0x555e3898e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f22d80056a0 tx=0x7f22d8030c40 comp rx=0 tx=0).stop 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 shutdown_connections 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e389a0ab0 0x555e389a2ea0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38990cb0 0x555e3898e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e0a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22d17fa640 0 client.15699 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.806+0000 7f22f3048740 1 --2- 172.21.15.81:0/4214063295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e3898db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.807+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 >> 172.21.15.81:0/4214063295 conn(0x555e38982060 msgr2=0x555e38987dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.807+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 shutdown_connections 2024-09-12T12:18:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.807+0000 7f22f3048740 1 -- 172.21.15.81:0/4214063295 wait complete. 2024-09-12T12:18:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.807+0000 7f22f3048740 20 client.15699 trim_cache size 0 max 16384 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.821+0000 7f22f3048740 1 Processor -- start 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.821+0000 7f22f3048740 1 -- start start 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22f3048740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 0x555e38988560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22f3048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22f3048740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38990cb0 0x555e3898fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22f3048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81ad620 con 0x555e38986410 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22f3048740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81af280 con 0x555e38985af0 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22f3048740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81add20 con 0x555e38990cb0 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22edf74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 0x555e38988560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ee775640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38990cb0 0x555e3898fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22edf74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 0x555e38988560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:34052/0 (socket says 172.21.15.81:34052) 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22edf74640 1 -- 172.21.15.81:0/2335421800 learned_addr learned my addr 172.21.15.81:0/2335421800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 -- 172.21.15.81:0/2335421800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38990cb0 msgr2=0x555e3898fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38990cb0 0x555e3898fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 -- 172.21.15.81:0/2335421800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 msgr2=0x555e38988560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 0x555e38988560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 -- 172.21.15.81:0/2335421800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e38986240 con 0x555e38986410 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22edf74640 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 0x555e38988560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22ed773640 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e410 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f22d8004aa0 tx=0x7f22d8005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39a6583ac970c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22d37fe640 1 -- 172.21.15.81:0/2335421800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8057030 con 0x555e38986410 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22d37fe640 1 -- 172.21.15.81:0/2335421800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22d8005850 con 0x555e38986410 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.822+0000 7f22d37fe640 1 -- 172.21.15.81:0/2335421800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004230 con 0x555e38986410 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 -- 172.21.15.81:0/2335421800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 msgr2=0x555e3898e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e410 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f22d8004aa0 tx=0x7f22d8005d50 comp rx=0 tx=0).stop 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 -- 172.21.15.81:0/2335421800 shutdown_connections 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38990cb0 0x555e3898fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38986410 0x555e3898e410 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 --2- 172.21.15.81:0/2335421800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38985af0 0x555e38988560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 -- 172.21.15.81:0/2335421800 >> 172.21.15.81:0/2335421800 conn(0x555e38982060 msgr2=0x555e3898f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 -- 172.21.15.81:0/2335421800 shutdown_connections 2024-09-12T12:18:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 -- 172.21.15.81:0/2335421800 wait complete. 2024-09-12T12:18:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.823+0000 7f22f3048740 1 -- start start 2024-09-12T12:18:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 Processor -- start 2024-09-12T12:18:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e38994270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 0x555e389947b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 0x555e38a09460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81aeaf0 con 0x555e38990cb0 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81ae420 con 0x555e38986410 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81ab620 con 0x555e38985af0 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22f3048740 10 client.0 _ll_register_callbacks cb 0x7f22e40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ee775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 0x555e38a09460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 0x555e389947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 0x555e389947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:34068/0 (socket says 172.21.15.81:34068) 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ee775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 0x555e38a09460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49792/0 (socket says 172.21.15.81:49792) 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 -- 172.21.15.81:0/2874720209 learned_addr learned my addr 172.21.15.81:0/2874720209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22edf74640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e38994270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 -- 172.21.15.81:0/2874720209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 msgr2=0x555e38994270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e38994270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 -- 172.21.15.81:0/2874720209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 msgr2=0x555e38a09460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 0x555e38a09460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ed773640 1 -- 172.21.15.81:0/2874720209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e38a099a0 con 0x555e38986410 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.824+0000 7f22ee775640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 0x555e38a09460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22ed773640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 0x555e389947b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22d8031040 tx=0x7f22d80052d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8368df10aa23d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22d17fa640 1 -- 172.21.15.81:0/2874720209 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8057040 con 0x555e38986410 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d8005850 con 0x555e38986410 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22d17fa640 1 -- 172.21.15.81:0/2874720209 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f22d800d000 con 0x555e38986410 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22d17fa640 1 -- 172.21.15.81:0/2874720209 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f22d8069050 con 0x555e38986410 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 10 client.25211 fetch_fsmap learned FSMap version 31 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555e38a0ac80 con 0x555e38986410 2024-09-12T12:18:38.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22d17fa640 1 -- 172.21.15.81:0/2874720209 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22d8005850 con 0x555e38986410 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22d17fa640 1 -- 172.21.15.81:0/2874720209 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f22d80035f0 con 0x555e38986410 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 10 client.25211 fetch_fsmap finished waiting for FSMap version 31 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 10 client.25211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 20 client.25211 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e38a0b3d0 0x555e38a0d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 4 client.25211 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.825+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555e388f1d70 con 0x555e38a0b3d0 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.826+0000 7f22edf74640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e38a0b3d0 0x555e38a0d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.826+0000 7f22d17fa640 10 client.25211 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.826+0000 7f22edf74640 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e38a0b3d0 0x555e38a0d7f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293b8ffce5e6c3ba server_cookie=e5233924c26fef39 in_seq=0 out_seq=0 2024-09-12T12:18:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.931+0000 7f22d17fa640 1 -- 172.21.15.81:0/2874720209 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555e388f1d70 con 0x555e38a0b3d0 2024-09-12T12:18:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.931+0000 7f22d17fa640 10 client.25211 handle_command_reply: tid=0 2024-09-12T12:18:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.931+0000 7f22f3048740 1 client.25211 shutdown 2024-09-12T12:18:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.931+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 msgr2=0x555e389947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.931+0000 7f22f3048740 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 0x555e389947b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22d8031040 tx=0x7f22d80052d0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 shutdown_connections 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x555e38a0b3d0 0x555e38a0d7f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e38990cb0 0x555e38a09460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555e38986410 0x555e389947b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22d17fa640 0 client.25211 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 --2- 172.21.15.81:0/2874720209 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555e38985af0 0x555e38994270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 >> 172.21.15.81:0/2874720209 conn(0x555e38982060 msgr2=0x555e389811c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 shutdown_connections 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 1 -- 172.21.15.81:0/2874720209 wait complete. 2024-09-12T12:18:38.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f3048740 20 client.25211 trim_cache size 0 max 16384 2024-09-12T12:18:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:18:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:18:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:18:38.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f22d40a2da0 msgr2=0x7f22d40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f22d40a2da0 0x7f22d40a5260 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x555e38982ec0 tx=0x7f22e4005f90 comp rx=0 tx=0).stop 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 msgr2=0x7f22e819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 0x7f22e819cd70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f22e000efd0 tx=0x7f22e000c6a0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 shutdown_connections 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f22d40a2da0 0x7f22d40a5260 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22e8105520 0x7f22e819cd70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22e81011e0 0x7f22e81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 --2- 172.21.15.81:0/2069271789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e8100830 0x7f22e81984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 >> 172.21.15.81:0/2069271789 conn(0x7f22e8075ec0 msgr2=0x7f22e80fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.932+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 shutdown_connections 2024-09-12T12:18:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:38.933+0000 7f22f01d8640 1 -- 172.21.15.81:0/2069271789 wait complete. 2024-09-12T12:18:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:39 smithi173 ceph-mon[35326]: pgmap v69: 97 pgs: 97 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2024-09-12T12:18:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:39 smithi103 ceph-mon[35094]: pgmap v69: 97 pgs: 97 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2024-09-12T12:18:39.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:39 smithi081 ceph-mon[30948]: pgmap v69: 97 pgs: 97 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 1.6 MiB/s wr, 218 op/s 2024-09-12T12:18:40.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:40 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:40.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:40 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:40.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:40 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:41 smithi103 ceph-mon[35094]: pgmap v70: 97 pgs: 97 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-09-12T12:18:41.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:41 smithi081 ceph-mon[30948]: pgmap v70: 97 pgs: 97 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-09-12T12:18:41.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:41 smithi173 ceph-mon[35326]: pgmap v70: 97 pgs: 97 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-09-12T12:18:42.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:42 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:42.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:42 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:42.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:42 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:43 smithi103 ceph-mon[35094]: pgmap v71: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 417 op/s 2024-09-12T12:18:43.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:43 smithi081 ceph-mon[30948]: pgmap v71: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 417 op/s 2024-09-12T12:18:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:43 smithi173 ceph-mon[35326]: pgmap v71: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 417 op/s 2024-09-12T12:18:45.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar xf doc.tar 2024-09-12T12:18:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:45 smithi081 ceph-mon[30948]: pgmap v72: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-12T12:18:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:45 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:45.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:45 smithi173 ceph-mon[35326]: pgmap v72: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-12T12:18:45.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:45 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:45 smithi103 ceph-mon[35094]: pgmap v72: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-12T12:18:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:45 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:47.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:47 smithi081 ceph-mon[30948]: pgmap v73: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-12T12:18:47.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:47 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:47 smithi173 ceph-mon[35326]: pgmap v73: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-12T12:18:47.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:47 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:47 smithi103 ceph-mon[35094]: pgmap v73: 97 pgs: 97 active+clean; 188 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-12T12:18:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:47 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:49.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:49 smithi081 ceph-mon[30948]: pgmap v74: 97 pgs: 97 active+clean; 184 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 574 op/s 2024-09-12T12:18:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:49 smithi173 ceph-mon[35326]: pgmap v74: 97 pgs: 97 active+clean; 184 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 574 op/s 2024-09-12T12:18:49.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:49 smithi103 ceph-mon[35094]: pgmap v74: 97 pgs: 97 active+clean; 184 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 574 op/s 2024-09-12T12:18:50.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:50 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:50.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:50 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:50.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:50 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:18:51.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:51 smithi081 ceph-mon[30948]: pgmap v75: 97 pgs: 97 active+clean; 184 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 419 op/s 2024-09-12T12:18:51.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:51 smithi173 ceph-mon[35326]: pgmap v75: 97 pgs: 97 active+clean; 184 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 419 op/s 2024-09-12T12:18:51.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:51 smithi103 ceph-mon[35094]: pgmap v75: 97 pgs: 97 active+clean; 184 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 419 op/s 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 -- 172.21.15.81:0/1889008433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde741035c0 msgr2=0x7fde7410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1889008433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde741035c0 0x7fde7410baa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde7002a480 comp rx=0 tx=0).stop 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 -- 172.21.15.81:0/1889008433 shutdown_connections 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1889008433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde7410c0c0 0x7fde7410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1889008433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde741035c0 0x7fde7410baa0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1889008433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde74102ca0 0x7fde74103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 -- 172.21.15.81:0/1889008433 >> 172.21.15.81:0/1889008433 conn(0x7fde740fc6f0 msgr2=0x7fde740feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 -- 172.21.15.81:0/1889008433 shutdown_connections 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.026+0000 7fde7bd59640 1 -- 172.21.15.81:0/1889008433 wait complete. 2024-09-12T12:18:52.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 Processor -- start 2024-09-12T12:18:52.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 -- start start 2024-09-12T12:18:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 0x7fde741983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde741035c0 0x7fde74198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde7410c0c0 0x7fde7419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde74112000 con 0x7fde74102ca0 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde74111e80 con 0x7fde741035c0 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7bd59640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde74112180 con 0x7fde7410c0c0 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 0x7fde741983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 0x7fde741983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55060/0 (socket says 172.21.15.81:55060) 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 -- 172.21.15.81:0/1335307784 learned_addr learned my addr 172.21.15.81:0/1335307784 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde792f4640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde741035c0 0x7fde74198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde7410c0c0 0x7fde7419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 -- 172.21.15.81:0/1335307784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde7410c0c0 msgr2=0x7fde7419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde7410c0c0 0x7fde7419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 -- 172.21.15.81:0/1335307784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde741035c0 msgr2=0x7fde74198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde741035c0 0x7fde74198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.027+0000 7fde79af5640 1 -- 172.21.15.81:0/1335307784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7419d3e0 con 0x7fde74102ca0 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.028+0000 7fde79af5640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 0x7fde741983f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fde6400ea60 tx=0x7fde6400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.028+0000 7fde6affd640 1 -- 172.21.15.81:0/1335307784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6400cde0 con 0x7fde74102ca0 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.028+0000 7fde6affd640 1 -- 172.21.15.81:0/1335307784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde640035f0 con 0x7fde74102ca0 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.028+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7419d6d0 con 0x7fde74102ca0 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.028+0000 7fde6affd640 1 -- 172.21.15.81:0/1335307784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64010720 con 0x7fde74102ca0 2024-09-12T12:18:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.028+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde741a4f60 con 0x7fde74102ca0 2024-09-12T12:18:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.030+0000 7fde6affd640 1 -- 172.21.15.81:0/1335307784 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fde640037a0 con 0x7fde74102ca0 2024-09-12T12:18:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.030+0000 7fde7ebd3740 1 Processor -- start 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 -- start start 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 0x558f7b9f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f9410 0x558f7ba03770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 0x558f7ba060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558f7b95d2f0 con 0x558f7ba03cb0 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558f7b905270 con 0x558f7b9f8af0 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558f7b9592b0 con 0x558f7b9f9410 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde792f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 0x558f7ba060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7a2f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 0x558f7b9f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde792f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 0x558f7ba060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55074/0 (socket says 172.21.15.81:55074) 2024-09-12T12:18:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7a2f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 0x558f7b9f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:40200/0 (socket says 172.21.15.81:40200) 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde792f4640 1 -- 172.21.15.81:0/1987709183 learned_addr learned my addr 172.21.15.81:0/1987709183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde6affd640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fde600a2da0 0x7fde600a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde79af5640 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f9410 0x558f7ba03770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.031+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fde600a2da0 0x7fde600a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde792f4640 1 -- 172.21.15.81:0/1987709183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f9410 msgr2=0x558f7ba03770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde792f4640 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f9410 0x558f7ba03770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde792f4640 1 -- 172.21.15.81:0/1987709183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 msgr2=0x558f7b9f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde792f4640 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 0x558f7b9f8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde792f4640 1 -- 172.21.15.81:0/1987709183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7b904340 con 0x558f7ba03cb0 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 0x558f7b9f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde6affd640 1 -- 172.21.15.81:0/1335307784 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fde640cf7a0 con 0x7fde74102ca0 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde792f4640 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 0x558f7ba060a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde70005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cd54b44bb4363c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fde600a2da0 0x7fde600a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde6c011fd0 tx=0x7fde6c004ab0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde5ffff640 1 -- 172.21.15.81:0/1987709183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70040070 con 0x558f7ba03cb0 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde5ffff640 1 -- 172.21.15.81:0/1987709183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde70031980 con 0x558f7ba03cb0 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.032+0000 7fde5ffff640 1 -- 172.21.15.81:0/1987709183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70035040 con 0x558f7ba03cb0 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 -- 172.21.15.81:0/1987709183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 msgr2=0x558f7ba060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 0x558f7ba060a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde70005c00 comp rx=0 tx=0).stop 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 -- 172.21.15.81:0/1987709183 shutdown_connections 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7ba03cb0 0x558f7ba060a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f9410 0x558f7ba03770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/1987709183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f8af0 0x558f7b9f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 -- 172.21.15.81:0/1987709183 >> 172.21.15.81:0/1987709183 conn(0x558f7b9f5060 msgr2=0x558f7b9f5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 -- 172.21.15.81:0/1987709183 shutdown_connections 2024-09-12T12:18:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 -- 172.21.15.81:0/1987709183 wait complete. 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 -- start start 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.033+0000 7fde7ebd3740 1 Processor -- start 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7ba00b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7ba010d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558f7ba06880 con 0x558f7b9f9410 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558f7b8e6290 con 0x558f7ba03cb0 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558f7ba06a00 con 0x558f7b9f8af0 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7ebd3740 10 client.0 _ll_register_callbacks cb 0x558f7b917140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7ba010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7ba010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55078/0 (socket says 172.21.15.81:55078) 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 -- 172.21.15.81:0/203341020 learned_addr learned my addr 172.21.15.81:0/203341020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:52.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde79af5640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7ba00b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 -- 172.21.15.81:0/203341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 msgr2=0x558f7ba00b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7ba00b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 -- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 msgr2=0x558f7ba01610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 -- 172.21.15.81:0/203341020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7b670210 con 0x558f7b9f9410 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde792f4640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7ba010d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fde70004770 tx=0x7fde7002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd8e060f1833057 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:52.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.034+0000 7fde5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde5d7fa640 1 -- 172.21.15.81:0/203341020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7004c020 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde70031980 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde5d7fa640 1 -- 172.21.15.81:0/203341020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fde70004a20 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde5d7fa640 1 -- 172.21.15.81:0/203341020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fde70057050 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 10 client.15717 fetch_fsmap learned FSMap version 36 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558f7b73c620 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde5d7fa640 1 -- 172.21.15.81:0/203341020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde70031980 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde5d7fa640 1 -- 172.21.15.81:0/203341020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8438+0+0 (secure 0 0 0) 0x7fde7003cb60 con 0x558f7b9f9410 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 10 client.15717 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 20 client.15717 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:52.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba13a80 0x558f7ba15e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 4 client.15717 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:18:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.035+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f7b96aa20 con 0x558f7ba13a80 2024-09-12T12:18:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.036+0000 7fde79af5640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba13a80 0x558f7ba15e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.036+0000 7fde5d7fa640 10 client.15717 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:52.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.036+0000 7fde79af5640 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba13a80 0x558f7ba15e70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba1600078c62a4bc server_cookie=5cddc3ad533dbe82 in_seq=0 out_seq=0 2024-09-12T12:18:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde5d7fa640 1 -- 172.21.15.81:0/203341020 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f7b96aa20 con 0x558f7ba13a80 2024-09-12T12:18:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde5d7fa640 10 client.15717 handle_command_reply: tid=0 2024-09-12T12:18:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 client.15717 shutdown 2024-09-12T12:18:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 msgr2=0x558f7ba010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7ba010d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fde70004770 tx=0x7fde7002a480 comp rx=0 tx=0).stop 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 shutdown_connections 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba13a80 0x558f7ba15e70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7ba010d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/203341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7ba00b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde5d7fa640 0 client.15717 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 >> 172.21.15.81:0/203341020 conn(0x558f7b9f5060 msgr2=0x558f7b9fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 shutdown_connections 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 1 -- 172.21.15.81:0/203341020 wait complete. 2024-09-12T12:18:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.038+0000 7fde7ebd3740 20 client.15717 trim_cache size 0 max 16384 2024-09-12T12:18:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 Processor -- start 2024-09-12T12:18:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 -- start start 2024-09-12T12:18:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7b9fb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7b9ff440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde741ab510 con 0x558f7b9f9410 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde741ad350 con 0x558f7ba03cb0 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde741abca0 con 0x558f7b9f8af0 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7b9ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7b9ff440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55094/0 (socket says 172.21.15.81:55094) 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 -- 172.21.15.81:0/380021656 learned_addr learned my addr 172.21.15.81:0/380021656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde79af5640 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7b9fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 -- 172.21.15.81:0/380021656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 msgr2=0x558f7b9fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7b9fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 -- 172.21.15.81:0/380021656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 msgr2=0x558f7ba01440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde792f4640 1 -- 172.21.15.81:0/380021656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f7b9f5cf0 con 0x558f7b9f9410 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.053+0000 7fde79af5640 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7b9fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde792f4640 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7b9ff440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde70005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca09871b47135a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde5f7fe640 1 -- 172.21.15.81:0/380021656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7004c070 con 0x558f7b9f9410 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde5f7fe640 1 -- 172.21.15.81:0/380021656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde70044480 con 0x558f7b9f9410 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde5f7fe640 1 -- 172.21.15.81:0/380021656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70040070 con 0x558f7b9f9410 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 -- 172.21.15.81:0/380021656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 msgr2=0x558f7b9ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7b9ff440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde70005900 comp rx=0 tx=0).stop 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 -- 172.21.15.81:0/380021656 shutdown_connections 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7ba03cb0 0x558f7ba01440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f9410 0x558f7b9ff440 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/380021656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7b9f8af0 0x558f7b9fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 -- 172.21.15.81:0/380021656 >> 172.21.15.81:0/380021656 conn(0x558f7b9f5060 msgr2=0x558f7ba02c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.054+0000 7fde7ebd3740 1 -- 172.21.15.81:0/380021656 shutdown_connections 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 -- 172.21.15.81:0/380021656 wait complete. 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 -- start start 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 Processor -- start 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 0x558f7ba0bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f9410 0x558f7ba0c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7ba03cb0 0x558f7ba07600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde741acbc0 con 0x558f7b9f8af0 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde741ac430 con 0x558f7b9f9410 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fde741a94f0 con 0x558f7ba03cb0 2024-09-12T12:18:52.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7ebd3740 10 client.0 _ll_register_callbacks cb 0x7fde6c011850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde79af5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 0x558f7ba0bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde792f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f9410 0x558f7ba0c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde79af5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 0x558f7ba0bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55104/0 (socket says 172.21.15.81:55104) 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde79af5640 1 -- 172.21.15.81:0/2292148378 learned_addr learned my addr 172.21.15.81:0/2292148378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.055+0000 7fde7a2f6640 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7ba03cb0 0x558f7ba07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde79af5640 1 -- 172.21.15.81:0/2292148378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7ba03cb0 msgr2=0x558f7ba07600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde79af5640 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7ba03cb0 0x558f7ba07600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde79af5640 1 -- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f9410 msgr2=0x558f7ba0c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde79af5640 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f9410 0x558f7ba0c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde79af5640 1 -- 172.21.15.81:0/2292148378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f7ba07e30 con 0x558f7b9f8af0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde79af5640 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 0x558f7ba0bff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fde64098190 tx=0x7fde640a6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83d9b10682ba228 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:18:52.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde5d7fa640 1 -- 172.21.15.81:0/2292148378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6409bd30 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde5d7fa640 1 -- 172.21.15.81:0/2292148378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fde640cd1e0 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde70044480 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde5d7fa640 1 -- 172.21.15.81:0/2292148378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fde640cd3e0 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 10 client.15723 fetch_fsmap learned FSMap version 36 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558f7ba7e160 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde5d7fa640 1 -- 172.21.15.81:0/2292148378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fde70044480 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde5d7fa640 1 -- 172.21.15.81:0/2292148378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 8438+0+0 (secure 0 0 0) 0x7fde64097a80 con 0x558f7b9f8af0 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 10 client.15723 fetch_fsmap finished waiting for FSMap version 36 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 20 client.15723 populate_metadata read hostname 'smithi081' 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba7e920 0x558f7ba80d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:52.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 4 client.15723 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:18:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.056+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558f7b964d70 con 0x558f7ba7e920 2024-09-12T12:18:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.057+0000 7fde792f4640 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba7e920 0x558f7ba80d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.057+0000 7fde792f4640 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba7e920 0x558f7ba80d40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35cd378f90c5114 server_cookie=3014defb9423dbd1 in_seq=0 out_seq=0 2024-09-12T12:18:52.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:52.057+0000 7fde5d7fa640 10 client.15723 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:52.349 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2024-09-12T12:18:53.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:53 smithi081 ceph-mon[30948]: pgmap v76: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 434 op/s 2024-09-12T12:18:53.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:53 smithi173 ceph-mon[35326]: pgmap v76: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 434 op/s 2024-09-12T12:18:53.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:53 smithi103 ceph-mon[35094]: pgmap v76: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 434 op/s 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.255+0000 7fde5d7fa640 1 -- 172.21.15.81:0/2292148378 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558f7b964d70 con 0x558f7ba7e920 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde5d7fa640 10 client.15723 handle_command_reply: tid=0 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 client.15723 shutdown 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 msgr2=0x558f7ba0bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 0x558f7ba0bff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fde64098190 tx=0x7fde640a6040 comp rx=0 tx=0).stop 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 shutdown_connections 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x558f7ba7e920 0x558f7ba80d40 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558f7ba03cb0 0x558f7ba07600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f7b9f9410 0x558f7ba0c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 --2- 172.21.15.81:0/2292148378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558f7b9f8af0 0x558f7ba0bff0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde5d7fa640 0 client.15723 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 >> 172.21.15.81:0/2292148378 conn(0x558f7b9f5060 msgr2=0x558f7b9f39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 shutdown_connections 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 1 -- 172.21.15.81:0/2292148378 wait complete. 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.256+0000 7fde7ebd3740 20 client.15723 trim_cache size 0 max 16384 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:18:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:18:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.257+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fde600a2da0 msgr2=0x7fde600a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.257+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fde600a2da0 0x7fde600a5260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde6c011fd0 tx=0x7fde6c004ab0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.257+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 msgr2=0x7fde741983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.257+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 0x7fde741983f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fde6400ea60 tx=0x7fde6400ef20 comp rx=0 tx=0).stop 2024-09-12T12:18:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 shutdown_connections 2024-09-12T12:18:55.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fde600a2da0 0x7fde600a5260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fde7410c0c0 0x7fde7419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde741035c0 0x7fde74198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 --2- 172.21.15.81:0/1335307784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74102ca0 0x7fde741983f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 >> 172.21.15.81:0/1335307784 conn(0x7fde740fc6f0 msgr2=0x7fde740fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 shutdown_connections 2024-09-12T12:18:55.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:18:55.258+0000 7fde7bd59640 1 -- 172.21.15.81:0/1335307784 wait complete. 2024-09-12T12:18:55.623 INFO:tasks.workunit.client.0.smithi081.stderr:+ tar c linux-4.0.5 2024-09-12T12:18:55.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:55 smithi081 ceph-mon[30948]: pgmap v77: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-12T12:18:55.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:55 smithi173 ceph-mon[35326]: pgmap v77: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-12T12:18:55.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:55 smithi103 ceph-mon[35094]: pgmap v77: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-12T12:18:56.440 INFO:tasks.workunit.client.0.smithi081.stdout:Ok 2024-09-12T12:18:56.441 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo Ok 2024-09-12T12:18:56.441 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T12:18:56.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T12:18:57.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:57 smithi081 ceph-mon[30948]: pgmap v78: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-12T12:18:57.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:57 smithi173 ceph-mon[35326]: pgmap v78: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-12T12:18:57.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:57 smithi103 ceph-mon[35094]: pgmap v78: 97 pgs: 97 active+clean; 191 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 177 op/s 2024-09-12T12:18:58.878 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.7 2024-09-12T12:18:58.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:18:59.135 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:18:59.601 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:18:59 smithi081 ceph-mon[30948]: pgmap v79: 97 pgs: 97 active+clean; 215 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 1.21k op/s 2024-09-12T12:18:59.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/3666721087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 msgr2=0x7f8ed0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:59.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/3666721087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0103110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ca0 tx=0x7f8ec802a950 comp rx=0 tx=0).stop 2024-09-12T12:18:59.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/3666721087 shutdown_connections 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/3666721087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 0x7f8ed010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/3666721087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 0x7f8ed010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/3666721087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0103110 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/3666721087 >> 172.21.15.81:0/3666721087 conn(0x7f8ed00fc7d0 msgr2=0x7f8ed00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/3666721087 shutdown_connections 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.687+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/3666721087 wait complete. 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 Processor -- start 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 -- start start 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 0x7f8ed0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 0x7f8ed0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:59.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0112080 con 0x7f8ed0102d30 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0111f00 con 0x7f8ed010c160 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ed5e0a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0112200 con 0x7f8ed0103650 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ecf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ecffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 0x7f8ed0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8eceffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 0x7f8ed0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ecf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36496/0 (socket says 172.21.15.81:36496) 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.688+0000 7f8ecf7fe640 1 -- 172.21.15.81:0/638049363 learned_addr learned my addr 172.21.15.81:0/638049363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecffff640 1 -- 172.21.15.81:0/638049363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 msgr2=0x7f8ed0100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecffff640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 0x7f8ed0100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecffff640 1 -- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 msgr2=0x7f8ed0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecffff640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecffff640 1 -- 172.21.15.81:0/638049363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed01a69e0 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecf7fe640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8eceffd640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 0x7f8ed0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ecffff640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 0x7f8ed0101410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000e970 tx=0x7f8ec000ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000ccc0 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed01a6cd0 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8ec0005020 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0004a20 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.689+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed01a7210 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.690+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed0103110 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.692+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f8ec0004c00 con 0x7f8ed010c160 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.693+0000 7f8eccff9640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8ebc0a2cf0 0x7f8ebc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.693+0000 7f8ecf7fe640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8ebc0a2cf0 0x7f8ebc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:18:59.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.693+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f8ec00cf410 con 0x7f8ed010c160 2024-09-12T12:18:59.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.693+0000 7f8ecf7fe640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8ebc0a2cf0 0x7f8ebc0a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ec802ae70 tx=0x7f8ec8005c50 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:18:59.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.696+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ec009c130 con 0x7f8ed010c160 2024-09-12T12:18:59.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:18:59 smithi173 ceph-mon[35326]: pgmap v79: 97 pgs: 97 active+clean; 215 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 1.21k op/s 2024-09-12T12:18:59.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.910+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ed002d7c0 con 0x7f8ed010c160 2024-09-12T12:18:59.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.911+0000 7f8eccff9640 1 -- 172.21.15.81:0/638049363 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+12015 (secure 0 0 0) 0x7f8ec009ba30 con 0x7f8ed010c160 2024-09-12T12:18:59.911 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:18:59.912 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-12T12:18:49:448904+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:18:48.750514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[0,1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24485,24461,24457,24437,24436]},"id":1}]} 2024-09-12T12:18:59.912 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-12T12:18:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8ebc0a2cf0 msgr2=0x7f8ebc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8ebc0a2cf0 0x7f8ebc0a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ec802ae70 tx=0x7f8ec8005c50 comp rx=0 tx=0).stop 2024-09-12T12:18:59.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 msgr2=0x7f8ed0101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 0x7f8ed0101410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000e970 tx=0x7f8ec000ee30 comp rx=0 tx=0).stop 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 shutdown_connections 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f8ebc0a2cf0 0x7f8ebc0a51b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ed010c160 0x7f8ed0101410 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ed0103650 0x7f8ed0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 --2- 172.21.15.81:0/638049363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ed0102d30 0x7f8ed0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 >> 172.21.15.81:0/638049363 conn(0x7f8ed00fc7d0 msgr2=0x7f8ed00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 shutdown_connections 2024-09-12T12:18:59.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:18:59.913+0000 7f8ed5e0a640 1 -- 172.21.15.81:0/638049363 wait complete. 2024-09-12T12:18:59.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:18:59 smithi103 ceph-mon[35094]: pgmap v79: 97 pgs: 97 active+clean; 215 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.5 MiB/s wr, 1.21k op/s 2024-09-12T12:19:00.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:00 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/638049363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:00.774 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0' 2024-09-12T12:19:00.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db / --timeout 90 --expiration 144.7 --await-for 45.0 2024-09-12T12:19:00.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:00 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/638049363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:00.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:00 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/638049363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:01.043 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 -- 172.21.15.81:0/2529518302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 msgr2=0x7f75c410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 --2- 172.21.15.81:0/2529518302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c410ec70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009cd0 tx=0x7f75bc02a8d0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 -- 172.21.15.81:0/2529518302 shutdown_connections 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 --2- 172.21.15.81:0/2529518302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c410ec70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 --2- 172.21.15.81:0/2529518302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 0x7f75c4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 --2- 172.21.15.81:0/2529518302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 -- 172.21.15.81:0/2529518302 >> 172.21.15.81:0/2529518302 conn(0x7f75c40fc7d0 msgr2=0x7f75c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 -- 172.21.15.81:0/2529518302 shutdown_connections 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 -- 172.21.15.81:0/2529518302 wait complete. 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 Processor -- start 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.592+0000 7f75cbf04640 1 -- start start 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75cbf04640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75cbf04640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 0x7f75c4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75cbf04640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75cbf04640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41121f0 con 0x7f75c4108300 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75cbf04640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4112070 con 0x7f75c4102dd0 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75cbf04640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4112370 con 0x7f75c4103780 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c419cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36522/0 (socket says 172.21.15.81:36522) 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c4198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:36932/0 (socket says 172.21.15.81:36932) 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75ca4a1640 1 -- 172.21.15.81:0/950993635 learned_addr learned my addr 172.21.15.81:0/950993635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c949f640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 0x7f75c4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 -- 172.21.15.81:0/950993635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 msgr2=0x7f75c4198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 0x7f75c4198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 -- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 msgr2=0x7f75c419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 -- 172.21.15.81:0/950993635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c419d5f0 con 0x7f75c4102dd0 2024-09-12T12:19:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c949f640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 0x7f75c4198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c4198640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75c000e9f0 tx=0x7f75c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.593+0000 7f75baffd640 1 -- 172.21.15.81:0/950993635 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c000ccc0 con 0x7f75c4102dd0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.594+0000 7f75baffd640 1 -- 172.21.15.81:0/950993635 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75c0010930 con 0x7f75c4102dd0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.594+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c419d8e0 con 0x7f75c4102dd0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.594+0000 7f75baffd640 1 -- 172.21.15.81:0/950993635 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c00189f0 con 0x7f75c4102dd0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.594+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c41a51c0 con 0x7f75c4102dd0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.597+0000 7f75baffd640 1 -- 172.21.15.81:0/950993635 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f75c0010ae0 con 0x7f75c4102dd0 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.597+0000 7f75ce2dd740 1 Processor -- start 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.597+0000 7f75ce2dd740 1 -- start start 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.597+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 0x557354af1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.597+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557354a572a0 con 0x557354b04fe0 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5573549feb10 con 0x557354af2ce0 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557354a53260 con 0x557354af1b40 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 0x557354af1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75c949f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 0x557354af1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:36942/0 (socket says 172.21.15.81:36942) 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 -- 172.21.15.81:0/2846075351 learned_addr learned my addr 172.21.15.81:0/2846075351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 -- 172.21.15.81:0/2846075351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 msgr2=0x557354af1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 -- 172.21.15.81:0/2846075351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 msgr2=0x557354b073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 -- 172.21.15.81:0/2846075351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573547c8b90 con 0x557354af2ce0 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75baffd640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f75b00a2cf0 0x7f75b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75c949f640 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 0x557354af1600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009830 tx=0x7f75bc009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e79d5210749dc3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.598+0000 7f75baffd640 1 -- 172.21.15.81:0/950993635 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f75c00cf760 con 0x7f75c4102dd0 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f75b00a2cf0 0x7f75b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75affff640 1 -- 172.21.15.81:0/2846075351 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc049070 con 0x557354af2ce0 2024-09-12T12:19:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75affff640 1 -- 172.21.15.81:0/2846075351 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75bc036040 con 0x557354af2ce0 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75affff640 1 -- 172.21.15.81:0/2846075351 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc02fb70 con 0x557354af2ce0 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75ce2dd740 1 -- 172.21.15.81:0/2846075351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 msgr2=0x557354af1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75c9ca0640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f75b00a2cf0 0x7f75b00a51b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ccfd0 tx=0x7f75c000cf70 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.599+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 0x557354af1600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009830 tx=0x7f75bc009860 comp rx=0 tx=0).stop 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 -- 172.21.15.81:0/2846075351 shutdown_connections 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/2846075351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af2ce0 0x557354af1600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 -- 172.21.15.81:0/2846075351 >> 172.21.15.81:0/2846075351 conn(0x557354aedcf0 msgr2=0x557354aee0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 -- 172.21.15.81:0/2846075351 shutdown_connections 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 -- 172.21.15.81:0/2846075351 wait complete. 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 -- start start 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 Processor -- start 2024-09-12T12:19:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.600+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354af5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354af5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x557354b07cb0 con 0x557354af2ce0 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5573549df6e0 con 0x557354b04fe0 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x557354b07e30 con 0x557354af1b40 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 10 client.0 _ll_register_callbacks cb 0x557354a03a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354af5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354af5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36544/0 (socket says 172.21.15.81:36544) 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 -- 172.21.15.81:0/584198756 learned_addr learned my addr 172.21.15.81:0/584198756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354af5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 -- 172.21.15.81:0/584198756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 msgr2=0x557354af5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 -- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 msgr2=0x557354af5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354af5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 -- 172.21.15.81:0/584198756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557354b112d0 con 0x557354af2ce0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354af5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75c949f640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354af5980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f75b4012700 tx=0x7f75b4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207f325efb8b8f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ad7fa640 1 -- 172.21.15.81:0/584198756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011c70 con 0x557354af2ce0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ad7fa640 1 -- 172.21.15.81:0/584198756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f75b4011e10 con 0x557354af2ce0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.601+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75bc036040 con 0x557354af2ce0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ad7fa640 1 -- 172.21.15.81:0/584198756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f75b4005020 con 0x557354af2ce0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 10 client.15741 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557354b13c40 con 0x557354af2ce0 2024-09-12T12:19:01.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ad7fa640 1 -- 172.21.15.81:0/584198756 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75bc036040 con 0x557354af2ce0 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ad7fa640 1 -- 172.21.15.81:0/584198756 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f75b4024050 con 0x557354af2ce0 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 10 client.15741 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 10 client.15741 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 20 client.15741 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b15110 0x557354b17550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 4 client.15741 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557354a649d0 con 0x557354b15110 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b15110 0x557354b17550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.602+0000 7f75ad7fa640 10 client.15741 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.603+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b15110 0x557354b17550 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332b040d4d82cc30 server_cookie=6ff1ff18317ec002 in_seq=0 out_seq=0 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.604+0000 7f75ad7fa640 1 -- 172.21.15.81:0/584198756 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557354a649d0 con 0x557354b15110 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.604+0000 7f75ad7fa640 10 client.15741 handle_command_reply: tid=0 2024-09-12T12:19:01.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.604+0000 7f75ce2dd740 1 client.15741 shutdown 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 msgr2=0x557354af5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354af5980 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f75b4012700 tx=0x7f75b4012bc0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 shutdown_connections 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b15110 0x557354b17550 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354af5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354af5980 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/584198756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 >> 172.21.15.81:0/584198756 conn(0x557354aedcf0 msgr2=0x557354af3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ad7fa640 0 client.15741 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.605+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 shutdown_connections 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.606+0000 7f75ce2dd740 1 -- 172.21.15.81:0/584198756 wait complete. 2024-09-12T12:19:01.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.606+0000 7f75ce2dd740 20 client.15741 trim_cache size 0 max 16384 2024-09-12T12:19:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 Processor -- start 2024-09-12T12:19:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 -- start start 2024-09-12T12:19:01.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354b1ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354b1d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41ab590 con 0x557354af2ce0 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41ad3d0 con 0x557354b04fe0 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41abd20 con 0x557354af1b40 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75c949f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354b1ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75c949f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354b1ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36546/0 (socket says 172.21.15.81:36546) 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75c949f640 1 -- 172.21.15.81:0/1449214505 learned_addr learned my addr 172.21.15.81:0/1449214505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.628+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354b1d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75c949f640 1 -- 172.21.15.81:0/1449214505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 msgr2=0x557354af73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75c949f640 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75c949f640 1 -- 172.21.15.81:0/1449214505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 msgr2=0x557354b1d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75c949f640 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354b1d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75c949f640 1 -- 172.21.15.81:0/1449214505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557354b019e0 con 0x557354af2ce0 2024-09-12T12:19:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354b1d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75c949f640 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354b1ce20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d30 tx=0x7f75b4005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9f3e21f8d3b9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75af7fe640 1 -- 172.21.15.81:0/1449214505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b4011c70 con 0x557354af2ce0 2024-09-12T12:19:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75af7fe640 1 -- 172.21.15.81:0/1449214505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75b4011e10 con 0x557354af2ce0 2024-09-12T12:19:01.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.629+0000 7f75af7fe640 1 -- 172.21.15.81:0/1449214505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b40048c0 con 0x557354af2ce0 2024-09-12T12:19:01.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 -- 172.21.15.81:0/1449214505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 msgr2=0x557354b1ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:01.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354b1ce20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009d30 tx=0x7f75b4005890 comp rx=0 tx=0).stop 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 -- 172.21.15.81:0/1449214505 shutdown_connections 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354b04fe0 0x557354b1d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354af2ce0 0x557354b1ce20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/1449214505 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af1b40 0x557354af73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 -- 172.21.15.81:0/1449214505 >> 172.21.15.81:0/1449214505 conn(0x557354aedcf0 msgr2=0x557354af6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 -- 172.21.15.81:0/1449214505 shutdown_connections 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 -- 172.21.15.81:0/1449214505 wait complete. 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 -- start start 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.630+0000 7f75ce2dd740 1 Processor -- start 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af1b40 0x557354b094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af2ce0 0x557354b09a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b7edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41acc40 con 0x557354b04fe0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41ac4b0 con 0x557354af1b40 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f75c41a95b0 con 0x557354af2ce0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ce2dd740 10 client.0 _ll_register_callbacks cb 0x7f75b4009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b7edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b7edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36552/0 (socket says 172.21.15.81:36552) 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 -- 172.21.15.81:0/434251230 learned_addr learned my addr 172.21.15.81:0/434251230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af1b40 0x557354b094d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75c949f640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af2ce0 0x557354b09a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 -- 172.21.15.81:0/434251230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af2ce0 msgr2=0x557354b09a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af2ce0 0x557354b09a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 -- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af1b40 msgr2=0x557354b094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af1b40 0x557354b094d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 -- 172.21.15.81:0/434251230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557354b7f330 con 0x557354b04fe0 2024-09-12T12:19:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ca4a1640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b7edf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f75bc005e30 tx=0x7f75b4009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5044a9bc56ed016 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.631+0000 7f75ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ad7fa640 1 -- 172.21.15.81:0/434251230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc049040 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ad7fa640 1 -- 172.21.15.81:0/434251230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f75bc0317f0 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75b4011e10 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ad7fa640 1 -- 172.21.15.81:0/434251230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f75bc02f8e0 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 10 client.15747 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x557354b80570 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ad7fa640 1 -- 172.21.15.81:0/434251230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75b4011e10 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ad7fa640 1 -- 172.21.15.81:0/434251230 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f75bc030c00 con 0x557354b04fe0 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 10 client.15747 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 10 client.15747 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:19:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 20 client.15747 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:01.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b80790 0x557354b82b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:01.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 4 client.15747 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}] 2024-09-12T12:19:01.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.7, "await_for": 45.0}) -- 0x557354a5ed20 con 0x557354b80790 2024-09-12T12:19:01.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.632+0000 7f75c949f640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b80790 0x557354b82b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:01.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.633+0000 7f75ad7fa640 10 client.15747 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:01.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:01.633+0000 7f75c949f640 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b80790 0x557354b82b80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffcbc77fb8020385 server_cookie=dc0eade99f4075db in_seq=0 out_seq=0 2024-09-12T12:19:01.804 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:01 smithi173 ceph-mon[35326]: pgmap v80: 97 pgs: 97 active+clean; 215 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 1.04k op/s 2024-09-12T12:19:01.835 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:01 smithi103 ceph-mon[35094]: pgmap v80: 97 pgs: 97 active+clean; 215 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 1.04k op/s 2024-09-12T12:19:01.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:01 smithi081 ceph-mon[30948]: pgmap v80: 97 pgs: 97 active+clean; 215 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 1.04k op/s 2024-09-12T12:19:02.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:02 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:19:02.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:02 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:19:02.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:02 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:19:03.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:03 smithi081 ceph-mon[30948]: pgmap v81: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.24k op/s 2024-09-12T12:19:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ad7fa640 1 -- 172.21.15.81:0/434251230 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557354a5ed20 con 0x557354b80790 2024-09-12T12:19:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ad7fa640 10 client.15747 handle_command_reply: tid=0 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 client.15747 shutdown 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 msgr2=0x557354b7edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b7edf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f75bc005e30 tx=0x7f75b4009d60 comp rx=0 tx=0).stop 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 shutdown_connections 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x557354b80790 0x557354b82b80 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557354b04fe0 0x557354b7edf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x557354af2ce0 0x557354b09a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 --2- 172.21.15.81:0/434251230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557354af1b40 0x557354b094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ad7fa640 0 client.15747 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 >> 172.21.15.81:0/434251230 conn(0x557354aedcf0 msgr2=0x557354af74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 shutdown_connections 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 1 -- 172.21.15.81:0/434251230 wait complete. 2024-09-12T12:19:03.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.902+0000 7f75ce2dd740 20 client.15747 trim_cache size 0 max 16384 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 37, 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 10, 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "e02adb47": { 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 10, 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T12:19:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 144.7, 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "QUIESCED", 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f75b00a2cf0 msgr2=0x7f75b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f75b00a2cf0 0x7f75b00a51b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ccfd0 tx=0x7f75c000cf70 comp rx=0 tx=0).stop 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 msgr2=0x7f75c4198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:03.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c4198640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75c000e9f0 tx=0x7f75c000eeb0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 shutdown_connections 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f75b00a2cf0 0x7f75b00a51b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75c4108300 0x7f75c419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75c4103780 0x7f75c4198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 --2- 172.21.15.81:0/950993635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75c4102dd0 0x7f75c4198640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 >> 172.21.15.81:0/950993635 conn(0x7f75c40fc7d0 msgr2=0x7f75c4106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 shutdown_connections 2024-09-12T12:19:03.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:03.903+0000 7f75cbf04640 1 -- 172.21.15.81:0/950993635 wait complete. 2024-09-12T12:19:03.907 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:03 smithi173 ceph-mon[35326]: pgmap v81: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.24k op/s 2024-09-12T12:19:03.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:03 smithi103 ceph-mon[35094]: pgmap v81: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.24k op/s 2024-09-12T12:19:04.671 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e02adb47', quiesce took 5.8 seconds. Will release after: 18.9 2024-09-12T12:19:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:05 smithi081 ceph-mon[30948]: pgmap v82: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-09-12T12:19:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:05 smithi173 ceph-mon[35326]: pgmap v82: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-09-12T12:19:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:05 smithi103 ceph-mon[35094]: pgmap v82: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-09-12T12:19:07.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:07 smithi081 ceph-mon[30948]: pgmap v83: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-09-12T12:19:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:07 smithi173 ceph-mon[35326]: pgmap v83: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-09-12T12:19:07.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:07 smithi103 ceph-mon[35094]: pgmap v83: 97 pgs: 97 active+clean; 220 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 1.22k op/s 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 -- 172.21.15.81:0/536299211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc010c0d0 msgr2=0x7f6cc010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/536299211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc010c0d0 0x7f6cc010e550 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009900 tx=0x7f6cb002a480 comp rx=0 tx=0).stop 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 -- 172.21.15.81:0/536299211 shutdown_connections 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/536299211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc010c0d0 0x7f6cc010e550 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/536299211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc01035a0 0x7f6cc010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/536299211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cc0102c80 0x7f6cc0103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 -- 172.21.15.81:0/536299211 >> 172.21.15.81:0/536299211 conn(0x7f6cc0077990 msgr2=0x7f6cc00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 -- 172.21.15.81:0/536299211 shutdown_connections 2024-09-12T12:19:08.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.355+0000 7f6cc57c0640 1 -- 172.21.15.81:0/536299211 wait complete. 2024-09-12T12:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 Processor -- start 2024-09-12T12:19:08.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 -- start start 2024-09-12T12:19:08.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc0102c80 0x7f6cc0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 0x7f6cc01988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cc010c0d0 0x7f6cc019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0111fd0 con 0x7f6cc01035a0 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0111e50 con 0x7f6cc010c0d0 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cc57c0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc0112150 con 0x7f6cc0102c80 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cbe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 0x7f6cc01988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cbe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 0x7f6cc01988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55836/0 (socket says 172.21.15.81:55836) 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cbe7fc640 1 -- 172.21.15.81:0/2883148197 learned_addr learned my addr 172.21.15.81:0/2883148197 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cc010c0d0 0x7f6cc019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.356+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc0102c80 0x7f6cc0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cbe7fc640 1 -- 172.21.15.81:0/2883148197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc0102c80 msgr2=0x7f6cc0198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc0102c80 0x7f6cc0198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cbe7fc640 1 -- 172.21.15.81:0/2883148197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cc010c0d0 msgr2=0x7f6cc019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cc010c0d0 0x7f6cc019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cbe7fc640 1 -- 172.21.15.81:0/2883148197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc019d350 con 0x7f6cc01035a0 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 0x7f6cc01988a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9d0 tx=0x7f6cb400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6ca7fff640 1 -- 172.21.15.81:0/2883148197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4004d20 con 0x7f6cc01035a0 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6ca7fff640 1 -- 172.21.15.81:0/2883148197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6cb400cb20 con 0x7f6cc01035a0 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc019d640 con 0x7f6cc01035a0 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6ca7fff640 1 -- 172.21.15.81:0/2883148197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40116d0 con 0x7f6cc01035a0 2024-09-12T12:19:08.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.357+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc01a4ed0 con 0x7f6cc01035a0 2024-09-12T12:19:08.366 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.359+0000 7f6ca7fff640 1 -- 172.21.15.81:0/2883148197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f6cb4011870 con 0x7f6cc01035a0 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.359+0000 7f6cc862f740 1 Processor -- start 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.359+0000 7f6cc862f740 1 -- start start 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 0x56452ad6ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad77770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad77cb0 0x56452ad7a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cc862f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56452acd12f0 con 0x56452ad6caf0 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cc862f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56452ac79270 con 0x56452ad77cb0 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cc862f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56452accd2b0 con 0x56452ad6d410 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 0x56452ad6ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 0x56452ad6ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55846/0 (socket says 172.21.15.81:55846) 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/3924718139 learned_addr learned my addr 172.21.15.81:0/3924718139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:08.367 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad77770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad77cb0 0x56452ad7a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6ca7fff640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f6ca80a2da0 0x7f6ca80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/3924718139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 msgr2=0x56452ad77770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad77770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/3924718139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad77cb0 msgr2=0x56452ad7a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad77cb0 0x56452ad7a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/3924718139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452ac78340 con 0x56452ad6caf0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6ca7fff640 1 -- 172.21.15.81:0/2883148197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f6cb40cf4d0 con 0x7f6cc01035a0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.360+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 0x56452ad6ced0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0033000 tx=0x7f6cb0031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba66875458ec0e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f6ca80a2da0 0x7f6ca80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6ca57fa640 1 -- 172.21.15.81:0/3924718139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0040070 con 0x56452ad6caf0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6ca57fa640 1 -- 172.21.15.81:0/3924718139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6cb0004240 con 0x56452ad6caf0 2024-09-12T12:19:08.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6ca57fa640 1 -- 172.21.15.81:0/3924718139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0035040 con 0x56452ad6caf0 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 -- 172.21.15.81:0/3924718139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 msgr2=0x56452ad6ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 0x56452ad6ced0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0033000 tx=0x7f6cb0031540 comp rx=0 tx=0).stop 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f6ca80a2da0 0x7f6ca80a5260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00315e0 tx=0x7f6cb0045ca0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 -- 172.21.15.81:0/3924718139 shutdown_connections 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad77cb0 0x56452ad7a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad77770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 --2- 172.21.15.81:0/3924718139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad6caf0 0x56452ad6ced0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 -- 172.21.15.81:0/3924718139 >> 172.21.15.81:0/3924718139 conn(0x56452ad69060 msgr2=0x56452ad69440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.361+0000 7f6cc862f740 1 -- 172.21.15.81:0/3924718139 shutdown_connections 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 -- 172.21.15.81:0/3924718139 wait complete. 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 -- start start 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 Processor -- start 2024-09-12T12:19:08.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6caf0 0x56452ad74b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad75600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56452ad7a880 con 0x56452ad77cb0 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56452ac5a290 con 0x56452ad6caf0 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56452ad7aa00 con 0x56452ad6d410 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cc862f740 10 client.0 _ll_register_callbacks cb 0x56452ac8b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad75600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad75600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55850/0 (socket says 172.21.15.81:55850) 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1405633162 learned_addr learned my addr 172.21.15.81:0/1405633162 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6caf0 0x56452ad74b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.362+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1405633162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 msgr2=0x56452ad750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad750c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6caf0 msgr2=0x56452ad74b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6caf0 0x56452ad74b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1405633162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452a9e4210 con 0x56452ad77cb0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad75600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0004650 tx=0x7f6cb0045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7348d56f18473d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6ca2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/1405633162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb005f060 con 0x56452ad77cb0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/1405633162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f6cb0003f60 con 0x56452ad77cb0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cb0004240 con 0x56452ad77cb0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/1405633162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6cb0040070 con 0x56452ad77cb0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cc862f740 10 client.15759 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56452aab0620 con 0x56452ad77cb0 2024-09-12T12:19:08.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/1405633162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6cb0004240 con 0x56452ad77cb0 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/1405633162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f6cb0062020 con 0x56452ad77cb0 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cc862f740 10 client.15759 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.363+0000 7f6cc862f740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6cc862f740 20 client.15759 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452ad87a80 0x56452ad89e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6cc862f740 4 client.15759 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56452acdea20 con 0x56452ad87a80 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452ad87a80 0x56452ad89e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6ca2ff5640 10 client.15759 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.364+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452ad87a80 0x56452ad89e70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80b43de06fc5d24f server_cookie=c16dcc2a993a1aaf in_seq=0 out_seq=0 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/1405633162 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56452acdea20 con 0x56452ad87a80 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6ca2ff5640 10 client.15759 handle_command_reply: tid=0 2024-09-12T12:19:08.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 client.15759 shutdown 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 msgr2=0x56452ad75600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad75600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0004650 tx=0x7f6cb0045000 comp rx=0 tx=0).stop 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 shutdown_connections 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452ad87a80 0x56452ad89e70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad75600 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6d410 0x56452ad750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1405633162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6caf0 0x56452ad74b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6ca2ff5640 0 client.15759 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 >> 172.21.15.81:0/1405633162 conn(0x56452ad69060 msgr2=0x56452ad681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 shutdown_connections 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 1 -- 172.21.15.81:0/1405633162 wait complete. 2024-09-12T12:19:08.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.365+0000 7f6cc862f740 20 client.15759 trim_cache size 0 max 16384 2024-09-12T12:19:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 Processor -- start 2024-09-12T12:19:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 -- start start 2024-09-12T12:19:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad6f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad75430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad8f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01ad680 con 0x56452ad77cb0 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01af4c0 con 0x56452ad6d410 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cc862f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01ade10 con 0x56452ad6caf0 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad8f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad8f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55852/0 (socket says 172.21.15.81:55852) 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1610231979 learned_addr learned my addr 172.21.15.81:0/1610231979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad75430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad6f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1610231979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 msgr2=0x56452ad6f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad6f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1610231979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 msgr2=0x56452ad75430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad75430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/1610231979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452ad642d0 con 0x56452ad77cb0 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad75430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.380+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad8f560 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009850 tx=0x7f6cb0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9082ce20b7e548 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6ca4ff9640 1 -- 172.21.15.81:0/1610231979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0035040 con 0x56452ad77cb0 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6ca4ff9640 1 -- 172.21.15.81:0/1610231979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6cb003cde0 con 0x56452ad77cb0 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6ca4ff9640 1 -- 172.21.15.81:0/1610231979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0005260 con 0x56452ad77cb0 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 -- 172.21.15.81:0/1610231979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 msgr2=0x56452ad8f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad8f560 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009850 tx=0x7f6cb0001e70 comp rx=0 tx=0).stop 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 -- 172.21.15.81:0/1610231979 shutdown_connections 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad8f560 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad75430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 --2- 172.21.15.81:0/1610231979 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad6f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 -- 172.21.15.81:0/1610231979 >> 172.21.15.81:0/1610231979 conn(0x56452ad69060 msgr2=0x56452ad76c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 -- 172.21.15.81:0/1610231979 shutdown_connections 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 -- 172.21.15.81:0/1610231979 wait complete. 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.381+0000 7f6cc862f740 1 -- start start 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 Processor -- start 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad7b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad7be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad7c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01aed30 con 0x56452ad77cb0 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01ae5a0 con 0x56452ad6d410 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc01ab660 con 0x56452ad6caf0 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cc862f740 10 client.0 _ll_register_callbacks cb 0x7f6cb800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:08.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad7c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad7c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55862/0 (socket says 172.21.15.81:55862) 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/2542879359 learned_addr learned my addr 172.21.15.81:0/2542879359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbe7fc640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad7be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad7b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/2542879359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 msgr2=0x56452ad7b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad7b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 msgr2=0x56452ad7be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad7be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 -- 172.21.15.81:0/2542879359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56452adf1530 con 0x56452ad77cb0 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6cbf7fe640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad7c390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009400 tx=0x7f6cb003cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb10eb9c3b790468 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6ca2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:08.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.382+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/2542879359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0072070 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/2542879359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f6cb0003ad0 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cb003cde0 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/2542879359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6cb007e050 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 10 client.15765 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56452adf2760 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/2542879359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6cb003cde0 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/2542879359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f6cb006c070 con 0x56452ad77cb0 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 10 client.15765 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 20 client.15765 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452adf2d70 0x56452adf5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 4 client.15765 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:19:08.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56452acd8d70 con 0x56452adf2d70 2024-09-12T12:19:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.383+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452adf2d70 0x56452adf5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.384+0000 7f6ca2ff5640 10 client.15765 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:08.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.384+0000 7f6cbeffd640 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452adf2d70 0x56452adf5190 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=213dadbeabbd59f6 server_cookie=90dc9a6bc2cc475b in_seq=0 out_seq=0 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6ca2ff5640 1 -- 172.21.15.81:0/2542879359 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56452acd8d70 con 0x56452adf2d70 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6ca2ff5640 10 client.15765 handle_command_reply: tid=0 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 client.15765 shutdown 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 msgr2=0x56452ad7c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad7c390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009400 tx=0x7f6cb003cd50 comp rx=0 tx=0).stop 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 shutdown_connections 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x56452adf2d70 0x56452adf5190 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6ca2ff5640 0 client.15765 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56452ad77cb0 0x56452ad7c390 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.501 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56452ad6d410 0x56452ad7be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 --2- 172.21.15.81:0/2542879359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56452ad6caf0 0x56452ad7b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 >> 172.21.15.81:0/2542879359 conn(0x56452ad69060 msgr2=0x56452ad679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 shutdown_connections 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 1 -- 172.21.15.81:0/2542879359 wait complete. 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.500+0000 7f6cc862f740 20 client.15765 trim_cache size 0 max 16384 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:19:08.502 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:19:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f6ca80a2da0 msgr2=0x7f6ca80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f6ca80a2da0 0x7f6ca80a5260 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00315e0 tx=0x7f6cb0045ca0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 msgr2=0x7f6cc01988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 0x7f6cc01988a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9d0 tx=0x7f6cb400edd0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.503 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 shutdown_connections 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f6ca80a2da0 0x7f6ca80a5260 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6cc010c0d0 0x7f6cc019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cc01035a0 0x7f6cc01988a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 --2- 172.21.15.81:0/2883148197 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6cc0102c80 0x7f6cc0198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 >> 172.21.15.81:0/2883148197 conn(0x7f6cc0077990 msgr2=0x7f6cc00fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 shutdown_connections 2024-09-12T12:19:08.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:08.501+0000 7f6cc57c0640 1 -- 172.21.15.81:0/2883148197 wait complete. 2024-09-12T12:19:09.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:09 smithi081 ceph-mon[30948]: pgmap v84: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.43k op/s 2024-09-12T12:19:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:09 smithi173 ceph-mon[35326]: pgmap v84: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.43k op/s 2024-09-12T12:19:09.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:09 smithi103 ceph-mon[35094]: pgmap v84: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.3 MiB/s wr, 1.43k op/s 2024-09-12T12:19:11.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:11 smithi081 ceph-mon[30948]: pgmap v85: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 400 op/s 2024-09-12T12:19:11.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:11 smithi173 ceph-mon[35326]: pgmap v85: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 400 op/s 2024-09-12T12:19:11.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:11 smithi103 ceph-mon[35094]: pgmap v85: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 400 op/s 2024-09-12T12:19:13.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:13 smithi081 ceph-mon[30948]: pgmap v86: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 459 op/s 2024-09-12T12:19:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:13 smithi173 ceph-mon[35326]: pgmap v86: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 459 op/s 2024-09-12T12:19:13.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:13 smithi103 ceph-mon[35094]: pgmap v86: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 459 op/s 2024-09-12T12:19:15.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:15 smithi081 ceph-mon[30948]: pgmap v87: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 685 KiB/s wr, 268 op/s 2024-09-12T12:19:15.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:15 smithi173 ceph-mon[35326]: pgmap v87: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 685 KiB/s wr, 268 op/s 2024-09-12T12:19:15.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:15 smithi103 ceph-mon[35094]: pgmap v87: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 685 KiB/s wr, 268 op/s 2024-09-12T12:19:17.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:17 smithi081 ceph-mon[30948]: pgmap v88: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 685 KiB/s wr, 268 op/s 2024-09-12T12:19:17.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:17 smithi173 ceph-mon[35326]: pgmap v88: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 685 KiB/s wr, 268 op/s 2024-09-12T12:19:17.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:17 smithi103 ceph-mon[35094]: pgmap v88: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 685 KiB/s wr, 268 op/s 2024-09-12T12:19:19.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:19 smithi081 ceph-mon[30948]: pgmap v89: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 690 KiB/s wr, 275 op/s 2024-09-12T12:19:19.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:19 smithi173 ceph-mon[35326]: pgmap v89: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 690 KiB/s wr, 275 op/s 2024-09-12T12:19:19.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:19 smithi103 ceph-mon[35094]: pgmap v89: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 690 KiB/s wr, 275 op/s 2024-09-12T12:19:21.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 -- 172.21.15.81:0/1043880451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc106a00 msgr2=0x7fa5fc106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 --2- 172.21.15.81:0/1043880451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc106a00 0x7fa5fc106de0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009930 tx=0x7fa5ec02a420 comp rx=0 tx=0).stop 2024-09-12T12:19:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 -- 172.21.15.81:0/1043880451 shutdown_connections 2024-09-12T12:19:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 --2- 172.21.15.81:0/1043880451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5fc101390 0x7fa5fc10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 --2- 172.21.15.81:0/1043880451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 --2- 172.21.15.81:0/1043880451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc106a00 0x7fa5fc106de0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 -- 172.21.15.81:0/1043880451 >> 172.21.15.81:0/1043880451 conn(0x7fa5fc0fc6b0 msgr2=0x7fa5fc0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 -- 172.21.15.81:0/1043880451 shutdown_connections 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.599+0000 7fa6030b7640 1 -- 172.21.15.81:0/1043880451 wait complete. 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 Processor -- start 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 -- start start 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc101390 0x7fa5fc197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5fc106a00 0x7fa5fc19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc110f20 con 0x7fa5fc1009f0 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc110da0 con 0x7fa5fc106a00 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa6030b7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1110a0 con 0x7fa5fc101390 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc1972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45906/0 (socket says 172.21.15.81:45906) 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 -- 172.21.15.81:0/4198112304 learned_addr learned my addr 172.21.15.81:0/4198112304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa601654640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5fc106a00 0x7fa5fc19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc101390 0x7fa5fc197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 -- 172.21.15.81:0/4198112304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc101390 msgr2=0x7fa5fc197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc101390 0x7fa5fc197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 -- 172.21.15.81:0/4198112304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5fc106a00 msgr2=0x7fa5fc19bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5fc106a00 0x7fa5fc19bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa600e53640 1 -- 172.21.15.81:0/4198112304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc19c2e0 con 0x7fa5fc1009f0 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.600+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc101390 0x7fa5fc197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.601+0000 7fa600e53640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc1972f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009a50 tx=0x7fa5ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.601+0000 7fa5f9ffb640 1 -- 172.21.15.81:0/4198112304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec03f030 con 0x7fa5fc1009f0 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.601+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc19c570 con 0x7fa5fc1009f0 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.601+0000 7fa5f9ffb640 1 -- 172.21.15.81:0/4198112304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5ec003af0 con 0x7fa5fc1009f0 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.601+0000 7fa5f9ffb640 1 -- 172.21.15.81:0/4198112304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec035070 con 0x7fa5fc1009f0 2024-09-12T12:19:21.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.601+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc1a3e60 con 0x7fa5fc1009f0 2024-09-12T12:19:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa5f9ffb640 1 -- 172.21.15.81:0/4198112304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa5ec042030 con 0x7fa5fc1009f0 2024-09-12T12:19:21.614 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 Processor -- start 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 -- start start 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84daf9d0 0x562f84dafdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84db02f0 0x562f84dbc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 0x562f84dbf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562f84d142f0 con 0x562f84dbcec0 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f84cbc270 con 0x562f84db02f0 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.604+0000 7fa605e52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f84d102b0 con 0x562f84daf9d0 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5f9ffb640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa5e40a2da0 0x7fa5e40a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 0x562f84dbf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 0x562f84dbf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45910/0 (socket says 172.21.15.81:45910) 2024-09-12T12:19:21.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 -- 172.21.15.81:0/2972458944 learned_addr learned my addr 172.21.15.81:0/2972458944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa600e53640 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84db02f0 0x562f84dbc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa601654640 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84daf9d0 0x562f84dafdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa601654640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa5e40a2da0 0x7fa5e40a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5f9ffb640 1 -- 172.21.15.81:0/4198112304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa5ec0efaa0 con 0x7fa5fc1009f0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 -- 172.21.15.81:0/2972458944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84daf9d0 msgr2=0x562f84dafdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84daf9d0 0x562f84dafdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 -- 172.21.15.81:0/2972458944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84db02f0 msgr2=0x562f84dbc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84db02f0 0x562f84dbc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 -- 172.21.15.81:0/2972458944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f84cbb340 con 0x562f84dbcec0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 0x562f84dbf2b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000bc10 tx=0x7fa5f000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dd5330478e5540 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa601654640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa5e40a2da0 0x7fa5e40a5260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400a780 tx=0x7fa5f400a4d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:21.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.605+0000 7fa5e2ffd640 1 -- 172.21.15.81:0/2972458944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0017620 con 0x562f84dbcec0 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa5e2ffd640 1 -- 172.21.15.81:0/2972458944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f0017cc0 con 0x562f84dbcec0 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa5e2ffd640 1 -- 172.21.15.81:0/2972458944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000fc70 con 0x562f84dbcec0 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 -- 172.21.15.81:0/2972458944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 msgr2=0x562f84dbf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 0x562f84dbf2b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000bc10 tx=0x7fa5f000d710 comp rx=0 tx=0).stop 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 -- 172.21.15.81:0/2972458944 shutdown_connections 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84dbcec0 0x562f84dbf2b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84db02f0 0x562f84dbc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 --2- 172.21.15.81:0/2972458944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84daf9d0 0x562f84dafdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 -- 172.21.15.81:0/2972458944 >> 172.21.15.81:0/2972458944 conn(0x562f84dac060 msgr2=0x562f84dac440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 -- 172.21.15.81:0/2972458944 shutdown_connections 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.606+0000 7fa605e52740 1 -- 172.21.15.81:0/2972458944 wait complete. 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 -- start start 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 Processor -- start 2024-09-12T12:19:21.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 0x562f84db9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84db02f0 0x562f84dba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84dbcec0 0x562f84dba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562f84dbfaf0 con 0x562f84daf9d0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f84c9d290 con 0x562f84dbcec0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f84dbfc70 con 0x562f84db02f0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa605e52740 10 client.0 _ll_register_callbacks cb 0x562f84cce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa600e53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 0x562f84db9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa600e53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 0x562f84db9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45918/0 (socket says 172.21.15.81:45918) 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.607+0000 7fa600e53640 1 -- 172.21.15.81:0/1677119641 learned_addr learned my addr 172.21.15.81:0/1677119641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84db02f0 0x562f84dba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa601654640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84dbcec0 0x562f84dba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.618 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa600e53640 1 -- 172.21.15.81:0/1677119641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84db02f0 msgr2=0x562f84dba300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa600e53640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84db02f0 0x562f84dba300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa600e53640 1 -- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84dbcec0 msgr2=0x562f84dba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa600e53640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84dbcec0 0x562f84dba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa600e53640 1 -- 172.21.15.81:0/1677119641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f84a27210 con 0x562f84daf9d0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa601654640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84dbcec0 0x562f84dba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa600e53640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 0x562f84db9dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec005ec0 tx=0x7fa5ec08af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514d3bf586034f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa5dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1677119641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec049070 con 0x562f84daf9d0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1677119641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa5ec03b460 con 0x562f84daf9d0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f0017cc0 con 0x562f84daf9d0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1677119641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa5ec0dc110 con 0x562f84daf9d0 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa605e52740 10 client.15777 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:21.619 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562f84af3620 con 0x562f84daf9d0 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.608+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1677119641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f0017cc0 con 0x562f84daf9d0 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1677119641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7fa5ec0ed530 con 0x562f84daf9d0 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa605e52740 10 client.15777 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa605e52740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa605e52740 20 client.15777 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa605e52740 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84dcce30 0x562f84dcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa605e52740 4 client.15777 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f84d21a20 con 0x562f84dcce30 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84dcce30 0x562f84dcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa5dbfff640 10 client.15777 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.609+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84dcce30 0x562f84dcf2d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7785569347da43fb server_cookie=7cf11748fc9cde81 in_seq=0 out_seq=0 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1677119641 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f84d21a20 con 0x562f84dcce30 2024-09-12T12:19:21.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa5dbfff640 10 client.15777 handle_command_reply: tid=0 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 client.15777 shutdown 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 msgr2=0x562f84db9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 0x562f84db9dc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec005ec0 tx=0x7fa5ec08af40 comp rx=0 tx=0).stop 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 shutdown_connections 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84dcce30 0x562f84dcf2d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84dbcec0 0x562f84dba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84db02f0 0x562f84dba300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa5dbfff640 0 client.15777 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 --2- 172.21.15.81:0/1677119641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84daf9d0 0x562f84db9dc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 >> 172.21.15.81:0/1677119641 conn(0x562f84dac060 msgr2=0x562f84dab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 shutdown_connections 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.610+0000 7fa605e52740 1 -- 172.21.15.81:0/1677119641 wait complete. 2024-09-12T12:19:21.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.611+0000 7fa605e52740 20 client.15777 trim_cache size 0 max 16384 2024-09-12T12:19:21.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 Processor -- start 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 -- start start 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dd4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84dd50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1ab560 con 0x562f84db02f0 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1ad3a0 con 0x562f84daf9d0 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa605e52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1abcf0 con 0x562f84dbcec0 2024-09-12T12:19:21.632 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa5fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dd4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa5fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dd4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45932/0 (socket says 172.21.15.81:45932) 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.625+0000 7fa5fbfff640 1 -- 172.21.15.81:0/214411706 learned_addr learned my addr 172.21.15.81:0/214411706 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa600e53640 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa601654640 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84dd50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5fbfff640 1 -- 172.21.15.81:0/214411706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 msgr2=0x562f84dd50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84dd50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5fbfff640 1 -- 172.21.15.81:0/214411706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 msgr2=0x562f84dab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.633 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5fbfff640 1 -- 172.21.15.81:0/214411706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f84db9b90 con 0x562f84db02f0 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa601654640 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84dd50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dd4b90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0005d10 tx=0x7fa5f000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f596f2a33bcf9bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5e27fc640 1 -- 172.21.15.81:0/214411706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0030070 con 0x562f84db02f0 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5e27fc640 1 -- 172.21.15.81:0/214411706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f000fde0 con 0x562f84db02f0 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.626+0000 7fa5e27fc640 1 -- 172.21.15.81:0/214411706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00051b0 con 0x562f84db02f0 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 -- 172.21.15.81:0/214411706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 msgr2=0x562f84dd4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dd4b90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0005d10 tx=0x7fa5f000bf10 comp rx=0 tx=0).stop 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 -- 172.21.15.81:0/214411706 shutdown_connections 2024-09-12T12:19:21.634 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84dd50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dd4b90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 --2- 172.21.15.81:0/214411706 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 -- 172.21.15.81:0/214411706 >> 172.21.15.81:0/214411706 conn(0x562f84dac060 msgr2=0x562f84daa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 -- 172.21.15.81:0/214411706 shutdown_connections 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 -- 172.21.15.81:0/214411706 wait complete. 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 -- start start 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.627+0000 7fa605e52740 1 Processor -- start 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dc0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.635 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dc14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84e36b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1acc10 con 0x562f84db02f0 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1ac480 con 0x562f84daf9d0 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1a9560 con 0x562f84dbcec0 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 10 client.0 _ll_register_callbacks cb 0x7fa5ec0bbc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dc14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dc14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45938/0 (socket says 172.21.15.81:45938) 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 -- 172.21.15.81:0/1419239327 learned_addr learned my addr 172.21.15.81:0/1419239327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:21.636 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa600e53640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dc0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa601654640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84e36b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 -- 172.21.15.81:0/1419239327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 msgr2=0x562f84e36b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84e36b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 -- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 msgr2=0x562f84dc0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dc0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 -- 172.21.15.81:0/1419239327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f84dc1da0 con 0x562f84db02f0 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa601654640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84e36b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5fbfff640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dc14c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0019040 tx=0x7fa5f000bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83292eb1fd0cb4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:21.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1419239327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0030070 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1419239327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7fa5f000fae0 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.628+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f000fde0 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1419239327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa5f003c050 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 10 client.15783 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562f84e38130 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1419239327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa5f000fde0 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1419239327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7fa5f002a070 con 0x562f84db02f0 2024-09-12T12:19:21.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 10 client.15783 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 20 client.15783 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84e38600 0x562f84e3aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 4 client.15783 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f84d1bd70 con 0x562f84e38600 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.629+0000 7fa600e53640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84e38600 0x562f84e3aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.630+0000 7fa600e53640 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84e38600 0x562f84e3aa20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd61fd3062e5d0f8 server_cookie=5018e89f663e355d in_seq=0 out_seq=0 2024-09-12T12:19:21.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.630+0000 7fa5dbfff640 10 client.15783 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa5dbfff640 1 -- 172.21.15.81:0/1419239327 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f84d1bd70 con 0x562f84e38600 2024-09-12T12:19:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa5dbfff640 10 client.15783 handle_command_reply: tid=0 2024-09-12T12:19:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 client.15783 shutdown 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 msgr2=0x562f84dc14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dc14c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0019040 tx=0x7fa5f000bb70 comp rx=0 tx=0).stop 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 shutdown_connections 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x562f84e38600 0x562f84e3aa20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f84dbcec0 0x562f84e36b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562f84db02f0 0x562f84dc14c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 --2- 172.21.15.81:0/1419239327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f84daf9d0 0x562f84dc0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa5dbfff640 0 client.15783 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.652+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 >> 172.21.15.81:0/1419239327 conn(0x562f84dac060 msgr2=0x562f84db1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 shutdown_connections 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa605e52740 1 -- 172.21.15.81:0/1419239327 wait complete. 2024-09-12T12:19:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa605e52740 20 client.15783 trim_cache size 0 max 16384 2024-09-12T12:19:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:19:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:19:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:19:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa5e40a2da0 msgr2=0x7fa5e40a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa5e40a2da0 0x7fa5e40a5260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400a780 tx=0x7fa5f400a4d0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 msgr2=0x7fa5fc1972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc1972f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009a50 tx=0x7fa5ec004270 comp rx=0 tx=0).stop 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 shutdown_connections 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa5e40a2da0 0x7fa5e40a5260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5fc106a00 0x7fa5fc19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5fc101390 0x7fa5fc197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 --2- 172.21.15.81:0/4198112304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5fc1009f0 0x7fa5fc1972f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 >> 172.21.15.81:0/4198112304 conn(0x7fa5fc0fc6b0 msgr2=0x7fa5fc0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 shutdown_connections 2024-09-12T12:19:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:21.653+0000 7fa6030b7640 1 -- 172.21.15.81:0/4198112304 wait complete. 2024-09-12T12:19:21.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:21 smithi081 ceph-mon[30948]: pgmap v90: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 106 KiB/s wr, 65 op/s 2024-09-12T12:19:21.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:21 smithi173 ceph-mon[35326]: pgmap v90: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 106 KiB/s wr, 65 op/s 2024-09-12T12:19:21.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:21 smithi103 ceph-mon[35094]: pgmap v90: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 106 KiB/s wr, 65 op/s 2024-09-12T12:19:23.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:19:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:23.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:23 smithi081 ceph-mon[30948]: pgmap v91: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 110 KiB/s wr, 71 op/s 2024-09-12T12:19:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:23 smithi173 ceph-mon[35326]: pgmap v91: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 110 KiB/s wr, 71 op/s 2024-09-12T12:19:23.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:23 smithi103 ceph-mon[35094]: pgmap v91: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 110 KiB/s wr, 71 op/s 2024-09-12T12:19:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 -- 172.21.15.81:0/1569502603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 msgr2=0x7f7d5c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 --2- 172.21.15.81:0/1569502603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c103110 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009930 tx=0x7f7d4c02a420 comp rx=0 tx=0).stop 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 -- 172.21.15.81:0/1569502603 shutdown_connections 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 --2- 172.21.15.81:0/1569502603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d5c1082a0 0x7f7d5c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 --2- 172.21.15.81:0/1569502603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1036e0 0x7f7d5c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 --2- 172.21.15.81:0/1569502603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c103110 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 -- 172.21.15.81:0/1569502603 >> 172.21.15.81:0/1569502603 conn(0x7f7d5c0fc7d0 msgr2=0x7f7d5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 -- 172.21.15.81:0/1569502603 shutdown_connections 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.403+0000 7f7d6153e640 1 -- 172.21.15.81:0/1569502603 wait complete. 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 Processor -- start 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 -- start start 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d5c1036e0 0x7f7d5c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1082a0 0x7f7d5c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:24.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c1121c0 con 0x7f7d5c102d30 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c112040 con 0x7f7d5c1082a0 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d6153e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c112340 con 0x7f7d5c1036e0 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d5affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d5affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33466/0 (socket says 172.21.15.81:33466) 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.404+0000 7f7d5affd640 1 -- 172.21.15.81:0/435701101 learned_addr learned my addr 172.21.15.81:0/435701101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5b7fe640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1082a0 0x7f7d5c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5affd640 1 -- 172.21.15.81:0/435701101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d5c1036e0 msgr2=0x7f7d5c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5a7fc640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d5c1036e0 0x7f7d5c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5affd640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d5c1036e0 0x7f7d5c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5affd640 1 -- 172.21.15.81:0/435701101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1082a0 msgr2=0x7f7d5c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5affd640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1082a0 0x7f7d5c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5affd640 1 -- 172.21.15.81:0/435701101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c1a6ad0 con 0x7f7d5c102d30 2024-09-12T12:19:24.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5b7fe640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1082a0 0x7f7d5c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d5affd640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c100990 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009230 tx=0x7f7d4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c03f030 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5c1a6d60 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d4c003af0 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c035070 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.405+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5c1a7230 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.406+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5c103110 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.407+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7d4c042030 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.408+0000 7f7d43fff640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f7d440a2cf0 0x7f7d440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.408+0000 7f7d5a7fc640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f7d440a2cf0 0x7f7d440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.408+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f7d4c0f00d0 con 0x7f7d5c102d30 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.408+0000 7f7d5a7fc640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f7d440a2cf0 0x7f7d440a51b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c102420 tx=0x7f7d50005cc0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:24.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.412+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d4c0bcdc0 con 0x7f7d5c102d30 2024-09-12T12:19:24.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.613+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d5c10a2b0 con 0x7f7d5c102d30 2024-09-12T12:19:24.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.614+0000 7f7d43fff640 1 -- 172.21.15.81:0/435701101 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+12017 (secure 0 0 0) 0x7f7d4c0bc6c0 con 0x7f7d5c102d30 2024-09-12T12:19:24.616 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:19:24.616 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"btime":"2024-09-12T12:19:01:478574+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:19:01.170409+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:19:24.616 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 37 2024-09-12T12:19:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f7d440a2cf0 msgr2=0x7f7d440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f7d440a2cf0 0x7f7d440a51b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c102420 tx=0x7f7d50005cc0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 msgr2=0x7f7d5c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c100990 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009230 tx=0x7f7d4c004270 comp rx=0 tx=0).stop 2024-09-12T12:19:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 shutdown_connections 2024-09-12T12:19:24.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f7d440a2cf0 0x7f7d440a51b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5c1082a0 0x7f7d5c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d5c1036e0 0x7f7d5c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 --2- 172.21.15.81:0/435701101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d5c102d30 0x7f7d5c100990 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:24.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 >> 172.21.15.81:0/435701101 conn(0x7f7d5c0fc7d0 msgr2=0x7f7d5c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:24.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 shutdown_connections 2024-09-12T12:19:24.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:24.616+0000 7f7d6153e640 1 -- 172.21.15.81:0/435701101 wait complete. 2024-09-12T12:19:25.456 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --set-id e02adb47 --release --await' 2024-09-12T12:19:25.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --set-id e02adb47 --release --await 2024-09-12T12:19:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:25.825 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:25 smithi081 ceph-mon[30948]: pgmap v92: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-09-12T12:19:25.826 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:25 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/435701101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:25.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:25 smithi173 ceph-mon[35326]: pgmap v92: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-09-12T12:19:25.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:25 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/435701101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:25.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:25 smithi103 ceph-mon[35094]: pgmap v92: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-09-12T12:19:25.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:25 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/435701101' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.200+0000 7ff981077640 1 -- 172.21.15.81:0/940950718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c101de0 msgr2=0x7ff97c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.200+0000 7ff981077640 1 --2- 172.21.15.81:0/940950718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c101de0 0x7ff97c1021c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009900 tx=0x7ff96c02a410 comp rx=0 tx=0).stop 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 -- 172.21.15.81:0/940950718 shutdown_connections 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 --2- 172.21.15.81:0/940950718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff97c106f10 0x7ff97c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 --2- 172.21.15.81:0/940950718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 0x7ff97c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 --2- 172.21.15.81:0/940950718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c101de0 0x7ff97c1021c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 -- 172.21.15.81:0/940950718 >> 172.21.15.81:0/940950718 conn(0x7ff97c0fd8c0 msgr2=0x7ff97c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 -- 172.21.15.81:0/940950718 shutdown_connections 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 -- 172.21.15.81:0/940950718 wait complete. 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.201+0000 7ff981077640 1 Processor -- start 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 -- start start 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff97c101de0 0x7ff97c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 0x7ff97c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 0x7ff97c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c112050 con 0x7ff97c106f10 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c111ed0 con 0x7ff97c102790 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff981077640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1121d0 con 0x7ff97c101de0 2024-09-12T12:19:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 0x7ff97c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 0x7ff97c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff97c101de0 0x7ff97c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 0x7ff97c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:39702/0 (socket says 172.21.15.81:39702) 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97a59c640 1 -- 172.21.15.81:0/4150714831 learned_addr learned my addr 172.21.15.81:0/4150714831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 0x7ff97c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33488/0 (socket says 172.21.15.81:33488) 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 -- 172.21.15.81:0/4150714831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff97c101de0 msgr2=0x7ff97c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff97c101de0 0x7ff97c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 -- 172.21.15.81:0/4150714831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 msgr2=0x7ff97c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 0x7ff97c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 -- 172.21.15.81:0/4150714831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c1a69b0 con 0x7ff97c106f10 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.202+0000 7ff97b59e640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 0x7ff97c074f70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff97400ca30 tx=0x7ff97400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.203+0000 7ff963fff640 1 -- 172.21.15.81:0/4150714831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974007d90 con 0x7ff97c106f10 2024-09-12T12:19:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.203+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c1a6ca0 con 0x7ff97c106f10 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.203+0000 7ff963fff640 1 -- 172.21.15.81:0/4150714831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff974004b20 con 0x7ff97c106f10 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.203+0000 7ff963fff640 1 -- 172.21.15.81:0/4150714831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97400f810 con 0x7ff97c106f10 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.203+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c1a71e0 con 0x7ff97c106f10 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.205+0000 7ff963fff640 1 -- 172.21.15.81:0/4150714831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff974004cd0 con 0x7ff97c106f10 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.205+0000 7ff983450740 1 Processor -- start 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.205+0000 7ff983450740 1 -- start start 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff983450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83833e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff983450740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e838348d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff983450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e83834b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff983450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e8382a3620 con 0x55e838349240 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff983450740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e83824ae50 con 0x55e83833e980 2024-09-12T12:19:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff983450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e83829f5e0 con 0x55e83833e060 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff963fff640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff9640a2cf0 0x7ff9640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e83834b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e83834b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33490/0 (socket says 172.21.15.81:33490) 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 -- 172.21.15.81:0/2215164379 learned_addr learned my addr 172.21.15.81:0/2215164379 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97b59e640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff9640a2cf0 0x7ff9640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e838348d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83833e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff963fff640 1 -- 172.21.15.81:0/4150714831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7ff9740cf630 con 0x7ff97c106f10 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 -- 172.21.15.81:0/2215164379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 msgr2=0x55e83833e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83833e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 -- 172.21.15.81:0/2215164379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 msgr2=0x55e838348d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e838348d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 -- 172.21.15.81:0/2215164379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e83823bd40 con 0x55e838349240 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97b59e640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff9640a2cf0 0x7ff9640a51b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff97409b910 tx=0x7ff97406ec80 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.206+0000 7ff97a59c640 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e83834b630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff970005d10 tx=0x7ff97000a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0dbb352cc74d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff9617fa640 1 -- 172.21.15.81:0/2215164379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970005020 con 0x55e838349240 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff9617fa640 1 -- 172.21.15.81:0/2215164379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9700047a0 con 0x55e838349240 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff9617fa640 1 -- 172.21.15.81:0/2215164379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97000fa70 con 0x55e838349240 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 -- 172.21.15.81:0/2215164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 msgr2=0x55e83834b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e83834b630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff970005d10 tx=0x7ff97000a790 comp rx=0 tx=0).stop 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 -- 172.21.15.81:0/2215164379 shutdown_connections 2024-09-12T12:19:26.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e83834b630 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e838348d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 --2- 172.21.15.81:0/2215164379 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83833e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 -- 172.21.15.81:0/2215164379 >> 172.21.15.81:0/2215164379 conn(0x55e83833a5f0 msgr2=0x55e83833a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 -- 172.21.15.81:0/2215164379 shutdown_connections 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.207+0000 7ff983450740 1 -- 172.21.15.81:0/2215164379 wait complete. 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 -- start start 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 Processor -- start 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e060 0x55e8383461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e838346730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e838349240 0x55e838346c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55e83834be10 con 0x55e83833e980 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e83822bf10 con 0x55e83833e060 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e83834bf90 con 0x55e838349240 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff983450740 10 client.0 _ll_register_callbacks cb 0x55e83824fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e838346730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e838346730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33504/0 (socket says 172.21.15.81:33504) 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 -- 172.21.15.81:0/3716824306 learned_addr learned my addr 172.21.15.81:0/3716824306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97a59c640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e060 0x55e8383461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97a59c640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e838349240 0x55e838346c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 -- 172.21.15.81:0/3716824306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e838349240 msgr2=0x55e838346c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e838349240 0x55e838346c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 -- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e060 msgr2=0x55e8383461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e060 0x55e8383461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.208+0000 7ff97ad9d640 1 -- 172.21.15.81:0/3716824306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e837fb2580 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e838346730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009900 tx=0x7ff96c031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1281587989e48c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff95eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff95eff5640 1 -- 172.21.15.81:0/3716824306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c035040 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff95eff5640 1 -- 172.21.15.81:0/3716824306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7ff96c004340 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9700047a0 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff95eff5640 1 -- 172.21.15.81:0/3716824306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff96c005020 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 10 client.15801 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e83807c960 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff95eff5640 1 -- 172.21.15.81:0/3716824306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9700047a0 con 0x55e83833e980 2024-09-12T12:19:26.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff95eff5640 1 -- 172.21.15.81:0/3716824306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7ff96c04e020 con 0x55e83833e980 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 10 client.15801 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 10 client.15801 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 20 client.15801 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e838358e10 0x55e83835b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 4 client.15801 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.209+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8382b0b90 con 0x55e838358e10 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.210+0000 7ff97a59c640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e838358e10 0x55e83835b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.210+0000 7ff95eff5640 10 client.15801 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.210+0000 7ff97a59c640 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e838358e10 0x55e83835b2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ae75ca4eb4afd02 server_cookie=b961d11f244c5cf4 in_seq=0 out_seq=0 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff95eff5640 1 -- 172.21.15.81:0/3716824306 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8382b0b90 con 0x55e838358e10 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff95eff5640 10 client.15801 handle_command_reply: tid=0 2024-09-12T12:19:26.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 client.15801 shutdown 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 msgr2=0x55e838346730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e838346730 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009900 tx=0x7ff96c031b80 comp rx=0 tx=0).stop 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 shutdown_connections 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e838358e10 0x55e83835b2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e838349240 0x55e838346c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e838346730 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 --2- 172.21.15.81:0/3716824306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e060 0x55e8383461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff95eff5640 0 client.15801 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 >> 172.21.15.81:0/3716824306 conn(0x55e83833a5f0 msgr2=0x55e8383402d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 shutdown_connections 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 1 -- 172.21.15.81:0/3716824306 wait complete. 2024-09-12T12:19:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.211+0000 7ff983450740 20 client.15801 trim_cache size 0 max 16384 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 Processor -- start 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 -- start start 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e8383352b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e8383401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e838349240 0x55e838360ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1af9c0 con 0x55e83833e980 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b1800 con 0x55e838349240 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff983450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b0150 con 0x55e83833e060 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e8383401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e8383401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33510/0 (socket says 172.21.15.81:33510) 2024-09-12T12:19:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 -- 172.21.15.81:0/2025895145 learned_addr learned my addr 172.21.15.81:0/2025895145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97a59c640 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e8383352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 -- 172.21.15.81:0/2025895145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 msgr2=0x55e8383352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e8383352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 -- 172.21.15.81:0/2025895145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e838349240 msgr2=0x55e838360ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e838349240 0x55e838360ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 -- 172.21.15.81:0/2025895145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e838348130 con 0x55e83833e980 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e8383401c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff96c000c00 tx=0x7ff96c003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69b67dcaf1599eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.228+0000 7ff960ff9640 1 -- 172.21.15.81:0/2025895145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c035030 con 0x55e83833e980 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff960ff9640 1 -- 172.21.15.81:0/2025895145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff96c004ca0 con 0x55e83833e980 2024-09-12T12:19:26.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff960ff9640 1 -- 172.21.15.81:0/2025895145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c003fd0 con 0x55e83833e980 2024-09-12T12:19:26.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 -- 172.21.15.81:0/2025895145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 msgr2=0x55e8383401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e8383401c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff96c000c00 tx=0x7ff96c003a60 comp rx=0 tx=0).stop 2024-09-12T12:19:26.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 -- 172.21.15.81:0/2025895145 shutdown_connections 2024-09-12T12:19:26.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e838349240 0x55e838360ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e83833e980 0x55e8383401c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 --2- 172.21.15.81:0/2025895145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e8383352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 -- 172.21.15.81:0/2025895145 >> 172.21.15.81:0/2025895145 conn(0x55e83833a5f0 msgr2=0x55e83833fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 -- 172.21.15.81:0/2025895145 shutdown_connections 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.229+0000 7ff983450740 1 -- 172.21.15.81:0/2025895145 wait complete. 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 -- start start 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 Processor -- start 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83834da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e83834df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e8383bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b1070 con 0x55e838349240 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1b08e0 con 0x55e83833e980 2024-09-12T12:19:26.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c1ad9a0 con 0x55e83833e060 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff983450740 10 client.0 _ll_register_callbacks cb 0x7ff96c031810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e8383bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e8383bbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33520/0 (socket says 172.21.15.81:33520) 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 -- 172.21.15.81:0/1034746328 learned_addr learned my addr 172.21.15.81:0/1034746328 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83834da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e83834df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 -- 172.21.15.81:0/1034746328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 msgr2=0x55e83834da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83834da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 -- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 msgr2=0x55e83834df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e83834df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97a59c640 1 -- 172.21.15.81:0/1034746328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8383bc1d0 con 0x55e838349240 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.230+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e83834df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff97a59c640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e8383bbb30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff970013010 tx=0x7ff97001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227d370a0b5cad91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:26.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff95eff5640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff95eff5640 1 -- 172.21.15.81:0/1034746328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970004c90 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff95eff5640 1 -- 172.21.15.81:0/1034746328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7ff97002de80 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff96c004ca0 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff95eff5640 1 -- 172.21.15.81:0/1034746328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff97003f050 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 10 client.15807 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55e8383c4730 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff95eff5640 1 -- 172.21.15.81:0/1034746328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff96c004ca0 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff95eff5640 1 -- 172.21.15.81:0/1034746328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7ff970005430 con 0x55e838349240 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 10 client.15807 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 10 client.15807 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 20 client.15807 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e8383c4ca0 0x55e8383c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:26.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 4 client.15807 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e02adb47", "release": true, "await": true}] 2024-09-12T12:19:26.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.231+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e02adb47", "release": true, "await": true}) -- 0x55e8382ab0a0 con 0x55e8383c4ca0 2024-09-12T12:19:26.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.232+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e8383c4ca0 0x55e8383c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:26.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.232+0000 7ff95eff5640 10 client.15807 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:26.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.232+0000 7ff97ad9d640 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e8383c4ca0 0x55e8383c70c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94545e0e8c86ff62 server_cookie=78e2021e986bfc8e in_seq=0 out_seq=0 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff95eff5640 1 -- 172.21.15.81:0/1034746328 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e8382ab0a0 con 0x55e8383c4ca0 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff95eff5640 10 client.15807 handle_command_reply: tid=0 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 client.15807 shutdown 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 msgr2=0x55e8383bbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e8383bbb30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff970013010 tx=0x7ff97001a040 comp rx=0 tx=0).stop 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 shutdown_connections 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55e8383c4ca0 0x55e8383c70c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e838349240 0x55e8383bbb30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e83833e980 0x55e83834df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff95eff5640 0 client.15807 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 --2- 172.21.15.81:0/1034746328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e83833e060 0x55e83834da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 >> 172.21.15.81:0/1034746328 conn(0x55e83833a5f0 msgr2=0x55e838339750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 shutdown_connections 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 1 -- 172.21.15.81:0/1034746328 wait complete. 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.291+0000 7ff983450740 20 client.15807 trim_cache size 0 max 16384 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 37, 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 12, 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": { 2024-09-12T12:19:26.293 INFO:teuthology.orchestra.run.smithi081.stdout: "e02adb47": { 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "version": 12, 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "age_ref": 0.0, 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "timeout": 90.0, 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "expiration": 144.7, 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "members": { 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "file:/": { 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "excluded": false, 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "state": { 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RELEASED", 2024-09-12T12:19:26.294 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:19:26.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff9640a2cf0 msgr2=0x7ff9640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff9640a2cf0 0x7ff9640a51b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff97409b910 tx=0x7ff97406ec80 comp rx=0 tx=0).stop 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 msgr2=0x7ff97c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 0x7ff97c074f70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff97400ca30 tx=0x7ff97400cef0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 shutdown_connections 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff9640a2cf0 0x7ff9640a51b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff97c106f10 0x7ff97c074f70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff97c102790 0x7ff97c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 --2- 172.21.15.81:0/4150714831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff97c101de0 0x7ff97c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 >> 172.21.15.81:0/4150714831 conn(0x7ff97c0fd8c0 msgr2=0x7ff97c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 shutdown_connections 2024-09-12T12:19:26.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:26.292+0000 7ff981077640 1 -- 172.21.15.81:0/4150714831 wait complete. 2024-09-12T12:19:27.066 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e02adb47', total seconds elapsed: 28.2 2024-09-12T12:19:27.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:27 smithi081 ceph-mon[30948]: pgmap v93: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-09-12T12:19:27.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:27 smithi173 ceph-mon[35326]: pgmap v93: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-09-12T12:19:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:27 smithi103 ceph-mon[35094]: pgmap v93: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-09-12T12:19:29.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:29 smithi081 ceph-mon[30948]: pgmap v94: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-09-12T12:19:29.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:29 smithi173 ceph-mon[35326]: pgmap v94: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-09-12T12:19:29.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:29 smithi103 ceph-mon[35094]: pgmap v94: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-09-12T12:19:31.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:31 smithi081 ceph-mon[30948]: pgmap v95: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 57 KiB/s wr, 20 op/s 2024-09-12T12:19:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:31 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:31.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:31 smithi173 ceph-mon[35326]: pgmap v95: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 57 KiB/s wr, 20 op/s 2024-09-12T12:19:31.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:31 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:31.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:31 smithi103 ceph-mon[35094]: pgmap v95: 97 pgs: 97 active+clean; 210 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 57 KiB/s wr, 20 op/s 2024-09-12T12:19:31.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:31 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:19:32.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:32.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:19:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:32.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:19:32.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:19:32.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:19:32.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:19:33.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:33 smithi081 ceph-mon[30948]: pgmap v96: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 788 KiB/s wr, 160 op/s 2024-09-12T12:19:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:33 smithi173 ceph-mon[35326]: pgmap v96: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 788 KiB/s wr, 160 op/s 2024-09-12T12:19:33.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:33 smithi103 ceph-mon[35094]: pgmap v96: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 788 KiB/s wr, 160 op/s 2024-09-12T12:19:34.207 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-12T12:19:34.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T12:19:34.539 DEBUG:teuthology.parallel:result is None 2024-09-12T12:19:34.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T12:19:34.573 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T12:19:34.573 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-12T12:19:34.585 INFO:tasks.quiescer:joining Quiescers 2024-09-12T12:19:34.585 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-12T12:19:34.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 -- 172.21.15.81:0/936097723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 msgr2=0x7f11ac10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/936097723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac10e550 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009ca0 tx=0x7f11a402a950 comp rx=0 tx=0).stop 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 -- 172.21.15.81:0/936097723 shutdown_connections 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/936097723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac10e550 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/936097723 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11ac103620 0x7f11ac10bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/936097723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 0x7f11ac1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 -- 172.21.15.81:0/936097723 >> 172.21.15.81:0/936097723 conn(0x7f11ac077990 msgr2=0x7f11ac0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:34.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 -- 172.21.15.81:0/936097723 shutdown_connections 2024-09-12T12:19:34.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 -- 172.21.15.81:0/936097723 wait complete. 2024-09-12T12:19:34.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 Processor -- start 2024-09-12T12:19:34.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.743+0000 7f11b3fd8640 1 -- start start 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 0x7f11ac198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11ac103620 0x7f11ac1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac112020 con 0x7f11ac10c0d0 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac111ea0 con 0x7f11ac102d00 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1121a0 con 0x7f11ac103620 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60344/0 (socket says 172.21.15.81:60344) 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 -- 172.21.15.81:0/128462551 learned_addr learned my addr 172.21.15.81:0/128462551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b1573640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11ac103620 0x7f11ac1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b1d74640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 0x7f11ac198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 -- 172.21.15.81:0/128462551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11ac103620 msgr2=0x7f11ac1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11ac103620 0x7f11ac1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 -- 172.21.15.81:0/128462551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 msgr2=0x7f11ac198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 0x7f11ac198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 -- 172.21.15.81:0/128462551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ac19d380 con 0x7f11ac10c0d0 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b1d74640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 0x7f11ac198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b2575640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac19cc50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005e30 tx=0x7f11a402fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11a2ffd640 1 -- 172.21.15.81:0/128462551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4034040 con 0x7f11ac10c0d0 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11a2ffd640 1 -- 172.21.15.81:0/128462551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11a4030940 con 0x7f11ac10c0d0 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11a2ffd640 1 -- 172.21.15.81:0/128462551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4045480 con 0x7f11ac10c0d0 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ac19d610 con 0x7f11ac10c0d0 2024-09-12T12:19:34.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.744+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ac1a4f00 con 0x7f11ac10c0d0 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 Processor -- start 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11a2ffd640 1 -- 172.21.15.81:0/128462551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f11a4037020 con 0x7f11ac10c0d0 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 -- start start 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b7bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105b8d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a105ae02f0 con 0x55a105b8b0c0 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a105a88270 con 0x55a105b7b9f0 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.747+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a105adc2b0 con 0x55a105b7c310 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105b8d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.81:51044/0 (socket says 172.21.15.81:51044) 2024-09-12T12:19:34.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 -- 172.21.15.81:0/851809384 learned_addr learned my addr 172.21.15.81:0/851809384 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11a2ffd640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f11980a2da0 0x7f11980a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1573640 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b7bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 -- 172.21.15.81:0/851809384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 msgr2=0x55a105b7bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b7bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 -- 172.21.15.81:0/851809384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 msgr2=0x55a105b8d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105b8d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 -- 172.21.15.81:0/851809384 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a105a87340 con 0x55a105b7c310 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b2575640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f11980a2da0 0x7f11980a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11a2ffd640 1 -- 172.21.15.81:0/128462551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f11a40f0190 con 0x7f11ac10c0d0 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b1d74640 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8ab80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009c30 tx=0x7f11a8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd1fe7473ec8ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f1197fff640 1 -- 172.21.15.81:0/851809384 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8004030 con 0x55a105b7c310 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.748+0000 7f11b2575640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f11980a2da0 0x7f11980a5260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f11a40edb10 tx=0x7f11a40b1cc0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:34.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f1197fff640 1 -- 172.21.15.81:0/851809384 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11a80041d0 con 0x55a105b7c310 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f1197fff640 1 -- 172.21.15.81:0/851809384 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a80126b0 con 0x55a105b7c310 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 -- 172.21.15.81:0/851809384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 msgr2=0x55a105b8ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8ab80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009c30 tx=0x7f11a8010740 comp rx=0 tx=0).stop 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 -- 172.21.15.81:0/851809384 shutdown_connections 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105b8d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8ab80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/851809384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b7bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 -- 172.21.15.81:0/851809384 >> 172.21.15.81:0/851809384 conn(0x55a105b78060 msgr2=0x55a105b78440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:34.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 -- 172.21.15.81:0/851809384 shutdown_connections 2024-09-12T12:19:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.749+0000 7f11b6e4b740 1 -- 172.21.15.81:0/851809384 wait complete. 2024-09-12T12:19:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 -- start start 2024-09-12T12:19:34.753 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 Processor -- start 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 0x55a105b87fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b884e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105b88a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a105b8dd20 con 0x55a105b7b9f0 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a105a69290 con 0x55a105b8b0c0 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a105b8dea0 con 0x55a105b7c310 2024-09-12T12:19:34.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b6e4b740 10 client.0 _ll_register_callbacks cb 0x55a105a9a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b1573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 0x55a105b87fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b1573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 0x55a105b87fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60366/0 (socket says 172.21.15.81:60366) 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b1573640 1 -- 172.21.15.81:0/1004159641 learned_addr learned my addr 172.21.15.81:0/1004159641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b1573640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105b88a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.750+0000 7f11b1d74640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b884e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b1573640 1 -- 172.21.15.81:0/1004159641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 msgr2=0x55a105b884e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b1573640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b884e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b1573640 1 -- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 msgr2=0x55a105b88a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b1573640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105b88a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b1573640 1 -- 172.21.15.81:0/1004159641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1057f3210 con 0x55a105b7b9f0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b1573640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 0x55a105b87fa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c010 tx=0x7f119c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d6284026811d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11957fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:34.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11957fa640 1 -- 172.21.15.81:0/1004159641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c004220 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11957fa640 1 -- 172.21.15.81:0/1004159641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f119c0043c0 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a80041d0 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11957fa640 1 -- 172.21.15.81:0/1004159641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f119c0108d0 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b6e4b740 10 client.15819 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a1058bf620 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.751+0000 7f11957fa640 1 -- 172.21.15.81:0/1004159641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11a80041d0 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11957fa640 1 -- 172.21.15.81:0/1004159641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f119c027030 con 0x55a105b7b9f0 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b6e4b740 10 client.15819 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b6e4b740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b6e4b740 20 client.15819 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105b9b220 0x55a105b9d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b6e4b740 4 client.15819 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a105aeda20 con 0x55a105b9b220 2024-09-12T12:19:34.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b1d74640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105b9b220 0x55a105b9d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11957fa640 10 client.15819 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.752+0000 7f11b1d74640 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105b9b220 0x55a105b9d680 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cac3b39cc17d9c5 server_cookie=d1eff1e77828cb40 in_seq=0 out_seq=0 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11957fa640 1 -- 172.21.15.81:0/1004159641 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a105aeda20 con 0x55a105b9b220 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11957fa640 10 client.15819 handle_command_reply: tid=0 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 client.15819 shutdown 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 msgr2=0x55a105b87fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 0x55a105b87fa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c010 tx=0x7f119c004730 comp rx=0 tx=0).stop 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 shutdown_connections 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105b9b220 0x55a105b9d680 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105b88a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b884e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1004159641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7b9f0 0x55a105b87fa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11957fa640 0 client.15819 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 >> 172.21.15.81:0/1004159641 conn(0x55a105b78060 msgr2=0x55a105b7ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.753+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 shutdown_connections 2024-09-12T12:19:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.754+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1004159641 wait complete. 2024-09-12T12:19:34.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.754+0000 7f11b6e4b740 20 client.15819 trim_cache size 0 max 16384 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 Processor -- start 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 -- start start 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7b9f0 0x55a105b770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 0x55a105ba2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105ba34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1ab4a0 con 0x55a105b7c310 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1ad2e0 con 0x55a105b8b0c0 2024-09-12T12:19:34.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1abc30 con 0x55a105b7b9f0 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 0x55a105ba2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 0x55a105ba2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60382/0 (socket says 172.21.15.81:60382) 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 -- 172.21.15.81:0/3354032849 learned_addr learned my addr 172.21.15.81:0/3354032849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1573640 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7b9f0 0x55a105b770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1573640 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105ba34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 -- 172.21.15.81:0/3354032849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7b9f0 msgr2=0x55a105b770b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7b9f0 0x55a105b770b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 -- 172.21.15.81:0/3354032849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 msgr2=0x55a105ba34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105ba34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 -- 172.21.15.81:0/3354032849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a105b77e90 con 0x55a105b7c310 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11b1d74640 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 0x55a105ba2f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x55a105b7e6c0 tx=0x7f11a8010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2003fe414d792e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:34.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.768+0000 7f11977fe640 1 -- 172.21.15.81:0/3354032849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8009770 con 0x55a105b7c310 2024-09-12T12:19:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.769+0000 7f11977fe640 1 -- 172.21.15.81:0/3354032849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11a8003af0 con 0x55a105b7c310 2024-09-12T12:19:34.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.769+0000 7f11977fe640 1 -- 172.21.15.81:0/3354032849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a80126b0 con 0x55a105b7c310 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 -- 172.21.15.81:0/3354032849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 msgr2=0x55a105ba2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 0x55a105ba2f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x55a105b7e6c0 tx=0x7f11a8010f70 comp rx=0 tx=0).stop 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 -- 172.21.15.81:0/3354032849 shutdown_connections 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b8b0c0 0x55a105ba34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b7c310 0x55a105ba2f90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/3354032849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7b9f0 0x55a105b770b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 -- 172.21.15.81:0/3354032849 >> 172.21.15.81:0/3354032849 conn(0x55a105b78060 msgr2=0x55a105b769a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 -- 172.21.15.81:0/3354032849 shutdown_connections 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 -- 172.21.15.81:0/3354032849 wait complete. 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 -- start start 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.770+0000 7f11b6e4b740 1 Processor -- start 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105c04f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1acb50 con 0x55a105b8b0c0 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1ac3c0 con 0x55a105b7b9f0 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11ac1a94a0 con 0x55a105b7c310 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 10 client.0 _ll_register_callbacks cb 0x7f119c012550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105c04f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105c04f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60390/0 (socket says 172.21.15.81:60390) 2024-09-12T12:19:34.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 -- 172.21.15.81:0/1071484700 learned_addr learned my addr 172.21.15.81:0/1071484700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1d74640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 -- 172.21.15.81:0/1071484700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 msgr2=0x55a105b8fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 -- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 msgr2=0x55a105b8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b8f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 -- 172.21.15.81:0/1071484700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a105b82d50 con 0x55a105b8b0c0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b1573640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105c04f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f119c005fd0 tx=0x7f119c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b5a379972bdc66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11957fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11957fa640 1 -- 172.21.15.81:0/1071484700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c03b060 con 0x55a105b8b0c0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11957fa640 1 -- 172.21.15.81:0/1071484700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f119c0039a0 con 0x55a105b8b0c0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.771+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a8003af0 con 0x55a105b8b0c0 2024-09-12T12:19:34.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11957fa640 1 -- 172.21.15.81:0/1071484700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f119c00b540 con 0x55a105b8b0c0 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 10 client.15825 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a105c06640 con 0x55a105b8b0c0 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11957fa640 1 -- 172.21.15.81:0/1071484700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11a8003af0 con 0x55a105b8b0c0 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11957fa640 1 -- 172.21.15.81:0/1071484700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f119c03e030 con 0x55a105b8b0c0 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 10 client.15825 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 20 client.15825 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105c06d10 0x55a105c09130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 4 client.15825 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a105ae7d70 con 0x55a105c06d10 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.772+0000 7f11b1d74640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105c06d10 0x55a105c09130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.773+0000 7f11957fa640 10 client.15825 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:34.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.773+0000 7f11b1d74640 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105c06d10 0x55a105c09130 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab9f101f813d84d6 server_cookie=a99fad703deb2d8e in_seq=0 out_seq=0 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.870+0000 7f11957fa640 1 -- 172.21.15.81:0/1071484700 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a105ae7d70 con 0x55a105c06d10 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.870+0000 7f11957fa640 10 client.15825 handle_command_reply: tid=0 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.870+0000 7f11b6e4b740 1 client.15825 shutdown 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.870+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 msgr2=0x55a105c04f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.870+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105c04f60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f119c005fd0 tx=0x7f119c004730 comp rx=0 tx=0).stop 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 shutdown_connections 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x55a105c06d10 0x55a105c09130 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a105b8b0c0 0x55a105c04f60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a105b7c310 0x55a105b8fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 --2- 172.21.15.81:0/1071484700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a105b7b9f0 0x55a105b8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 >> 172.21.15.81:0/1071484700 conn(0x55a105b78060 msgr2=0x55a105b88780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11957fa640 0 client.15825 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 shutdown_connections 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 1 -- 172.21.15.81:0/1071484700 wait complete. 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b6e4b740 20 client.15825 trim_cache size 0 max 16384 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-09-12T12:19:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-09-12T12:19:34.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-09-12T12:19:34.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f11980a2da0 msgr2=0x7f11980a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f11980a2da0 0x7f11980a5260 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f11a40edb10 tx=0x7f11a40b1cc0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 msgr2=0x7f11ac19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac19cc50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005e30 tx=0x7f11a402fd70 comp rx=0 tx=0).stop 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 shutdown_connections 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f11980a2da0 0x7f11980a5260 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ac10c0d0 0x7f11ac19cc50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11ac103620 0x7f11ac1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 --2- 172.21.15.81:0/128462551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11ac102d00 0x7f11ac198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.871+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 >> 172.21.15.81:0/128462551 conn(0x7f11ac077990 msgr2=0x7f11ac0fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.872+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 shutdown_connections 2024-09-12T12:19:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-09-12T12:19:34.872+0000 7f11b3fd8640 1 -- 172.21.15.81:0/128462551 wait complete. 2024-09-12T12:19:34.885 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 -- 172.21.15.81:0/1640624795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102570 msgr2=0x7f1a2c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 --2- 172.21.15.81:0/1640624795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102570 0x7f1a2c1029b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009900 tx=0x7f1a1c02a480 comp rx=0 tx=0).stop 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 -- 172.21.15.81:0/1640624795 shutdown_connections 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 --2- 172.21.15.81:0/1640624795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 --2- 172.21.15.81:0/1640624795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102570 0x7f1a2c1029b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 --2- 172.21.15.81:0/1640624795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a2c100e20 0x7f1a2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 -- 172.21.15.81:0/1640624795 >> 172.21.15.81:0/1640624795 conn(0x7f1a2c0fc7d0 msgr2=0x7f1a2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 -- 172.21.15.81:0/1640624795 shutdown_connections 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 -- 172.21.15.81:0/1640624795 wait complete. 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 Processor -- start 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.386+0000 7f1a336e3640 1 -- start start 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2c100e20 0x7f1a2c197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a2c102570 0x7f1a2c1977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1110a0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c110f20 con 0x7f1a2c100e20 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c111220 con 0x7f1a2c102570 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60404/0 (socket says 172.21.15.81:60404) 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 -- 172.21.15.81:0/2777777417 learned_addr learned my addr 172.21.15.81:0/2777777417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:35.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a3147f640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2c100e20 0x7f1a2c197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a30c7e640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a2c102570 0x7f1a2c1977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 -- 172.21.15.81:0/2777777417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a2c102570 msgr2=0x7f1a2c1977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a2c102570 0x7f1a2c1977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 -- 172.21.15.81:0/2777777417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2c100e20 msgr2=0x7f1a2c197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2c100e20 0x7f1a2c197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 -- 172.21.15.81:0/2777777417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c1a6ad0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a31c80640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c197ce0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009fd0 tx=0x7f1a2400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24017070 con 0x7f1a2c102ef0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c1a6dc0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1a24004020 con 0x7f1a2c102ef0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a240106c0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.387+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c1a72d0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.388+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c101200 con 0x7f1a2c102ef0 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.389+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1a240041d0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.390+0000 7f1a227fc640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1a180a2cf0 0x7f1a180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.390+0000 7f1a3147f640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1a180a2cf0 0x7f1a180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.390+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f1a240cf090 con 0x7f1a2c102ef0 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.391+0000 7f1a3147f640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1a180a2cf0 0x7f1a180a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009b60 tx=0x7f1a28005f90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.393+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a2409bdc0 con 0x7f1a2c102ef0 2024-09-12T12:19:35.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.597+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a2c06a560 con 0x7f1a2c102ef0 2024-09-12T12:19:35.598 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:35 smithi081 ceph-mon[30948]: pgmap v97: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 784 KiB/s wr, 155 op/s 2024-09-12T12:19:35.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.598+0000 7f1a227fc640 1 -- 172.21.15.81:0/2777777417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+12017 (secure 0 0 0) 0x7f1a2c06a560 con 0x7f1a2c102ef0 2024-09-12T12:19:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:19:35.599 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"btime":"2024-09-12T12:19:01:478574+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:19:01.170409+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:19:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 37 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.600+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1a180a2cf0 msgr2=0x7f1a180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.600+0000 7f1a336e3640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1a180a2cf0 0x7f1a180a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009b60 tx=0x7f1a28005f90 comp rx=0 tx=0).stop 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.600+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 msgr2=0x7f1a2c197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.600+0000 7f1a336e3640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c197ce0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009fd0 tx=0x7f1a2400b260 comp rx=0 tx=0).stop 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 shutdown_connections 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1a180a2cf0 0x7f1a180a51b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a2c102ef0 0x7f1a2c197ce0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1a2c102570 0x7f1a2c1977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 --2- 172.21.15.81:0/2777777417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a2c100e20 0x7f1a2c197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:35.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 >> 172.21.15.81:0/2777777417 conn(0x7f1a2c0fc7d0 msgr2=0x7f1a2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 shutdown_connections 2024-09-12T12:19:35.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:35.601+0000 7f1a336e3640 1 -- 172.21.15.81:0/2777777417 wait complete. 2024-09-12T12:19:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:35 smithi173 ceph-mon[35326]: pgmap v97: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 784 KiB/s wr, 155 op/s 2024-09-12T12:19:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:35 smithi103 ceph-mon[35094]: pgmap v97: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 784 KiB/s wr, 155 op/s 2024-09-12T12:19:36.351 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24485 quiesce db --cancel --all' 2024-09-12T12:19:36.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24485 quiesce db --cancel --all 2024-09-12T12:19:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:19:36.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:36 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2777777417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:36.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:36 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2777777417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:36.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:36 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2777777417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.140+0000 7f3286e6f640 1 -- 172.21.15.81:0/3155650771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 msgr2=0x7f3280106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.140+0000 7f3286e6f640 1 --2- 172.21.15.81:0/3155650771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f3280106e60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3274009930 tx=0x7f327402a420 comp rx=0 tx=0).stop 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- 172.21.15.81:0/3155650771 shutdown_connections 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 --2- 172.21.15.81:0/3155650771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3280101420 0x7f328010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 --2- 172.21.15.81:0/3155650771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 0x7f3280100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 --2- 172.21.15.81:0/3155650771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f3280106e60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- 172.21.15.81:0/3155650771 >> 172.21.15.81:0/3155650771 conn(0x7f32800fc7a0 msgr2=0x7f32800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- 172.21.15.81:0/3155650771 shutdown_connections 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- 172.21.15.81:0/3155650771 wait complete. 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 Processor -- start 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- start start 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 0x7f32801985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3280101420 0x7f3280198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f328019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3280110fe0 con 0x7f3280106a80 2024-09-12T12:19:37.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3280110e60 con 0x7f3280101420 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.141+0000 7f3286e6f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3280111160 con 0x7f3280100a80 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f328019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f328019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60414/0 (socket says 172.21.15.81:60414) 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 -- 172.21.15.81:0/1661897194 learned_addr learned my addr 172.21.15.81:0/1661897194 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f3284c0b640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 0x7f32801985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f327ffff640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3280101420 0x7f3280198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 -- 172.21.15.81:0/1661897194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 msgr2=0x7f32801985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 0x7f32801985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 -- 172.21.15.81:0/1661897194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3280101420 msgr2=0x7f3280198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3280101420 0x7f3280198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 -- 172.21.15.81:0/1661897194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328019d580 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f3284c0b640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 0x7f32801985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f328540c640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f328019cea0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f327800eaa0 tx=0x7f327800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f327dffb640 1 -- 172.21.15.81:0/1661897194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327800cdb0 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328019d870 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f327dffb640 1 -- 172.21.15.81:0/1661897194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3278004b20 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f327dffb640 1 -- 172.21.15.81:0/1661897194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278011760 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.142+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801a5150 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.144+0000 7f327dffb640 1 -- 172.21.15.81:0/1661897194 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3278004cd0 con 0x7f3280106a80 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 Processor -- start 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 -- start start 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f327dffb640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f32700a2cf0 0x7f32700a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x55878085ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x5587808696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x55878086bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5587807c3200 con 0x55878085f320 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558780769dc0 con 0x55878085ea00 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3289248740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5587807bf1c0 con 0x558780869be0 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f327ffff640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f32700a2cf0 0x7f32700a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f327dffb640 1 -- 172.21.15.81:0/1661897194 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f32780cf760 con 0x7f3280106a80 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3284c0b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x55878085ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f327ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x5587808696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3284c0b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x55878085ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.81:54710/0 (socket says 172.21.15.81:54710) 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.145+0000 7f3284c0b640 1 -- 172.21.15.81:0/4205731270 learned_addr learned my addr 172.21.15.81:0/4205731270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f328540c640 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x55878086bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 -- 172.21.15.81:0/4205731270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 msgr2=0x55878086bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x55878086bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 -- 172.21.15.81:0/4205731270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 msgr2=0x55878085ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x55878085ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 -- 172.21.15.81:0/4205731270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558780534620 con 0x55878085f320 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f3284c0b640 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x55878085ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f328540c640 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x55878086bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f32700a2cf0 0x7f32700a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f326c00afd0 tx=0x7f326c00a8b0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f327ffff640 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x5587808696a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f326c006aa0 tx=0x7f326c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decb69317da431d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f326affd640 1 -- 172.21.15.81:0/4205731270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c025070 con 0x55878085f320 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f326affd640 1 -- 172.21.15.81:0/4205731270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f326c01c070 con 0x55878085f320 2024-09-12T12:19:37.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.146+0000 7f326affd640 1 -- 172.21.15.81:0/4205731270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c020660 con 0x55878085f320 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 -- 172.21.15.81:0/4205731270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 msgr2=0x5587808696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x5587808696a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f326c006aa0 tx=0x7f326c019000 comp rx=0 tx=0).stop 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 -- 172.21.15.81:0/4205731270 shutdown_connections 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x55878086bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x5587808696a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 --2- 172.21.15.81:0/4205731270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x55878085ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 -- 172.21.15.81:0/4205731270 >> 172.21.15.81:0/4205731270 conn(0x55878085af90 msgr2=0x55878085b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 -- 172.21.15.81:0/4205731270 shutdown_connections 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 -- 172.21.15.81:0/4205731270 wait complete. 2024-09-12T12:19:37.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 -- start start 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.147+0000 7f3289248740 1 Processor -- start 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085ea00 0x558780869590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x558780866840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558780869be0 0x558780866de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55878086c7b0 con 0x55878085f320 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55878075dc50 con 0x558780869be0 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55878086c930 con 0x55878085ea00 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 10 client.0 _ll_register_callbacks cb 0x55878076fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x558780866840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x558780866840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60436/0 (socket says 172.21.15.81:60436) 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 -- 172.21.15.81:0/1767090512 learned_addr learned my addr 172.21.15.81:0/1767090512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3284c0b640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085ea00 0x558780869590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 -- 172.21.15.81:0/1767090512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085ea00 msgr2=0x558780869590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f328540c640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558780869be0 0x558780866de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085ea00 0x558780869590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 -- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558780869be0 msgr2=0x558780866de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558780869be0 0x558780866de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 -- 172.21.15.81:0/1767090512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558780867610 con 0x55878085f320 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3284c0b640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085ea00 0x558780869590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:19:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f327ffff640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x558780866840 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f326c00a110 tx=0x7f326c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49208eaccc94948 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f325ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f325ffff640 1 -- 172.21.15.81:0/1767090512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c02d020 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f325ffff640 1 -- 172.21.15.81:0/1767090512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f326c020420 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f326c01c070 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f325ffff640 1 -- 172.21.15.81:0/1767090512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f326c038050 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 10 client.15843 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.148+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5587808783a0 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f325ffff640 1 -- 172.21.15.81:0/1767090512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f326c01c070 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f325ffff640 1 -- 172.21.15.81:0/1767090512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f326c028030 con 0x55878085f320 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3289248740 10 client.15843 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3289248740 10 client.15843 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:19:37.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3289248740 20 client.15843 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3289248740 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x55878087bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3289248740 4 client.15843 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587807d0770 con 0x5587808796f0 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.149+0000 7f3284c0b640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x55878087bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3284c0b640 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x55878087bae0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34068c08e38dce44 server_cookie=cefb20bd565bd414 in_seq=0 out_seq=0 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f325ffff640 10 client.15843 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f325ffff640 1 -- 172.21.15.81:0/1767090512 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587807d0770 con 0x5587808796f0 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f325ffff640 10 client.15843 handle_command_reply: tid=0 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 client.15843 shutdown 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 msgr2=0x558780866840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x558780866840 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f326c00a110 tx=0x7f326c0047d0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 shutdown_connections 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x55878087bae0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558780869be0 0x558780866de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085f320 0x558780866840 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f325ffff640 0 client.15843 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 --2- 172.21.15.81:0/1767090512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085ea00 0x558780869590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.150+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 >> 172.21.15.81:0/1767090512 conn(0x55878085af90 msgr2=0x55878085a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.151+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 shutdown_connections 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.151+0000 7f3289248740 1 -- 172.21.15.81:0/1767090512 wait complete. 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.151+0000 7f3289248740 20 client.15843 trim_cache size 0 max 16384 2024-09-12T12:19:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 Processor -- start 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 -- start start 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x5587808687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085f320 0x558780881250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 0x558780881790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ad8f0 con 0x558780869be0 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32801af730 con 0x55878085ea00 2024-09-12T12:19:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f3289248740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ae080 con 0x55878085f320 2024-09-12T12:19:37.320 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:19:37.320 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 37, 2024-09-12T12:19:37.320 INFO:teuthology.orchestra.run.smithi081.stdout: "leader": 24485, 2024-09-12T12:19:37.320 INFO:teuthology.orchestra.run.smithi081.stdout: "set_version": 12, 2024-09-12T12:19:37.320 INFO:teuthology.orchestra.run.smithi081.stdout: "sets": {} 2024-09-12T12:19:37.320 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f328540c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 0x558780881790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f328540c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 0x558780881790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60444/0 (socket says 172.21.15.81:60444) 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.167+0000 7f328540c640 1 -- 172.21.15.81:0/2911746638 learned_addr learned my addr 172.21.15.81:0/2911746638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f3284c0b640 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x5587808687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f328540c640 1 -- 172.21.15.81:0/2911746638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085f320 msgr2=0x558780881250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f328540c640 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085f320 0x558780881250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f328540c640 1 -- 172.21.15.81:0/2911746638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 msgr2=0x5587808687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f328540c640 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x5587808687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f328540c640 1 -- 172.21.15.81:0/2911746638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558780856950 con 0x558780869be0 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f328540c640 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 0x558780881790 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f327800efd0 tx=0x7f327809b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c68349889099c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f326a7fc640 1 -- 172.21.15.81:0/2911746638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327801f040 con 0x558780869be0 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f326a7fc640 1 -- 172.21.15.81:0/2911746638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f327809bc90 con 0x558780869be0 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f326a7fc640 1 -- 172.21.15.81:0/2911746638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278098490 con 0x558780869be0 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f3289248740 1 -- 172.21.15.81:0/2911746638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 msgr2=0x558780881790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f3289248740 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 0x558780881790 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f327800efd0 tx=0x7f327809b6b0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f3289248740 1 -- 172.21.15.81:0/2911746638 shutdown_connections 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.168+0000 7f3289248740 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558780869be0 0x558780881790 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55878085f320 0x558780881250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 --2- 172.21.15.81:0/2911746638 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085ea00 0x5587808687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- 172.21.15.81:0/2911746638 >> 172.21.15.81:0/2911746638 conn(0x55878085af90 msgr2=0x5587808680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- 172.21.15.81:0/2911746638 shutdown_connections 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- 172.21.15.81:0/2911746638 wait complete. 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- start start 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 Processor -- start 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 0x558780870000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085f320 0x558780870540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x5587808e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32801aefa0 con 0x55878085ea00 2024-09-12T12:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ae810 con 0x55878085f320 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32801ab8f0 con 0x558780869be0 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3289248740 10 client.0 _ll_register_callbacks cb 0x7f326c00ac40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3284c0b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 0x558780870000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3284c0b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 0x558780870000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60450/0 (socket says 172.21.15.81:60450) 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.169+0000 7f3284c0b640 1 -- 172.21.15.81:0/573501681 learned_addr learned my addr 172.21.15.81:0/573501681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f327ffff640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085f320 0x558780870540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f328540c640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x5587808e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3284c0b640 1 -- 172.21.15.81:0/573501681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 msgr2=0x5587808e7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3284c0b640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x5587808e7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3284c0b640 1 -- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085f320 msgr2=0x558780870540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3284c0b640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085f320 0x558780870540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3284c0b640 1 -- 172.21.15.81:0/573501681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587808e7b80 con 0x55878085ea00 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3284c0b640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 0x558780870000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3274005ec0 tx=0x7f3274004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fe23a5f3b7fbfc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f325ffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f325ffff640 1 -- 172.21.15.81:0/573501681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274049060 con 0x55878085ea00 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f325ffff640 1 -- 172.21.15.81:0/573501681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8411+0+0 (secure 0 0 0) 0x7f3274005240 con 0x55878085ea00 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f327809bc90 con 0x55878085ea00 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f325ffff640 1 -- 172.21.15.81:0/573501681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3274035040 con 0x55878085ea00 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3289248740 10 client.15849 fetch_fsmap learned FSMap version 37 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5587808e8ed0 con 0x55878085ea00 2024-09-12T12:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.170+0000 7f325ffff640 1 -- 172.21.15.81:0/573501681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f327809bc90 con 0x55878085ea00 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f325ffff640 1 -- 172.21.15.81:0/573501681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 37) ==== 8442+0+0 (secure 0 0 0) 0x7f327404c020 con 0x55878085ea00 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f3289248740 10 client.15849 fetch_fsmap finished waiting for FSMap version 37 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f3289248740 10 client.15849 resolve_mds: validated gid 24485 aka daemon mds.b 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f3289248740 20 client.15849 populate_metadata read hostname 'smithi081' 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f3289248740 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x5587808eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f3289248740 4 client.15849 mds_command: new command op to 24485 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 --> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5587807cac80 con 0x5587808796f0 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f327ffff640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x5587808eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f325ffff640 10 client.15849 ms_handle_connect on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.171+0000 7f327ffff640 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x5587808eb6d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82d0ea6cb8981fa server_cookie=a4504df5971ddf33 in_seq=0 out_seq=0 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f325ffff640 1 -- 172.21.15.81:0/573501681 <== mds.0 v2:172.21.15.103:6838/3967449570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5587807cac80 con 0x5587808796f0 2024-09-12T12:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f325ffff640 10 client.15849 handle_command_reply: tid=0 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 client.15849 shutdown 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 msgr2=0x558780870000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 0x558780870000 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3274005ec0 tx=0x7f3274004180 comp rx=0 tx=0).stop 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 shutdown_connections 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:6838/3967449570,v1:172.21.15.103:6839/3967449570] conn(0x5587808796f0 0x5587808eb6d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558780869be0 0x5587808e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55878085f320 0x558780870540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f325ffff640 0 client.15849 ms_handle_reset on v2:172.21.15.103:6838/3967449570 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 --2- 172.21.15.81:0/573501681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55878085ea00 0x558780870000 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 >> 172.21.15.81:0/573501681 conn(0x55878085af90 msgr2=0x55878085a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 shutdown_connections 2024-09-12T12:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 1 -- 172.21.15.81:0/573501681 wait complete. 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.172+0000 7f3289248740 20 client.15849 trim_cache size 0 max 16384 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f32700a2cf0 msgr2=0x7f32700a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f32700a2cf0 0x7f32700a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f326c00afd0 tx=0x7f326c00a8b0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 msgr2=0x7f328019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f328019cea0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f327800eaa0 tx=0x7f327800ef60 comp rx=0 tx=0).stop 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 shutdown_connections 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f32700a2cf0 0x7f32700a51b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280106a80 0x7f328019cea0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3280101420 0x7f3280198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 --2- 172.21.15.81:0/1661897194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3280100a80 0x7f32801985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:19:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 >> 172.21.15.81:0/1661897194 conn(0x7f32800fc7a0 msgr2=0x7f328006aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:19:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 shutdown_connections 2024-09-12T12:19:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:19:37.173+0000 7f3286e6f640 1 -- 172.21.15.81:0/1661897194 wait complete. 2024-09-12T12:19:37.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:37 smithi081 ceph-mon[30948]: pgmap v98: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 784 KiB/s wr, 155 op/s 2024-09-12T12:19:37.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:37 smithi173 ceph-mon[35326]: pgmap v98: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 784 KiB/s wr, 155 op/s 2024-09-12T12:19:37.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:37 smithi103 ceph-mon[35094]: pgmap v98: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 784 KiB/s wr, 155 op/s 2024-09-12T12:19:38.132 INFO:tasks.quiescer:done joining Quiescers 2024-09-12T12:19:38.132 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-12T12:19:38.147 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:19:38.155 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T12:19:38.168 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T12:19:38.168 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T12:19:38.168 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:19:38.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T12:19:38.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T12:19:39.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:39 smithi081 ceph-mon[30948]: pgmap v99: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 319 op/s 2024-09-12T12:19:39.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:39 smithi173 ceph-mon[35326]: pgmap v99: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 319 op/s 2024-09-12T12:19:39.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:39 smithi103 ceph-mon[35094]: pgmap v99: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 319 op/s 2024-09-12T12:19:41.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:41 smithi081 ceph-mon[30948]: pgmap v100: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 304 op/s 2024-09-12T12:19:41.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:41 smithi173 ceph-mon[35326]: pgmap v100: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 304 op/s 2024-09-12T12:19:41.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:41 smithi103 ceph-mon[35094]: pgmap v100: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 304 op/s 2024-09-12T12:19:43.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:43 smithi081 ceph-mon[30948]: pgmap v101: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 310 op/s 2024-09-12T12:19:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:43 smithi173 ceph-mon[35326]: pgmap v101: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 310 op/s 2024-09-12T12:19:43.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:43 smithi103 ceph-mon[35094]: pgmap v101: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 310 op/s 2024-09-12T12:19:45.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:45 smithi081 ceph-mon[30948]: pgmap v102: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 540 KiB/s wr, 170 op/s 2024-09-12T12:19:45.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:45 smithi173 ceph-mon[35326]: pgmap v102: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 540 KiB/s wr, 170 op/s 2024-09-12T12:19:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:45 smithi103 ceph-mon[35094]: pgmap v102: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 540 KiB/s wr, 170 op/s 2024-09-12T12:19:47.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:47 smithi081 ceph-mon[30948]: pgmap v103: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 540 KiB/s wr, 170 op/s 2024-09-12T12:19:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:47 smithi173 ceph-mon[35326]: pgmap v103: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 540 KiB/s wr, 170 op/s 2024-09-12T12:19:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:47 smithi103 ceph-mon[35094]: pgmap v103: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 540 KiB/s wr, 170 op/s 2024-09-12T12:19:49.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:49 smithi081 ceph-mon[30948]: pgmap v104: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 542 KiB/s wr, 174 op/s 2024-09-12T12:19:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:49 smithi173 ceph-mon[35326]: pgmap v104: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 542 KiB/s wr, 174 op/s 2024-09-12T12:19:49.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:49 smithi103 ceph-mon[35094]: pgmap v104: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 542 KiB/s wr, 174 op/s 2024-09-12T12:19:51.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:51 smithi081 ceph-mon[30948]: pgmap v105: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-12T12:19:51.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:51 smithi173 ceph-mon[35326]: pgmap v105: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-12T12:19:51.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:51 smithi103 ceph-mon[35094]: pgmap v105: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-09-12T12:19:53.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:53 smithi081 ceph-mon[30948]: pgmap v106: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-09-12T12:19:53.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:53 smithi173 ceph-mon[35326]: pgmap v106: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-09-12T12:19:53.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:53 smithi103 ceph-mon[35094]: pgmap v106: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 KiB/s wr, 14 op/s 2024-09-12T12:19:54.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:54 smithi081 ceph-mon[30948]: pgmap v107: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T12:19:54.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:54 smithi173 ceph-mon[35326]: pgmap v107: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T12:19:54.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:54 smithi103 ceph-mon[35094]: pgmap v107: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T12:19:57.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:56 smithi081 ceph-mon[30948]: pgmap v108: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T12:19:57.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:56 smithi173 ceph-mon[35326]: pgmap v108: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T12:19:57.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:56 smithi103 ceph-mon[35094]: pgmap v108: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-12T12:19:59.107 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:19:58 smithi081 ceph-mon[30948]: pgmap v109: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-12T12:19:59.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:19:58 smithi173 ceph-mon[35326]: pgmap v109: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-12T12:19:59.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:19:58 smithi103 ceph-mon[35094]: pgmap v109: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-09-12T12:20:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:00 smithi081 ceph-mon[30948]: pgmap v110: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-12T12:20:01.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:00 smithi081 ceph-mon[30948]: overall HEALTH_OK 2024-09-12T12:20:01.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:00 smithi173 ceph-mon[35326]: pgmap v110: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-12T12:20:01.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:00 smithi173 ceph-mon[35326]: overall HEALTH_OK 2024-09-12T12:20:01.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:00 smithi103 ceph-mon[35094]: pgmap v110: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2024-09-12T12:20:01.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:00 smithi103 ceph-mon[35094]: overall HEALTH_OK 2024-09-12T12:20:02.956 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:02 smithi173 ceph-mon[35326]: pgmap v111: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T12:20:03.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:02 smithi081 ceph-mon[30948]: pgmap v111: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T12:20:03.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:02 smithi103 ceph-mon[35094]: pgmap v111: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-12T12:20:05.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:04 smithi081 ceph-mon[30948]: pgmap v112: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:05.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:04 smithi173 ceph-mon[35326]: pgmap v112: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:05.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:04 smithi103 ceph-mon[35094]: pgmap v112: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:06 smithi081 ceph-mon[30948]: pgmap v113: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:07.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:06 smithi173 ceph-mon[35326]: pgmap v113: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:07.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:06 smithi103 ceph-mon[35094]: pgmap v113: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:08 smithi081 ceph-mon[30948]: pgmap v114: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T12:20:09.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:08 smithi173 ceph-mon[35326]: pgmap v114: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T12:20:09.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:08 smithi103 ceph-mon[35094]: pgmap v114: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-12T12:20:11.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:10 smithi081 ceph-mon[30948]: pgmap v115: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:11.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:10 smithi173 ceph-mon[35326]: pgmap v115: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:11.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:10 smithi103 ceph-mon[35094]: pgmap v115: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:20:13.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:12 smithi081 ceph-mon[30948]: pgmap v116: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:20:13.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:12 smithi173 ceph-mon[35326]: pgmap v116: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:20:13.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:12 smithi103 ceph-mon[35094]: pgmap v116: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:20:15.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:14 smithi081 ceph-mon[30948]: pgmap v117: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:20:15.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:14 smithi173 ceph-mon[35326]: pgmap v117: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:20:15.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:14 smithi103 ceph-mon[35094]: pgmap v117: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:20:17.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:16 smithi081 ceph-mon[30948]: pgmap v118: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:20:17.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:16 smithi173 ceph-mon[35326]: pgmap v118: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:20:17.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:16 smithi103 ceph-mon[35094]: pgmap v118: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-12T12:20:19.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:18 smithi081 ceph-mon[30948]: pgmap v119: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:20:19.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:18 smithi173 ceph-mon[35326]: pgmap v119: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:20:19.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:18 smithi103 ceph-mon[35094]: pgmap v119: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:20:21.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:20 smithi081 ceph-mon[30948]: pgmap v120: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:20:21.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:20 smithi173 ceph-mon[35326]: pgmap v120: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:20:21.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:20 smithi103 ceph-mon[35094]: pgmap v120: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:20:23.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:22 smithi081 ceph-mon[30948]: pgmap v121: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:20:23.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:22 smithi173 ceph-mon[35326]: pgmap v121: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:20:23.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:22 smithi103 ceph-mon[35094]: pgmap v121: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:20:25.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:24 smithi081 ceph-mon[30948]: pgmap v122: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:25.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:24 smithi173 ceph-mon[35326]: pgmap v122: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:25.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:24 smithi103 ceph-mon[35094]: pgmap v122: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:27.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:26 smithi081 ceph-mon[30948]: pgmap v123: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:27.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:26 smithi173 ceph-mon[35326]: pgmap v123: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:27.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:26 smithi103 ceph-mon[35094]: pgmap v123: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:29.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:28 smithi081 ceph-mon[30948]: pgmap v124: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:29.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:28 smithi173 ceph-mon[35326]: pgmap v124: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:28 smithi103 ceph-mon[35094]: pgmap v124: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:31.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:30 smithi081 ceph-mon[30948]: pgmap v125: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:31.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:30 smithi173 ceph-mon[35326]: pgmap v125: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:31.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:30 smithi103 ceph-mon[35094]: pgmap v125: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:33.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:32 smithi081 ceph-mon[30948]: pgmap v126: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:33.112 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:33.113 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:33.113 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:33.113 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:20:33.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:32 smithi173 ceph-mon[35326]: pgmap v126: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:33.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:33.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:33.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:33.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:20:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:32 smithi103 ceph-mon[35094]: pgmap v126: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:20:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:20:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:20:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:20:35.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:34 smithi081 ceph-mon[30948]: pgmap v127: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:34 smithi173 ceph-mon[35326]: pgmap v127: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:35.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:34 smithi103 ceph-mon[35094]: pgmap v127: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:37.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:36 smithi081 ceph-mon[30948]: pgmap v128: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:37.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:36 smithi173 ceph-mon[35326]: pgmap v128: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:37.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:36 smithi103 ceph-mon[35094]: pgmap v128: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:39.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:38 smithi081 ceph-mon[30948]: pgmap v129: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:39.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:38 smithi173 ceph-mon[35326]: pgmap v129: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:39.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:38 smithi103 ceph-mon[35094]: pgmap v129: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:41.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:40 smithi081 ceph-mon[30948]: pgmap v130: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:41.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:40 smithi173 ceph-mon[35326]: pgmap v130: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:41.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:40 smithi103 ceph-mon[35094]: pgmap v130: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:43.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:42 smithi081 ceph-mon[30948]: pgmap v131: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:43.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:42 smithi173 ceph-mon[35326]: pgmap v131: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:43.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:42 smithi103 ceph-mon[35094]: pgmap v131: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:45.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:44 smithi081 ceph-mon[30948]: pgmap v132: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:45.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:44 smithi173 ceph-mon[35326]: pgmap v132: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:45.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:44 smithi103 ceph-mon[35094]: pgmap v132: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:47.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:46 smithi081 ceph-mon[30948]: pgmap v133: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:47.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:46 smithi173 ceph-mon[35326]: pgmap v133: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:47.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:46 smithi103 ceph-mon[35094]: pgmap v133: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:49.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:48 smithi081 ceph-mon[30948]: pgmap v134: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:49.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:48 smithi173 ceph-mon[35326]: pgmap v134: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:49.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:48 smithi103 ceph-mon[35094]: pgmap v134: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:51.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:50 smithi081 ceph-mon[30948]: pgmap v135: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:51.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:50 smithi173 ceph-mon[35326]: pgmap v135: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:51.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:50 smithi103 ceph-mon[35094]: pgmap v135: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:53.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:52 smithi081 ceph-mon[30948]: pgmap v136: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:53.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:52 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:20:53.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:52 smithi173 ceph-mon[35326]: pgmap v136: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:53.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:52 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:20:53.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:52 smithi103 ceph-mon[35094]: pgmap v136: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:53.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:52 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:20:55.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:54 smithi081 ceph-mon[30948]: pgmap v137: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:55.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:54 smithi173 ceph-mon[35326]: pgmap v137: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:55.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:54 smithi103 ceph-mon[35094]: pgmap v137: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:57.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:56 smithi081 ceph-mon[30948]: pgmap v138: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:57.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:56 smithi173 ceph-mon[35326]: pgmap v138: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:57.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:56 smithi103 ceph-mon[35094]: pgmap v138: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:20:59.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:20:58 smithi081 ceph-mon[30948]: pgmap v139: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:59.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:20:58 smithi173 ceph-mon[35326]: pgmap v139: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:20:59.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:20:58 smithi103 ceph-mon[35094]: pgmap v139: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:01.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:00 smithi081 ceph-mon[30948]: pgmap v140: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:01.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:00 smithi173 ceph-mon[35326]: pgmap v140: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:01.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:00 smithi103 ceph-mon[35094]: pgmap v140: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:03.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:02 smithi081 ceph-mon[30948]: pgmap v141: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:03.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:02 smithi173 ceph-mon[35326]: pgmap v141: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:03.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:02 smithi103 ceph-mon[35094]: pgmap v141: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:05.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:04 smithi081 ceph-mon[30948]: pgmap v142: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:05.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:04 smithi173 ceph-mon[35326]: pgmap v142: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:05.189 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:04 smithi103 ceph-mon[35094]: pgmap v142: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:06 smithi081 ceph-mon[30948]: pgmap v143: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:07.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:06 smithi173 ceph-mon[35326]: pgmap v143: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:07.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:06 smithi103 ceph-mon[35094]: pgmap v143: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:09.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:08 smithi081 ceph-mon[30948]: pgmap v144: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:09.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:08 smithi173 ceph-mon[35326]: pgmap v144: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:09.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:08 smithi103 ceph-mon[35094]: pgmap v144: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:11.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:10 smithi081 ceph-mon[30948]: pgmap v145: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:11.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:10 smithi173 ceph-mon[35326]: pgmap v145: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:11.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:10 smithi103 ceph-mon[35094]: pgmap v145: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:21:13.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:12 smithi081 ceph-mon[30948]: pgmap v146: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:13.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:12 smithi173 ceph-mon[35326]: pgmap v146: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:13.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:12 smithi103 ceph-mon[35094]: pgmap v146: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:21:15.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:14 smithi081 ceph-mon[30948]: pgmap v147: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:21:15.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:14 smithi173 ceph-mon[35326]: pgmap v147: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:21:15.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:14 smithi103 ceph-mon[35094]: pgmap v147: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:21:17.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:16 smithi081 ceph-mon[30948]: pgmap v148: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:21:17.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:16 smithi173 ceph-mon[35326]: pgmap v148: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:21:17.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:16 smithi103 ceph-mon[35094]: pgmap v148: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:21:19.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:18 smithi081 ceph-mon[30948]: pgmap v149: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:21:19.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:18 smithi173 ceph-mon[35326]: pgmap v149: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:21:19.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:18 smithi103 ceph-mon[35094]: pgmap v149: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:21:21.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:20 smithi081 ceph-mon[30948]: pgmap v150: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T12:21:21.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:20 smithi173 ceph-mon[35326]: pgmap v150: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T12:21:21.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:20 smithi103 ceph-mon[35094]: pgmap v150: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T12:21:23.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:22 smithi081 ceph-mon[30948]: pgmap v151: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T12:21:23.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:22 smithi173 ceph-mon[35326]: pgmap v151: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T12:21:23.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:22 smithi103 ceph-mon[35094]: pgmap v151: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T12:21:25.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:24 smithi081 ceph-mon[30948]: pgmap v152: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:25.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:24 smithi173 ceph-mon[35326]: pgmap v152: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:25.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:24 smithi103 ceph-mon[35094]: pgmap v152: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:27.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:26 smithi081 ceph-mon[30948]: pgmap v153: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:27.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:26 smithi173 ceph-mon[35326]: pgmap v153: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:27.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:26 smithi103 ceph-mon[35094]: pgmap v153: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:29.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:28 smithi081 ceph-mon[30948]: pgmap v154: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:29.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:28 smithi173 ceph-mon[35326]: pgmap v154: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:28 smithi103 ceph-mon[35094]: pgmap v154: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:30.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:29 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:30.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:29 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:30.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:29 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:31.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:30 smithi081 ceph-mon[30948]: pgmap v155: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:31.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:30 smithi173 ceph-mon[35326]: pgmap v155: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:31.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:30 smithi103 ceph-mon[35094]: pgmap v155: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:33.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:32 smithi081 ceph-mon[30948]: pgmap v156: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:33.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:32 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:33.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:32 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:33.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:32 smithi173 ceph-mon[35326]: pgmap v156: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:33.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:32 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:33.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:32 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:32 smithi103 ceph-mon[35094]: pgmap v156: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:33.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:32 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:33.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:32 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:21:34.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:33 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:34.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:33 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:34.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:33 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:21:34.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:33 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:34.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:33 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:34.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:33 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:21:34.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:33 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:21:34.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:33 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:21:34.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:33 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:21:35.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:35 smithi081 ceph-mon[30948]: pgmap v157: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:35.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:35 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:35.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:35 smithi173 ceph-mon[35326]: pgmap v157: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:35.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:35 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:35.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:35 smithi103 ceph-mon[35094]: pgmap v157: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:35.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:35 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:37.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:37 smithi081 ceph-mon[30948]: pgmap v158: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:37.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:37 smithi173 ceph-mon[35326]: pgmap v158: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:37.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:37 smithi103 ceph-mon[35094]: pgmap v158: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:38.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:38 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:38.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:38 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:38.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:38 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:39.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:39 smithi081 ceph-mon[30948]: pgmap v159: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:39.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:39 smithi173 ceph-mon[35326]: pgmap v159: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:39.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:39 smithi103 ceph-mon[35094]: pgmap v159: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:41.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:41 smithi081 ceph-mon[30948]: pgmap v160: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:41.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:41 smithi173 ceph-mon[35326]: pgmap v160: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:41.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:41 smithi103 ceph-mon[35094]: pgmap v160: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:43.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:43 smithi081 ceph-mon[30948]: pgmap v161: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:43.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:43 smithi173 ceph-mon[35326]: pgmap v161: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:43.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:43 smithi103 ceph-mon[35094]: pgmap v161: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:45.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:45 smithi081 ceph-mon[30948]: pgmap v162: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:45.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:45 smithi173 ceph-mon[35326]: pgmap v162: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:45.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:45 smithi103 ceph-mon[35094]: pgmap v162: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:47.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:47 smithi081 ceph-mon[30948]: pgmap v163: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:47.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:47 smithi173 ceph-mon[35326]: pgmap v163: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:47.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:47 smithi103 ceph-mon[35094]: pgmap v163: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:48.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:48 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:48.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:48 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:48.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:48 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:21:49.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:49 smithi173 ceph-mon[35326]: pgmap v164: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:49.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:49 smithi103 ceph-mon[35094]: pgmap v164: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:49.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:49 smithi081 ceph-mon[30948]: pgmap v164: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:51.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:51 smithi173 ceph-mon[35326]: pgmap v165: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:51.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:51 smithi103 ceph-mon[35094]: pgmap v165: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:51.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:51 smithi081 ceph-mon[30948]: pgmap v165: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:21:53.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:53 smithi173 ceph-mon[35326]: pgmap v166: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:53.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:53 smithi103 ceph-mon[35094]: pgmap v166: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:53.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:53 smithi081 ceph-mon[30948]: pgmap v166: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:21:55.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:55 smithi173 ceph-mon[35326]: pgmap v167: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:21:55.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:55 smithi103 ceph-mon[35094]: pgmap v167: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:21:55.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:55 smithi081 ceph-mon[30948]: pgmap v167: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:21:57.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:57 smithi173 ceph-mon[35326]: pgmap v168: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:21:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:57 smithi103 ceph-mon[35094]: pgmap v168: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:21:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:57 smithi081 ceph-mon[30948]: pgmap v168: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:21:59.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:21:59 smithi173 ceph-mon[35326]: pgmap v169: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T12:21:59.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:21:59 smithi103 ceph-mon[35094]: pgmap v169: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T12:21:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:21:59 smithi081 ceph-mon[30948]: pgmap v169: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-09-12T12:22:01.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:01 smithi173 ceph-mon[35326]: pgmap v170: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-12T12:22:01.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:01 smithi103 ceph-mon[35094]: pgmap v170: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-12T12:22:01.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:01 smithi081 ceph-mon[30948]: pgmap v170: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-09-12T12:22:02.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:02 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:02.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:02 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:02.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:02 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:03.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:03 smithi173 ceph-mon[35326]: pgmap v171: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-12T12:22:03.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:03 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:03.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:03 smithi103 ceph-mon[35094]: pgmap v171: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-12T12:22:03.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:03 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:03.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:03 smithi081 ceph-mon[30948]: pgmap v171: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 26 op/s 2024-09-12T12:22:03.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:03 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:05.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:05 smithi103 ceph-mon[35094]: pgmap v172: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T12:22:05.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:05 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:05.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:05 smithi081 ceph-mon[30948]: pgmap v172: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T12:22:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:05 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:05 smithi173 ceph-mon[35326]: pgmap v172: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T12:22:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:05 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:07 smithi103 ceph-mon[35094]: pgmap v173: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T12:22:07.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:07 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:07 smithi081 ceph-mon[30948]: pgmap v173: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T12:22:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:07 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:07 smithi173 ceph-mon[35326]: pgmap v173: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-12T12:22:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:07 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:08.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:08 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:08.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:08 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:08.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:08 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:09.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:09 smithi103 ceph-mon[35094]: pgmap v174: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:22:09.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:09 smithi081 ceph-mon[30948]: pgmap v174: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:22:09.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:09 smithi173 ceph-mon[35326]: pgmap v174: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:22:11.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:11 smithi103 ceph-mon[35094]: pgmap v175: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:22:11.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:11 smithi081 ceph-mon[30948]: pgmap v175: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:22:11.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:11 smithi173 ceph-mon[35326]: pgmap v175: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-12T12:22:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:13 smithi081 ceph-mon[30948]: pgmap v176: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:22:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:13 smithi081 ceph-mon[30948]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:13 smithi173 ceph-mon[35326]: pgmap v176: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:22:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:13 smithi173 ceph-mon[35326]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:13 smithi103 ceph-mon[35094]: pgmap v176: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-12T12:22:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:13 smithi103 ceph-mon[35094]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-12T12:22:15.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:15 smithi081 ceph-mon[30948]: pgmap v177: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:22:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:15 smithi173 ceph-mon[35326]: pgmap v177: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:22:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:15 smithi103 ceph-mon[35094]: pgmap v177: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:22:17.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:17 smithi081 ceph-mon[30948]: pgmap v178: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:22:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:17 smithi173 ceph-mon[35326]: pgmap v178: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:22:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:17 smithi103 ceph-mon[35094]: pgmap v178: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-12T12:22:19.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:19 smithi081 ceph-mon[30948]: pgmap v179: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:22:19.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:19 smithi173 ceph-mon[35326]: pgmap v179: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:22:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:19 smithi103 ceph-mon[35094]: pgmap v179: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-12T12:22:21.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:21 smithi081 ceph-mon[30948]: pgmap v180: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T12:22:21.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:21 smithi173 ceph-mon[35326]: pgmap v180: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T12:22:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:21 smithi103 ceph-mon[35094]: pgmap v180: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-12T12:22:23.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:23 smithi081 ceph-mon[30948]: pgmap v181: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T12:22:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:23 smithi173 ceph-mon[35326]: pgmap v181: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T12:22:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:23 smithi103 ceph-mon[35094]: pgmap v181: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-12T12:22:25.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:25 smithi081 ceph-mon[30948]: pgmap v182: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:25 smithi173 ceph-mon[35326]: pgmap v182: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:25 smithi103 ceph-mon[35094]: pgmap v182: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:27 smithi081 ceph-mon[30948]: pgmap v183: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:27 smithi173 ceph-mon[35326]: pgmap v183: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:27 smithi103 ceph-mon[35094]: pgmap v183: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:29.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:29 smithi081 ceph-mon[30948]: pgmap v184: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:29 smithi173 ceph-mon[35326]: pgmap v184: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:29 smithi103 ceph-mon[35094]: pgmap v184: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:31 smithi081 ceph-mon[30948]: pgmap v185: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:31 smithi173 ceph-mon[35326]: pgmap v185: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:31 smithi103 ceph-mon[35094]: pgmap v185: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:33.487 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:33 smithi103 ceph-mon[35094]: pgmap v186: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:33.488 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:33 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:33 smithi081 ceph-mon[30948]: pgmap v186: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:33 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:33 smithi173 ceph-mon[35326]: pgmap v186: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:33 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:22:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:22:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:34.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:22:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:22:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:22:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:22:35.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:35 smithi081 ceph-mon[30948]: pgmap v187: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:35 smithi173 ceph-mon[35326]: pgmap v187: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:35.690 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:35 smithi103 ceph-mon[35094]: pgmap v187: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:37.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:37 smithi081 ceph-mon[30948]: pgmap v188: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:37 smithi173 ceph-mon[35326]: pgmap v188: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:37 smithi103 ceph-mon[35094]: pgmap v188: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:39.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:39 smithi081 ceph-mon[30948]: pgmap v189: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:39 smithi173 ceph-mon[35326]: pgmap v189: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:39 smithi103 ceph-mon[35094]: pgmap v189: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:41.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:41 smithi081 ceph-mon[30948]: pgmap v190: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:41 smithi173 ceph-mon[35326]: pgmap v190: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:41 smithi103 ceph-mon[35094]: pgmap v190: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:43.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:43 smithi081 ceph-mon[30948]: pgmap v191: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:43 smithi173 ceph-mon[35326]: pgmap v191: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:43 smithi103 ceph-mon[35094]: pgmap v191: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:45.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:45 smithi081 ceph-mon[30948]: pgmap v192: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:45 smithi173 ceph-mon[35326]: pgmap v192: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:45.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:45 smithi103 ceph-mon[35094]: pgmap v192: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:47.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:47 smithi081 ceph-mon[30948]: pgmap v193: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:47 smithi173 ceph-mon[35326]: pgmap v193: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:47 smithi103 ceph-mon[35094]: pgmap v193: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:49.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:49 smithi081 ceph-mon[30948]: pgmap v194: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:49 smithi173 ceph-mon[35326]: pgmap v194: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:49 smithi103 ceph-mon[35094]: pgmap v194: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:51.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:51 smithi081 ceph-mon[30948]: pgmap v195: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:51 smithi173 ceph-mon[35326]: pgmap v195: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:51 smithi103 ceph-mon[35094]: pgmap v195: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:53.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:53 smithi081 ceph-mon[30948]: pgmap v196: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:53 smithi173 ceph-mon[35326]: pgmap v196: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:53 smithi103 ceph-mon[35094]: pgmap v196: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:55.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:55 smithi081 ceph-mon[30948]: pgmap v197: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:55 smithi173 ceph-mon[35326]: pgmap v197: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:55 smithi103 ceph-mon[35094]: pgmap v197: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:57.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:57 smithi081 ceph-mon[30948]: pgmap v198: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:57 smithi173 ceph-mon[35326]: pgmap v198: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:57 smithi103 ceph-mon[35094]: pgmap v198: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:22:59.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:22:59 smithi081 ceph-mon[30948]: pgmap v199: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:22:59 smithi173 ceph-mon[35326]: pgmap v199: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:22:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:22:59 smithi103 ceph-mon[35094]: pgmap v199: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:01.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:01 smithi081 ceph-mon[30948]: pgmap v200: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:01 smithi173 ceph-mon[35326]: pgmap v200: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:01 smithi103 ceph-mon[35094]: pgmap v200: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:03.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:03 smithi081 ceph-mon[30948]: pgmap v201: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:23:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:03 smithi173 ceph-mon[35326]: pgmap v201: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:23:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:03 smithi103 ceph-mon[35094]: pgmap v201: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:23:05.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:05 smithi081 ceph-mon[30948]: pgmap v202: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:23:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:05 smithi173 ceph-mon[35326]: pgmap v202: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:23:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:05 smithi103 ceph-mon[35094]: pgmap v202: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:23:07.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:07 smithi081 ceph-mon[30948]: pgmap v203: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:23:07.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:07 smithi081 ceph-mon[30948]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:23:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:07 smithi173 ceph-mon[35326]: pgmap v203: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:23:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:07 smithi173 ceph-mon[35326]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:23:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:07 smithi103 ceph-mon[35094]: pgmap v203: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:23:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:07 smithi103 ceph-mon[35094]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T12:23:09.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:09 smithi081 ceph-mon[30948]: pgmap v205: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:23:09.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:09 smithi173 ceph-mon[35326]: pgmap v205: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:23:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:09 smithi103 ceph-mon[35094]: pgmap v205: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:23:11.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:11 smithi081 ceph-mon[30948]: pgmap v206: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:23:11.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:11 smithi173 ceph-mon[35326]: pgmap v206: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:23:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:11 smithi103 ceph-mon[35094]: pgmap v206: 97 pgs: 22 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 34 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:23:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:13 smithi081 ceph-mon[30948]: pgmap v207: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:23:13.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:13 smithi081 ceph-mon[30948]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:23:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:13 smithi173 ceph-mon[35326]: pgmap v207: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:23:13.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:13 smithi173 ceph-mon[35326]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:23:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:13 smithi103 ceph-mon[35094]: pgmap v207: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:23:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:13 smithi103 ceph-mon[35094]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T12:23:15.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:15 smithi081 ceph-mon[30948]: pgmap v209: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:23:15.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:15 smithi173 ceph-mon[35326]: pgmap v209: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:23:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:15 smithi103 ceph-mon[35094]: pgmap v209: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:23:17.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:17 smithi081 ceph-mon[30948]: pgmap v210: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2024-09-12T12:23:17.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:17 smithi173 ceph-mon[35326]: pgmap v210: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2024-09-12T12:23:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:17 smithi103 ceph-mon[35094]: pgmap v210: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 218 B/s wr, 11 op/s 2024-09-12T12:23:19.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:19 smithi081 ceph-mon[30948]: pgmap v211: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:23:19.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:19 smithi173 ceph-mon[35326]: pgmap v211: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:23:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:19 smithi103 ceph-mon[35094]: pgmap v211: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:23:21.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:21 smithi081 ceph-mon[30948]: pgmap v212: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:23:21.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:21 smithi173 ceph-mon[35326]: pgmap v212: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:23:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:21 smithi103 ceph-mon[35094]: pgmap v212: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:23:23.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:23 smithi081 ceph-mon[30948]: pgmap v213: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:23:23.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:23 smithi173 ceph-mon[35326]: pgmap v213: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:23:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:23 smithi103 ceph-mon[35094]: pgmap v213: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:23:25.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:25 smithi081 ceph-mon[30948]: pgmap v214: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:23:25.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:25 smithi173 ceph-mon[35326]: pgmap v214: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:23:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:25 smithi103 ceph-mon[35094]: pgmap v214: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:23:27.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:27 smithi081 ceph-mon[30948]: pgmap v215: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:27.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:27 smithi173 ceph-mon[35326]: pgmap v215: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:27 smithi103 ceph-mon[35094]: pgmap v215: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:29.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:29 smithi081 ceph-mon[30948]: pgmap v216: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:29.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:29 smithi173 ceph-mon[35326]: pgmap v216: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:29.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:29 smithi103 ceph-mon[35094]: pgmap v216: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:31.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:31 smithi081 ceph-mon[30948]: pgmap v217: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:31.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:31 smithi173 ceph-mon[35326]: pgmap v217: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:31.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:31 smithi103 ceph-mon[35094]: pgmap v217: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:33.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:33 smithi081 ceph-mon[30948]: pgmap v218: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:33.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:33 smithi173 ceph-mon[35326]: pgmap v218: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:33.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:33 smithi103 ceph-mon[35094]: pgmap v218: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:34.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:23:34.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:34.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:34.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:34.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:23:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:23:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:23:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:23:34.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:23:35.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:35 smithi081 ceph-mon[30948]: pgmap v219: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:35.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:35 smithi173 ceph-mon[35326]: pgmap v219: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:35.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:35 smithi103 ceph-mon[35094]: pgmap v219: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:37.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:37 smithi081 ceph-mon[30948]: pgmap v220: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:37.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:37 smithi173 ceph-mon[35326]: pgmap v220: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:37.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:37 smithi103 ceph-mon[35094]: pgmap v220: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:39.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:39 smithi081 ceph-mon[30948]: pgmap v221: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:39.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:39 smithi173 ceph-mon[35326]: pgmap v221: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:39.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:39 smithi103 ceph-mon[35094]: pgmap v221: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:41.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:41 smithi081 ceph-mon[30948]: pgmap v222: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:41.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:41 smithi173 ceph-mon[35326]: pgmap v222: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:41.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:41 smithi103 ceph-mon[35094]: pgmap v222: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:43.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:43 smithi081 ceph-mon[30948]: pgmap v223: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:43.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:43 smithi173 ceph-mon[35326]: pgmap v223: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:43.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:43 smithi103 ceph-mon[35094]: pgmap v223: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:45.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:45 smithi081 ceph-mon[30948]: pgmap v224: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:45.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:45 smithi173 ceph-mon[35326]: pgmap v224: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:45.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:45 smithi103 ceph-mon[35094]: pgmap v224: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:47.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:47 smithi173 ceph-mon[35326]: pgmap v225: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:47.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:47 smithi103 ceph-mon[35094]: pgmap v225: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:47.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:47 smithi081 ceph-mon[30948]: pgmap v225: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:49.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:49 smithi173 ceph-mon[35326]: pgmap v226: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:49.662 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:49 smithi081 ceph-mon[30948]: pgmap v226: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:49.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:49 smithi103 ceph-mon[35094]: pgmap v226: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:51.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:51 smithi173 ceph-mon[35326]: pgmap v227: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:51.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:51 smithi103 ceph-mon[35094]: pgmap v227: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:51.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:51 smithi081 ceph-mon[30948]: pgmap v227: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:53.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:53 smithi173 ceph-mon[35326]: pgmap v228: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:53.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:53 smithi103 ceph-mon[35094]: pgmap v228: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:53.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:53 smithi081 ceph-mon[30948]: pgmap v228: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:55.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:55 smithi173 ceph-mon[35326]: pgmap v229: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:55.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:55 smithi103 ceph-mon[35094]: pgmap v229: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:55 smithi081 ceph-mon[30948]: pgmap v229: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:57.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:57 smithi173 ceph-mon[35326]: pgmap v230: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:57.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:57 smithi103 ceph-mon[35094]: pgmap v230: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:57.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:57 smithi081 ceph-mon[30948]: pgmap v230: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:23:59.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:23:59 smithi173 ceph-mon[35326]: pgmap v231: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:59.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:23:59 smithi103 ceph-mon[35094]: pgmap v231: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:23:59.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:23:59 smithi081 ceph-mon[30948]: pgmap v231: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:01 smithi173 ceph-mon[35326]: pgmap v232: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:01 smithi103 ceph-mon[35094]: pgmap v232: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:01.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:01 smithi081 ceph-mon[30948]: pgmap v232: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:03 smithi173 ceph-mon[35326]: pgmap v233: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:24:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:03 smithi103 ceph-mon[35094]: pgmap v233: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:24:03.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:03 smithi081 ceph-mon[30948]: pgmap v233: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:24:05.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:05 smithi173 ceph-mon[35326]: pgmap v234: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:24:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:05 smithi103 ceph-mon[35094]: pgmap v234: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:24:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:05 smithi081 ceph-mon[30948]: pgmap v234: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:24:07.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:07 smithi173 ceph-mon[35326]: pgmap v235: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:24:07.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:07 smithi173 ceph-mon[35326]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:24:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:07 smithi103 ceph-mon[35094]: pgmap v235: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:24:07.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:07 smithi103 ceph-mon[35094]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:24:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:07 smithi081 ceph-mon[30948]: pgmap v235: 97 pgs: 97 active+clean; 220 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:24:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:07 smithi081 ceph-mon[30948]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T12:24:09.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:09 smithi173 ceph-mon[35326]: pgmap v237: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 199 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:24:09.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:09 smithi103 ceph-mon[35094]: pgmap v237: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 199 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:24:09.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:09 smithi081 ceph-mon[30948]: pgmap v237: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 199 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:24:11.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:11 smithi103 ceph-mon[35094]: pgmap v238: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 199 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:24:11.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:11 smithi081 ceph-mon[30948]: pgmap v238: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 199 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:24:11.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:11 smithi173 ceph-mon[35326]: pgmap v238: 97 pgs: 23 active+clean+snaptrim, 41 active+clean+snaptrim_wait, 33 active+clean; 199 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:24:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:13 smithi103 ceph-mon[35094]: pgmap v239: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:24:13.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:13 smithi103 ceph-mon[35094]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:24:13.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:13 smithi081 ceph-mon[30948]: pgmap v239: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:24:13.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:13 smithi081 ceph-mon[30948]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:24:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:13 smithi173 ceph-mon[35326]: pgmap v239: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:24:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:13 smithi173 ceph-mon[35326]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T12:24:15.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:15 smithi103 ceph-mon[35094]: pgmap v241: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:24:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:15 smithi081 ceph-mon[30948]: pgmap v241: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:24:15.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:15 smithi173 ceph-mon[35326]: pgmap v241: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:24:17.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:17 smithi103 ceph-mon[35094]: pgmap v242: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2024-09-12T12:24:17.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:17 smithi081 ceph-mon[30948]: pgmap v242: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2024-09-12T12:24:17.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:17 smithi173 ceph-mon[35326]: pgmap v242: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 220 B/s wr, 11 op/s 2024-09-12T12:24:19.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:19 smithi103 ceph-mon[35094]: pgmap v243: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:24:19.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:19 smithi081 ceph-mon[30948]: pgmap v243: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:24:19.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:19 smithi173 ceph-mon[35326]: pgmap v243: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:24:21.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:21 smithi103 ceph-mon[35094]: pgmap v244: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:24:21.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:21 smithi081 ceph-mon[30948]: pgmap v244: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:24:21.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:21 smithi173 ceph-mon[35326]: pgmap v244: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:24:23.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:23 smithi103 ceph-mon[35094]: pgmap v245: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:24:23.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:23 smithi081 ceph-mon[30948]: pgmap v245: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:24:23.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:23 smithi173 ceph-mon[35326]: pgmap v245: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:24:25.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:25 smithi103 ceph-mon[35094]: pgmap v246: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:24:25.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:25 smithi081 ceph-mon[30948]: pgmap v246: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:24:25.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:25 smithi173 ceph-mon[35326]: pgmap v246: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:24:27.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:27 smithi103 ceph-mon[35094]: pgmap v247: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:27 smithi081 ceph-mon[30948]: pgmap v247: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:27.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:27 smithi173 ceph-mon[35326]: pgmap v247: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:29.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:29 smithi081 ceph-mon[30948]: pgmap v248: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:29.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:29 smithi173 ceph-mon[35326]: pgmap v248: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:29.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:29 smithi103 ceph-mon[35094]: pgmap v248: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:31.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:31 smithi081 ceph-mon[30948]: pgmap v249: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:31.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:31 smithi173 ceph-mon[35326]: pgmap v249: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:31.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:31 smithi103 ceph-mon[35094]: pgmap v249: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:33.706 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:33 smithi173 ceph-mon[35326]: pgmap v250: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:33.736 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:33 smithi103 ceph-mon[35094]: pgmap v250: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:33.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:33 smithi081 ceph-mon[30948]: pgmap v250: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:34.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:34 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:34.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:34 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:34.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:34 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:24:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:35 smithi081 ceph-mon[30948]: pgmap v251: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:24:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:24:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:24:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:35 smithi173 ceph-mon[35326]: pgmap v251: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:24:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:24:35.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:24:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:35 smithi103 ceph-mon[35094]: pgmap v251: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:24:35.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:24:35.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:24:37.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:37 smithi081 ceph-mon[30948]: pgmap v252: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:37.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:37 smithi173 ceph-mon[35326]: pgmap v252: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:37.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:37 smithi103 ceph-mon[35094]: pgmap v252: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:39.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:39 smithi081 ceph-mon[30948]: pgmap v253: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:39.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:39 smithi173 ceph-mon[35326]: pgmap v253: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:39.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:39 smithi103 ceph-mon[35094]: pgmap v253: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:41.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:41 smithi081 ceph-mon[30948]: pgmap v254: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:41.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:41 smithi173 ceph-mon[35326]: pgmap v254: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:41.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:41 smithi103 ceph-mon[35094]: pgmap v254: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:43.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:43 smithi081 ceph-mon[30948]: pgmap v255: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:43 smithi173 ceph-mon[35326]: pgmap v255: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:43.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:43 smithi103 ceph-mon[35094]: pgmap v255: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:45.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:45 smithi081 ceph-mon[30948]: pgmap v256: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:45.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:45 smithi173 ceph-mon[35326]: pgmap v256: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:45 smithi103 ceph-mon[35094]: pgmap v256: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:47.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:47 smithi081 ceph-mon[30948]: pgmap v257: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:47 smithi173 ceph-mon[35326]: pgmap v257: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:47 smithi103 ceph-mon[35094]: pgmap v257: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:49.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:49 smithi081 ceph-mon[30948]: pgmap v258: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:49 smithi173 ceph-mon[35326]: pgmap v258: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:49.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:49 smithi103 ceph-mon[35094]: pgmap v258: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:51.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:51 smithi081 ceph-mon[30948]: pgmap v259: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:51.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:51 smithi173 ceph-mon[35326]: pgmap v259: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:51.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:51 smithi103 ceph-mon[35094]: pgmap v259: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:53.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:53 smithi081 ceph-mon[30948]: pgmap v260: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:53.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:53 smithi173 ceph-mon[35326]: pgmap v260: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:53.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:53 smithi103 ceph-mon[35094]: pgmap v260: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:55.861 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:55 smithi081 ceph-mon[30948]: pgmap v261: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:55.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:55 smithi173 ceph-mon[35326]: pgmap v261: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:55.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:55 smithi103 ceph-mon[35094]: pgmap v261: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:57 smithi081 ceph-mon[30948]: pgmap v262: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:57.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:57 smithi173 ceph-mon[35326]: pgmap v262: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:57.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:57 smithi103 ceph-mon[35094]: pgmap v262: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:24:59.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:24:59 smithi081 ceph-mon[30948]: pgmap v263: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:59.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:24:59 smithi173 ceph-mon[35326]: pgmap v263: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:24:59.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:24:59 smithi103 ceph-mon[35094]: pgmap v263: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:01.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:01 smithi081 ceph-mon[30948]: pgmap v264: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:01.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:01 smithi173 ceph-mon[35326]: pgmap v264: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:01.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:01 smithi103 ceph-mon[35094]: pgmap v264: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:03.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:03 smithi081 ceph-mon[30948]: pgmap v265: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:25:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:03 smithi173 ceph-mon[35326]: pgmap v265: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:25:03.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:03 smithi103 ceph-mon[35094]: pgmap v265: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:25:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:05 smithi081 ceph-mon[30948]: pgmap v266: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:25:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:05 smithi173 ceph-mon[35326]: pgmap v266: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:25:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:05 smithi103 ceph-mon[35094]: pgmap v266: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:25:07.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:07 smithi081 ceph-mon[30948]: pgmap v267: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:25:07.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:07 smithi081 ceph-mon[30948]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:25:07.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:07 smithi173 ceph-mon[35326]: pgmap v267: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:25:07.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:07 smithi173 ceph-mon[35326]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:25:07.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:07 smithi103 ceph-mon[35094]: pgmap v267: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:25:07.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:07 smithi103 ceph-mon[35094]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T12:25:09.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:09 smithi081 ceph-mon[30948]: pgmap v269: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:25:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:09 smithi173 ceph-mon[35326]: pgmap v269: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:25:09.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:09 smithi103 ceph-mon[35094]: pgmap v269: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:25:11.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:11 smithi081 ceph-mon[30948]: pgmap v270: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:25:11.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:11 smithi173 ceph-mon[35326]: pgmap v270: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:25:11.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:11 smithi103 ceph-mon[35094]: pgmap v270: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 96 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:25:13.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:13 smithi081 ceph-mon[30948]: pgmap v271: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:25:13.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:13 smithi081 ceph-mon[30948]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:25:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:13 smithi173 ceph-mon[35326]: pgmap v271: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:25:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:13 smithi173 ceph-mon[35326]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:25:13.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:13 smithi103 ceph-mon[35094]: pgmap v271: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:25:13.936 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:13 smithi103 ceph-mon[35094]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T12:25:15.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:15 smithi081 ceph-mon[30948]: pgmap v273: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:25:15.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:15 smithi173 ceph-mon[35326]: pgmap v273: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:25:15.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:15 smithi103 ceph-mon[35094]: pgmap v273: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-12T12:25:17.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:17 smithi081 ceph-mon[30948]: pgmap v274: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 222 B/s wr, 11 op/s 2024-09-12T12:25:17.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:17 smithi173 ceph-mon[35326]: pgmap v274: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 222 B/s wr, 11 op/s 2024-09-12T12:25:17.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:17 smithi103 ceph-mon[35094]: pgmap v274: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 222 B/s wr, 11 op/s 2024-09-12T12:25:19.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:19 smithi081 ceph-mon[30948]: pgmap v275: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:25:19.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:19 smithi173 ceph-mon[35326]: pgmap v275: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:25:19.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:19 smithi103 ceph-mon[35094]: pgmap v275: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:25:21.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:21 smithi081 ceph-mon[30948]: pgmap v276: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:25:21.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:21 smithi173 ceph-mon[35326]: pgmap v276: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:25:21.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:21 smithi103 ceph-mon[35094]: pgmap v276: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:25:23.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:23 smithi081 ceph-mon[30948]: pgmap v277: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:25:23.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:23 smithi173 ceph-mon[35326]: pgmap v277: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:25:23.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:23 smithi103 ceph-mon[35094]: pgmap v277: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:25:25.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:25 smithi081 ceph-mon[30948]: pgmap v278: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:25:25.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:25 smithi173 ceph-mon[35326]: pgmap v278: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:25:25.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:25 smithi103 ceph-mon[35094]: pgmap v278: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:25:27.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:27 smithi081 ceph-mon[30948]: pgmap v279: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:27.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:27 smithi173 ceph-mon[35326]: pgmap v279: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:27.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:27 smithi103 ceph-mon[35094]: pgmap v279: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:29.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:29 smithi081 ceph-mon[30948]: pgmap v280: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:29.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:29 smithi173 ceph-mon[35326]: pgmap v280: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:29.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:29 smithi103 ceph-mon[35094]: pgmap v280: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:31.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:31 smithi081 ceph-mon[30948]: pgmap v281: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:31.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:31 smithi173 ceph-mon[35326]: pgmap v281: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:31.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:31 smithi103 ceph-mon[35094]: pgmap v281: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:33.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:33 smithi081 ceph-mon[30948]: pgmap v282: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:33.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:33 smithi173 ceph-mon[35326]: pgmap v282: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:33.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:33 smithi103 ceph-mon[35094]: pgmap v282: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:35.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:35 smithi081 ceph-mon[30948]: pgmap v283: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:25:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:35.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:25:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:35 smithi173 ceph-mon[35326]: pgmap v283: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:25:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:35.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:35.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:25:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:35 smithi103 ceph-mon[35094]: pgmap v283: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:25:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:25:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:25:35.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:25:37.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:37 smithi081 ceph-mon[30948]: pgmap v284: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:37.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:37 smithi173 ceph-mon[35326]: pgmap v284: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:37.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:37 smithi103 ceph-mon[35094]: pgmap v284: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:39.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:39 smithi081 ceph-mon[30948]: pgmap v285: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:39.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:39 smithi173 ceph-mon[35326]: pgmap v285: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:39.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:39 smithi103 ceph-mon[35094]: pgmap v285: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:41.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:41 smithi081 ceph-mon[30948]: pgmap v286: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:41.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:41 smithi173 ceph-mon[35326]: pgmap v286: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:41.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:41 smithi103 ceph-mon[35094]: pgmap v286: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:43.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:43 smithi081 ceph-mon[30948]: pgmap v287: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:43.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:43 smithi173 ceph-mon[35326]: pgmap v287: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:43.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:43 smithi103 ceph-mon[35094]: pgmap v287: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:45.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:45 smithi081 ceph-mon[30948]: pgmap v288: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:45.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:45 smithi173 ceph-mon[35326]: pgmap v288: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:45.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:45 smithi103 ceph-mon[35094]: pgmap v288: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:47.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:47 smithi081 ceph-mon[30948]: pgmap v289: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:47.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:47 smithi173 ceph-mon[35326]: pgmap v289: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:47.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:47 smithi103 ceph-mon[35094]: pgmap v289: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:49.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:49 smithi081 ceph-mon[30948]: pgmap v290: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:49.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:49 smithi173 ceph-mon[35326]: pgmap v290: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:49.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:49 smithi103 ceph-mon[35094]: pgmap v290: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:51.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:51 smithi081 ceph-mon[30948]: pgmap v291: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:51.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:51 smithi173 ceph-mon[35326]: pgmap v291: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:51.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:51 smithi103 ceph-mon[35094]: pgmap v291: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:53.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:53 smithi081 ceph-mon[30948]: pgmap v292: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:53.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:53 smithi173 ceph-mon[35326]: pgmap v292: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:53.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:53 smithi103 ceph-mon[35094]: pgmap v292: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:55.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:55 smithi081 ceph-mon[30948]: pgmap v293: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:55.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:55 smithi173 ceph-mon[35326]: pgmap v293: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:55.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:55 smithi103 ceph-mon[35094]: pgmap v293: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:57.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:57 smithi081 ceph-mon[30948]: pgmap v294: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:57.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:57 smithi173 ceph-mon[35326]: pgmap v294: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:57.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:57 smithi103 ceph-mon[35094]: pgmap v294: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:25:59.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:25:59 smithi081 ceph-mon[30948]: pgmap v295: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:59.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:25:59 smithi173 ceph-mon[35326]: pgmap v295: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:25:59.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:25:59 smithi103 ceph-mon[35094]: pgmap v295: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:01.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:01 smithi081 ceph-mon[30948]: pgmap v296: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:01.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:01 smithi173 ceph-mon[35326]: pgmap v296: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:01.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:01 smithi103 ceph-mon[35094]: pgmap v296: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:03.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:03 smithi081 ceph-mon[30948]: pgmap v297: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:26:03.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:03 smithi173 ceph-mon[35326]: pgmap v297: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:26:03.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:03 smithi103 ceph-mon[35094]: pgmap v297: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-09-12T12:26:05.860 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:05 smithi081 ceph-mon[30948]: pgmap v298: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:26:05.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:05 smithi173 ceph-mon[35326]: pgmap v298: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:26:05.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:05 smithi103 ceph-mon[35094]: pgmap v298: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-12T12:26:06.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:06 smithi173 ceph-mon[35326]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:26:06.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:06 smithi103 ceph-mon[35094]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:26:07.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:06 smithi081 ceph-mon[30948]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T12:26:07.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:07 smithi173 ceph-mon[35326]: pgmap v300: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:07.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:07 smithi103 ceph-mon[35094]: pgmap v300: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:08.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:07 smithi081 ceph-mon[30948]: pgmap v300: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:09.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:09 smithi173 ceph-mon[35326]: pgmap v301: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:09.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:09 smithi103 ceph-mon[35094]: pgmap v301: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:10.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:09 smithi081 ceph-mon[30948]: pgmap v301: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:11.905 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:11 smithi173 ceph-mon[35326]: pgmap v302: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:11.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:11 smithi103 ceph-mon[35094]: pgmap v302: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:12.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:11 smithi081 ceph-mon[30948]: pgmap v302: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-09-12T12:26:13.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:13 smithi173 ceph-mon[35326]: pgmap v303: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:26:13.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:13 smithi173 ceph-mon[35326]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:26:13.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:13 smithi103 ceph-mon[35094]: pgmap v303: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:26:13.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:13 smithi103 ceph-mon[35094]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:26:14.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:13 smithi081 ceph-mon[30948]: pgmap v303: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:26:14.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:13 smithi081 ceph-mon[30948]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T12:26:15.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:15 smithi173 ceph-mon[35326]: pgmap v305: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 251 B/s wr, 12 op/s 2024-09-12T12:26:15.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:15 smithi103 ceph-mon[35094]: pgmap v305: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 251 B/s wr, 12 op/s 2024-09-12T12:26:16.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:15 smithi081 ceph-mon[30948]: pgmap v305: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 251 B/s wr, 12 op/s 2024-09-12T12:26:17.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:17 smithi173 ceph-mon[35326]: pgmap v306: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:26:17.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:17 smithi103 ceph-mon[35094]: pgmap v306: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:26:18.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:17 smithi081 ceph-mon[30948]: pgmap v306: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-12T12:26:19.904 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:19 smithi173 ceph-mon[35326]: pgmap v307: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:26:19.912 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:19 smithi081 ceph-mon[30948]: pgmap v307: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:26:19.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:19 smithi103 ceph-mon[35094]: pgmap v307: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:26:20.903 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:20 smithi173 ceph-mon[35326]: pgmap v308: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:26:20.935 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:20 smithi103 ceph-mon[35094]: pgmap v308: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:26:21.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:20 smithi081 ceph-mon[30948]: pgmap v308: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-12T12:26:23.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:22 smithi081 ceph-mon[30948]: pgmap v309: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:26:23.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:22 smithi173 ceph-mon[35326]: pgmap v309: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:26:23.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:22 smithi103 ceph-mon[35094]: pgmap v309: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-12T12:26:25.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:24 smithi081 ceph-mon[30948]: pgmap v310: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:26:25.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:24 smithi173 ceph-mon[35326]: pgmap v310: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:26:25.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:24 smithi103 ceph-mon[35094]: pgmap v310: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-12T12:26:27.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:26 smithi081 ceph-mon[30948]: pgmap v311: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:27.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:26 smithi173 ceph-mon[35326]: pgmap v311: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:27.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:26 smithi103 ceph-mon[35094]: pgmap v311: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:27.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T12:26:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 -- 172.21.15.81:0/500893802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47981009b0 msgr2=0x7f4798100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 --2- 172.21.15.81:0/500893802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47981009b0 0x7f4798100e10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f478c009930 tx=0x7f478c02a420 comp rx=0 tx=0).stop 2024-09-12T12:26:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 -- 172.21.15.81:0/500893802 shutdown_connections 2024-09-12T12:26:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 --2- 172.21.15.81:0/500893802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4798101350 0x7f479810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 --2- 172.21.15.81:0/500893802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47981009b0 0x7f4798100e10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 --2- 172.21.15.81:0/500893802 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47981069c0 0x7f4798106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 -- 172.21.15.81:0/500893802 >> 172.21.15.81:0/500893802 conn(0x7f4798077990 msgr2=0x7f47980fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 -- 172.21.15.81:0/500893802 shutdown_connections 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.410+0000 7f479e6af640 1 -- 172.21.15.81:0/500893802 wait complete. 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 Processor -- start 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 -- start start 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47981009b0 0x7f47981991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 0x7f4798199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47981069c0 0x7f47981a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4798110f20 con 0x7f4798101350 2024-09-12T12:26:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4798110da0 con 0x7f47981009b0 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f479e6af640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f47981110a0 con 0x7f47981069c0 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f47977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 0x7f4798199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f47977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 0x7f4798199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55480/0 (socket says 172.21.15.81:55480) 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f47977fe640 1 -- 172.21.15.81:0/4010809185 learned_addr learned my addr 172.21.15.81:0/4010809185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.411+0000 7f4797fff640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47981009b0 0x7f47981991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f479cc4c640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47981069c0 0x7f47981a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47977fe640 1 -- 172.21.15.81:0/4010809185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47981069c0 msgr2=0x7f47981a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47977fe640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47981069c0 0x7f47981a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47977fe640 1 -- 172.21.15.81:0/4010809185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47981009b0 msgr2=0x7f47981991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47977fe640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47981009b0 0x7f47981991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47977fe640 1 -- 172.21.15.81:0/4010809185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47981a47a0 con 0x7f4798101350 2024-09-12T12:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47977fe640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 0x7f4798199720 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f478c009230 tx=0x7f478c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c03f030 con 0x7f4798101350 2024-09-12T12:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f478c003af0 con 0x7f4798101350 2024-09-12T12:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47981a4970 con 0x7f4798101350 2024-09-12T12:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c035070 con 0x7f4798101350 2024-09-12T12:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.412+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47981a4dd0 con 0x7f4798101350 2024-09-12T12:26:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.413+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4798100e10 con 0x7f4798101350 2024-09-12T12:26:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.414+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f478c042030 con 0x7f4798101350 2024-09-12T12:26:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.415+0000 7f47957fa640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f47800a2da0 0x7f47800a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.415+0000 7f4797fff640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f47800a2da0 0x7f47800a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.415+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f478c0efbe0 con 0x7f4798101350 2024-09-12T12:26:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.416+0000 7f4797fff640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f47800a2da0 0x7f47800a5260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f478800bb60 tx=0x7f478800b390 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.420+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f478c0bc900 con 0x7f4798101350 2024-09-12T12:26:27.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.605+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f4798103db0 con 0x7f47800a2da0 2024-09-12T12:26:27.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.613+0000 7f47957fa640 1 -- 172.21.15.81:0/4010809185 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f4798103db0 con 0x7f47800a2da0 2024-09-12T12:26:27.613 INFO:teuthology.orchestra.run.smithi081.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T12:16:26", "first": "2024-09-12T12:17:00", "last": "2024-09-12T12:26:00", "last_pruned": "2024-09-12T12:26:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-12T12:26:27.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f47800a2da0 msgr2=0x7f47800a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f47800a2da0 0x7f47800a5260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f478800bb60 tx=0x7f478800b390 comp rx=0 tx=0).stop 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 msgr2=0x7f4798199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 0x7f4798199720 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f478c009230 tx=0x7f478c004270 comp rx=0 tx=0).stop 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 shutdown_connections 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f47800a2da0 0x7f47800a5260 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f47981069c0 0x7f47981a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4798101350 0x7f4798199720 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 --2- 172.21.15.81:0/4010809185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47981009b0 0x7f47981991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 >> 172.21.15.81:0/4010809185 conn(0x7f4798077990 msgr2=0x7f47981036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 shutdown_connections 2024-09-12T12:26:27.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.615+0000 7f479e6af640 1 -- 172.21.15.81:0/4010809185 wait complete. 2024-09-12T12:26:27.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T12:26:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/2724868963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca010c0d0 msgr2=0x7f3ca010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/2724868963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca010c0d0 0x7f3ca010e550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009900 tx=0x7f3c9802a480 comp rx=0 tx=0).stop 2024-09-12T12:26:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/2724868963 shutdown_connections 2024-09-12T12:26:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/2724868963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca010c0d0 0x7f3ca010e550 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/2724868963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ca01035a0 0x7f3ca010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/2724868963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca0102c80 0x7f3ca0103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.727+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/2724868963 >> 172.21.15.81:0/2724868963 conn(0x7f3ca0077990 msgr2=0x7f3ca00fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/2724868963 shutdown_connections 2024-09-12T12:26:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/2724868963 wait complete. 2024-09-12T12:26:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 Processor -- start 2024-09-12T12:26:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 -- start start 2024-09-12T12:26:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 0x7f3ca01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ca01035a0 0x7f3ca0198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca010c0d0 0x7f3ca019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0111fd0 con 0x7f3ca0102c80 2024-09-12T12:26:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0111e50 con 0x7f3ca01035a0 2024-09-12T12:26:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.728+0000 7f3ca4a0a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112150 con 0x7f3ca010c0d0 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 0x7f3ca01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 0x7f3ca01983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55494/0 (socket says 172.21.15.81:55494) 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 -- 172.21.15.81:0/939790003 learned_addr learned my addr 172.21.15.81:0/939790003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9ed9d640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca010c0d0 0x7f3ca019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9dd9b640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ca01035a0 0x7f3ca0198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 -- 172.21.15.81:0/939790003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca010c0d0 msgr2=0x7f3ca019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca010c0d0 0x7f3ca019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 -- 172.21.15.81:0/939790003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ca01035a0 msgr2=0x7f3ca0198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ca01035a0 0x7f3ca0198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 -- 172.21.15.81:0/939790003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca019d3d0 con 0x7f3ca0102c80 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c9e59c640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 0x7f3ca01983e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000cce0 tx=0x7f3c9000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90004b20 con 0x7f3ca0102c80 2024-09-12T12:26:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c90004cc0 con 0x7f3ca0102c80 2024-09-12T12:26:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca019d6c0 con 0x7f3ca0102c80 2024-09-12T12:26:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000f8c0 con 0x7f3ca0102c80 2024-09-12T12:26:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.729+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca01a4f50 con 0x7f3ca0102c80 2024-09-12T12:26:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.730+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca0103060 con 0x7f3ca0102c80 2024-09-12T12:26:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.731+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f3c900056b0 con 0x7f3ca0102c80 2024-09-12T12:26:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.732+0000 7f3c977fe640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3c8c0a2da0 0x7f3c8c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.733+0000 7f3c9dd9b640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3c8c0a2da0 0x7f3c8c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.733+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f3c900cf640 con 0x7f3ca0102c80 2024-09-12T12:26:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.733+0000 7f3c9dd9b640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3c8c0a2da0 0x7f3c8c0a5260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c88005e00 tx=0x7f3c88005c90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.737+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c90014030 con 0x7f3ca0102c80 2024-09-12T12:26:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.923+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 --> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f3ca00fd420 con 0x7f3c8c0a2da0 2024-09-12T12:26:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.930+0000 7f3c977fe640 1 -- 172.21.15.81:0/939790003 <== mgr.15219 v2:172.21.15.81:6800/96268870 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f3ca00fd420 con 0x7f3c8c0a2da0 2024-09-12T12:26:27.930 INFO:teuthology.orchestra.run.smithi081.stdout:/ 1m 6m3h 2024-09-12T12:26:27.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3c8c0a2da0 msgr2=0x7f3c8c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3c8c0a2da0 0x7f3c8c0a5260 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3c88005e00 tx=0x7f3c88005c90 comp rx=0 tx=0).stop 2024-09-12T12:26:27.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 msgr2=0x7f3ca01983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 0x7f3ca01983e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000cce0 tx=0x7f3c9000a620 comp rx=0 tx=0).stop 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 shutdown_connections 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f3c8c0a2da0 0x7f3c8c0a5260 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ca010c0d0 0x7f3ca019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ca01035a0 0x7f3ca0198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 --2- 172.21.15.81:0/939790003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0102c80 0x7f3ca01983e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 >> 172.21.15.81:0/939790003 conn(0x7f3ca0077990 msgr2=0x7f3ca00fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 shutdown_connections 2024-09-12T12:26:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:27.932+0000 7f3ca4a0a640 1 -- 172.21.15.81:0/939790003 wait complete. 2024-09-12T12:26:27.942 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:27 smithi081 ceph-mon[30948]: from='client.15855 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:26:27.943 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T12:26:27.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T12:26:28.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 -- 172.21.15.81:0/3491036272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41069d0 msgr2=0x7f87d4106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 --2- 172.21.15.81:0/3491036272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41069d0 0x7f87d4106db0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009930 tx=0x7f87d002a420 comp rx=0 tx=0).stop 2024-09-12T12:26:28.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 -- 172.21.15.81:0/3491036272 shutdown_connections 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 --2- 172.21.15.81:0/3491036272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 0x7f87d410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 --2- 172.21.15.81:0/3491036272 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87d41009c0 0x7f87d4100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 --2- 172.21.15.81:0/3491036272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41069d0 0x7f87d4106db0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 -- 172.21.15.81:0/3491036272 >> 172.21.15.81:0/3491036272 conn(0x7f87d40fc6a0 msgr2=0x7f87d40feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 -- 172.21.15.81:0/3491036272 shutdown_connections 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 -- 172.21.15.81:0/3491036272 wait complete. 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 Processor -- start 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.054+0000 7f87dc559640 1 -- start start 2024-09-12T12:26:28.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 0x7f87d41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 0x7f87d41998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87d41069d0 0x7f87d41a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87d4110f30 con 0x7f87d41009c0 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f87d4110db0 con 0x7f87d4101360 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87d41110b0 con 0x7f87d41069d0 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 0x7f87d41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 0x7f87d41993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55520/0 (socket says 172.21.15.81:55520) 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 -- 172.21.15.81:0/3409982872 learned_addr learned my addr 172.21.15.81:0/3409982872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87d9af4640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 0x7f87d41998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87daaf6640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87d41069d0 0x7f87d41a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 -- 172.21.15.81:0/3409982872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87d41069d0 msgr2=0x7f87d41a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87d41069d0 0x7f87d41a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 -- 172.21.15.81:0/3409982872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 msgr2=0x7f87d41998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 0x7f87d41998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 -- 172.21.15.81:0/3409982872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87d41a4960 con 0x7f87d41009c0 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87d9af4640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 0x7f87d41998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87da2f5640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 0x7f87d41993a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009230 tx=0x7f87d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d003f030 con 0x7f87d41009c0 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87d41a4b30 con 0x7f87d41009c0 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87d0003af0 con 0x7f87d41009c0 2024-09-12T12:26:28.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0035070 con 0x7f87d41009c0 2024-09-12T12:26:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.055+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87d41a4f90 con 0x7f87d41009c0 2024-09-12T12:26:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.056+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87d4100e20 con 0x7f87d41009c0 2024-09-12T12:26:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.058+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f87d0042030 con 0x7f87d41009c0 2024-09-12T12:26:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.059+0000 7f87cb7fe640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f87c00a2d00 0x7f87c00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.059+0000 7f87d9af4640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f87c00a2d00 0x7f87c00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.059+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f87d00efff0 con 0x7f87d41009c0 2024-09-12T12:26:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.059+0000 7f87d9af4640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f87c00a2d00 0x7f87c00a51c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87c40058c0 tx=0x7f87c4005850 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.062+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87d00bcd10 con 0x7f87d41009c0 2024-09-12T12:26:28.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:27 smithi173 ceph-mon[35326]: from='client.15855 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:26:28.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:27 smithi103 ceph-mon[35094]: from='client.15855 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:26:28.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.229+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87d406a9f0 con 0x7f87d41009c0 2024-09-12T12:26:28.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.230+0000 7f87cb7fe640 1 -- 172.21.15.81:0/3409982872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23109 (secure 0 0 0) 0x7f87d406a9f0 con 0x7f87d41009c0 2024-09-12T12:26:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:26:28.231 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":88,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:26:13.330288+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/4236049851":"2024-09-13T12:16:25.570397+0000","172.21.15.81:6800/4236049851":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/22849456":"2024-09-13T12:16:25.570397+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2649443491":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/4279243684":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/1340615058":"2024-09-13T12:16:25.570397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f87c00a2d00 msgr2=0x7f87c00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f87c00a2d00 0x7f87c00a51c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87c40058c0 tx=0x7f87c4005850 comp rx=0 tx=0).stop 2024-09-12T12:26:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 msgr2=0x7f87d41993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 0x7f87d41993a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009230 tx=0x7f87d0004270 comp rx=0 tx=0).stop 2024-09-12T12:26:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 shutdown_connections 2024-09-12T12:26:28.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f87c00a2d00 0x7f87c00a51c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87d41069d0 0x7f87d41a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87d4101360 0x7f87d41998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 --2- 172.21.15.81:0/3409982872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87d41009c0 0x7f87d41993a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 >> 172.21.15.81:0/3409982872 conn(0x7f87d40fc6a0 msgr2=0x7f87d40fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 shutdown_connections 2024-09-12T12:26:28.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.233+0000 7f87dc559640 1 -- 172.21.15.81:0/3409982872 wait complete. 2024-09-12T12:26:28.246 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T12:10:04.561261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T12:14:31.876252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T12:14:34.201036+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 87, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T12:26:28.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T12:26:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 -- 172.21.15.81:0/254779674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90100970 msgr2=0x7f1c9010e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 --2- 172.21.15.81:0/254779674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90100970 0x7f1c9010e960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009900 tx=0x7f1c8802a410 comp rx=0 tx=0).stop 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 -- 172.21.15.81:0/254779674 shutdown_connections 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 --2- 172.21.15.81:0/254779674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90100970 0x7f1c9010e960 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 --2- 172.21.15.81:0/254779674 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c900fffd0 0x7f1c90100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 --2- 172.21.15.81:0/254779674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c90106ab0 0x7f1c90106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 -- 172.21.15.81:0/254779674 >> 172.21.15.81:0/254779674 conn(0x7f1c90077170 msgr2=0x7f1c900fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 -- 172.21.15.81:0/254779674 shutdown_connections 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 -- 172.21.15.81:0/254779674 wait complete. 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.349+0000 7f1c96227640 1 Processor -- start 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 -- start start 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c900fffd0 0x7f1c901011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90100970 0x7f1c901016f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 0x7f1c90101c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90112100 con 0x7f1c90106ab0 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90111f80 con 0x7f1c90100970 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c96227640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90112280 con 0x7f1c900fffd0 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 0x7f1c90101c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 0x7f1c90101c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55538/0 (socket says 172.21.15.81:55538) 2024-09-12T12:26:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 -- 172.21.15.81:0/178329245 learned_addr learned my addr 172.21.15.81:0/178329245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8effd640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90100970 0x7f1c901016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 -- 172.21.15.81:0/178329245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c900fffd0 msgr2=0x7f1c901011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8f7fe640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c900fffd0 0x7f1c901011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c900fffd0 0x7f1c901011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 -- 172.21.15.81:0/178329245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90100970 msgr2=0x7f1c901016f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90100970 0x7f1c901016f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8ffff640 1 -- 172.21.15.81:0/178329245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c901a6a30 con 0x7f1c90106ab0 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8effd640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90100970 0x7f1c901016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.350+0000 7f1c8f7fe640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c900fffd0 0x7f1c901011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.351+0000 7f1c8ffff640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 0x7f1c90101c30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009230 tx=0x7f1c880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.351+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8803f030 con 0x7f1c90106ab0 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.351+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c901a6cc0 con 0x7f1c90106ab0 2024-09-12T12:26:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.351+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c88003d00 con 0x7f1c90106ab0 2024-09-12T12:26:28.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.351+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88035070 con 0x7f1c90106ab0 2024-09-12T12:26:28.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.351+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c901a7200 con 0x7f1c90106ab0 2024-09-12T12:26:28.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.352+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90100430 con 0x7f1c90106ab0 2024-09-12T12:26:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.353+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f1c88042030 con 0x7f1c90106ab0 2024-09-12T12:26:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.353+0000 7f1c8cff9640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1c7c0a2d00 0x7f1c7c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.354+0000 7f1c8f7fe640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1c7c0a2d00 0x7f1c7c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.354+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f1c880efe00 con 0x7f1c90106ab0 2024-09-12T12:26:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.354+0000 7f1c8f7fe640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1c7c0a2d00 0x7f1c7c0a51c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007eb0 tx=0x7f1c800073c0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.356+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c880bca00 con 0x7f1c90106ab0 2024-09-12T12:26:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.520+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c901a7430 con 0x7f1c90106ab0 2024-09-12T12:26:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.521+0000 7f1c8cff9640 1 -- 172.21.15.81:0/178329245 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f1c880bc300 con 0x7f1c90106ab0 2024-09-12T12:26:28.521 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-12T12:26:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1c7c0a2d00 msgr2=0x7f1c7c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1c7c0a2d00 0x7f1c7c0a51c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c80007eb0 tx=0x7f1c800073c0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 msgr2=0x7f1c90101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 0x7f1c90101c30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009230 tx=0x7f1c880042f0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 shutdown_connections 2024-09-12T12:26:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f1c7c0a2d00 0x7f1c7c0a51c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c90106ab0 0x7f1c90101c30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c90100970 0x7f1c901016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 --2- 172.21.15.81:0/178329245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c900fffd0 0x7f1c901011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 >> 172.21.15.81:0/178329245 conn(0x7f1c90077170 msgr2=0x7f1c901049b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 shutdown_connections 2024-09-12T12:26:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.523+0000 7f1c96227640 1 -- 172.21.15.81:0/178329245 wait complete. 2024-09-12T12:26:28.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T12:26:28.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3916257489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 msgr2=0x7f2fa0107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3916257489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa0107e70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2f90009930 tx=0x7f2f9002a420 comp rx=0 tx=0).stop 2024-09-12T12:26:28.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3916257489 shutdown_connections 2024-09-12T12:26:28.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3916257489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fa0102420 0x7f2fa010e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3916257489 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fa0101a80 0x7f2fa0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3916257489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa0107e70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3916257489 >> 172.21.15.81:0/3916257489 conn(0x7f2fa00fd7c0 msgr2=0x7f2fa00ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3916257489 shutdown_connections 2024-09-12T12:26:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.636+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3916257489 wait complete. 2024-09-12T12:26:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 Processor -- start 2024-09-12T12:26:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 -- start start 2024-09-12T12:26:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fa0101a80 0x7f2fa01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fa0102420 0x7f2fa0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0111ff0 con 0x7f2fa0107a90 2024-09-12T12:26:28.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0111e70 con 0x7f2fa0102420 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2fa4eaf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa0112170 con 0x7f2fa0101a80 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2f9ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.637+0000 7f2f9ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55554/0 (socket says 172.21.15.81:55554) 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 -- 172.21.15.81:0/3666383650 learned_addr learned my addr 172.21.15.81:0/3666383650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f95d9b640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fa0102420 0x7f2fa0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9e59c640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fa0101a80 0x7f2fa01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 -- 172.21.15.81:0/3666383650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fa0101a80 msgr2=0x7f2fa01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fa0101a80 0x7f2fa01984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 -- 172.21.15.81:0/3666383650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fa0102420 msgr2=0x7f2fa0198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fa0102420 0x7f2fa0198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 -- 172.21.15.81:0/3666383650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa019d4c0 con 0x7f2fa0107a90 2024-09-12T12:26:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f9ed9d640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa019cd90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800eaa0 tx=0x7f2f9800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800cdb0 con 0x7f2fa0107a90 2024-09-12T12:26:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2f98004b20 con 0x7f2fa0107a90 2024-09-12T12:26:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa019d7b0 con 0x7f2fa0107a90 2024-09-12T12:26:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98011760 con 0x7f2fa0107a90 2024-09-12T12:26:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.638+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa01a5040 con 0x7f2fa0107a90 2024-09-12T12:26:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.639+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa0101ee0 con 0x7f2fa0107a90 2024-09-12T12:26:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.640+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2f98004cd0 con 0x7f2fa0107a90 2024-09-12T12:26:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.641+0000 7f2f97fff640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2f8c0a2d00 0x7f2f8c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.641+0000 7f2f9e59c640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2f8c0a2d00 0x7f2f8c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.641+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f2f980cf610 con 0x7f2fa0107a90 2024-09-12T12:26:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.641+0000 7f2f9e59c640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2f8c0a2d00 0x7f2f8c0a51c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f90006010 tx=0x7f2f90000bc0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.645+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f98016030 con 0x7f2fa0107a90 2024-09-12T12:26:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.810+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2fa010a050 con 0x7f2fa0107a90 2024-09-12T12:26:28.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.812+0000 7f2f97fff640 1 -- 172.21.15.81:0/3666383650 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f2f9809c270 con 0x7f2fa0107a90 2024-09-12T12:26:28.812 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-12T12:26:28.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2f8c0a2d00 msgr2=0x7f2f8c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2f8c0a2d00 0x7f2f8c0a51c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f90006010 tx=0x7f2f90000bc0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 msgr2=0x7f2fa019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa019cd90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800eaa0 tx=0x7f2f9800ef60 comp rx=0 tx=0).stop 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 shutdown_connections 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f2f8c0a2d00 0x7f2f8c0a51c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fa0107a90 0x7f2fa019cd90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fa0102420 0x7f2fa0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 --2- 172.21.15.81:0/3666383650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2fa0101a80 0x7f2fa01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 >> 172.21.15.81:0/3666383650 conn(0x7f2fa00fd7c0 msgr2=0x7f2fa00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 shutdown_connections 2024-09-12T12:26:28.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.814+0000 7f2fa4eaf640 1 -- 172.21.15.81:0/3666383650 wait complete. 2024-09-12T12:26:28.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T12:26:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 -- 172.21.15.81:0/3150142048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f630010c0c0 msgr2=0x7f630010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 --2- 172.21.15.81:0/3150142048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f630010c0c0 0x7f630010e530 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009ca0 tx=0x7f62f802a950 comp rx=0 tx=0).stop 2024-09-12T12:26:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 -- 172.21.15.81:0/3150142048 shutdown_connections 2024-09-12T12:26:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 --2- 172.21.15.81:0/3150142048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f630010c0c0 0x7f630010e530 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 --2- 172.21.15.81:0/3150142048 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 0x7f630010baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 --2- 172.21.15.81:0/3150142048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6300102cf0 0x7f63001030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.927+0000 7f63053c4640 1 -- 172.21.15.81:0/3150142048 >> 172.21.15.81:0/3150142048 conn(0x7f63000779d0 msgr2=0x7f63000fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 -- 172.21.15.81:0/3150142048 shutdown_connections 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 -- 172.21.15.81:0/3150142048 wait complete. 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 Processor -- start 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 -- start start 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 0x7f6300198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 0x7f63001989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f630010c0c0 0x7f630019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.928+0000 7f63053c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6300111fb0 con 0x7f6300102cf0 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f63053c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6300111e30 con 0x7f630010c0c0 2024-09-12T12:26:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f63053c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6300112130 con 0x7f6300103610 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 0x7f6300198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 0x7f6300198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55572/0 (socket says 172.21.15.81:55572) 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 -- 172.21.15.81:0/1728900429 learned_addr learned my addr 172.21.15.81:0/1728900429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 -- 172.21.15.81:0/1728900429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 msgr2=0x7f63001989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62fe7fc640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 0x7f63001989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62ff7fe640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f630010c0c0 0x7f630019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 0x7f63001989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 -- 172.21.15.81:0/1728900429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f630010c0c0 msgr2=0x7f630019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f630010c0c0 0x7f630019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 -- 172.21.15.81:0/1728900429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630019d450 con 0x7f6300102cf0 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62fe7fc640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 0x7f63001989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62feffd640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 0x7f6300198460 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c890 tx=0x7f62f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0004220 con 0x7f6300102cf0 2024-09-12T12:26:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f62f00043c0 con 0x7f6300102cf0 2024-09-12T12:26:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630019d740 con 0x7f6300102cf0 2024-09-12T12:26:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0004b10 con 0x7f6300102cf0 2024-09-12T12:26:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.929+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001a4fd0 con 0x7f6300102cf0 2024-09-12T12:26:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.930+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63001030d0 con 0x7f6300102cf0 2024-09-12T12:26:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.931+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f62f00051b0 con 0x7f6300102cf0 2024-09-12T12:26:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.932+0000 7f62e7fff640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f62e80a2d80 0x7f62e80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.932+0000 7f62fe7fc640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f62e80a2d80 0x7f62e80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.932+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f62f00cf4b0 con 0x7f6300102cf0 2024-09-12T12:26:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.932+0000 7f62fe7fc640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f62e80a2d80 0x7f62e80a5240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f62f4005fd0 tx=0x7f62f40094d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:28.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:28.936+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62f0014030 con 0x7f6300102cf0 2024-09-12T12:26:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.101+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f630002d7c0 con 0x7f6300102cf0 2024-09-12T12:26:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.101+0000 7f62e7fff640 1 -- 172.21.15.81:0/1728900429 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f62f009c110 con 0x7f6300102cf0 2024-09-12T12:26:29.101 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f62e80a2d80 msgr2=0x7f62e80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f62e80a2d80 0x7f62e80a5240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f62f4005fd0 tx=0x7f62f40094d0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 msgr2=0x7f6300198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 0x7f6300198460 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c890 tx=0x7f62f000cd50 comp rx=0 tx=0).stop 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 shutdown_connections 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f62e80a2d80 0x7f62e80a5240 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f630010c0c0 0x7f630019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6300103610 0x7f63001989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 --2- 172.21.15.81:0/1728900429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6300102cf0 0x7f6300198460 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 >> 172.21.15.81:0/1728900429 conn(0x7f63000779d0 msgr2=0x7f63000fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 shutdown_connections 2024-09-12T12:26:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.103+0000 7f63053c4640 1 -- 172.21.15.81:0/1728900429 wait complete. 2024-09-12T12:26:29.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:28 smithi081 ceph-mon[30948]: pgmap v312: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:29.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:28 smithi081 ceph-mon[30948]: from='client.15861 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:26:29.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:28 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3409982872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:29.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:28 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/178329245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:26:29.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T12:26:29.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:28 smithi173 ceph-mon[35326]: pgmap v312: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:29.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:28 smithi173 ceph-mon[35326]: from='client.15861 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:26:29.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:28 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3409982872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:29.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:28 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/178329245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:26:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:28 smithi103 ceph-mon[35094]: pgmap v312: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:28 smithi103 ceph-mon[35094]: from='client.15861 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T12:26:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:28 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3409982872' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:29.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:28 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/178329245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 -- 172.21.15.81:0/2984548597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c103610 msgr2=0x7fe94c10baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 --2- 172.21.15.81:0/2984548597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c103610 0x7fe94c10baf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe940009900 tx=0x7fe94002a480 comp rx=0 tx=0).stop 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 -- 172.21.15.81:0/2984548597 shutdown_connections 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 --2- 172.21.15.81:0/2984548597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c10c080 0x7fe94c10e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 --2- 172.21.15.81:0/2984548597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c103610 0x7fe94c10baf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 --2- 172.21.15.81:0/2984548597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94c102cf0 0x7fe94c1030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 -- 172.21.15.81:0/2984548597 >> 172.21.15.81:0/2984548597 conn(0x7fe94c0fc6c0 msgr2=0x7fe94c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 -- 172.21.15.81:0/2984548597 shutdown_connections 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 -- 172.21.15.81:0/2984548597 wait complete. 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.213+0000 7fe951e23640 1 Processor -- start 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 -- start start 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c102cf0 0x7fe94c100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94c103610 0x7fe94c100e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 0x7fe94c1013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c111fc0 con 0x7fe94c10c080 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c111e40 con 0x7fe94c103610 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe951e23640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe94c112140 con 0x7fe94c102cf0 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 0x7fe94c1013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 0x7fe94c1013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55590/0 (socket says 172.21.15.81:55590) 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 -- 172.21.15.81:0/3756919851 learned_addr learned my addr 172.21.15.81:0/3756919851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94affd640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94c103610 0x7fe94c100e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:29.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94b7fe640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c102cf0 0x7fe94c100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 -- 172.21.15.81:0/3756919851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c102cf0 msgr2=0x7fe94c100940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c102cf0 0x7fe94c100940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 -- 172.21.15.81:0/3756919851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94c103610 msgr2=0x7fe94c100e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94c103610 0x7fe94c100e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 -- 172.21.15.81:0/3756919851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94c1a68d0 con 0x7fe94c10c080 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.214+0000 7fe94bfff640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 0x7fe94c1013c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe94400eaa0 tx=0x7fe94400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.215+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94400cdb0 con 0x7fe94c10c080 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.215+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe944004b20 con 0x7fe94c10c080 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.215+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe94c1a6bc0 con 0x7fe94c10c080 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.215+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944011760 con 0x7fe94c10c080 2024-09-12T12:26:29.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.215+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe94c1a7110 con 0x7fe94c10c080 2024-09-12T12:26:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.216+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe94c1030d0 con 0x7fe94c10c080 2024-09-12T12:26:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.217+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe944004cd0 con 0x7fe94c10c080 2024-09-12T12:26:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.217+0000 7fe948ff9640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fe9340a2d00 0x7fe9340a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.217+0000 7fe94b7fe640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fe9340a2d00 0x7fe9340a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.217+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7fe9440cf6a0 con 0x7fe94c10c080 2024-09-12T12:26:29.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.218+0000 7fe94b7fe640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fe9340a2d00 0x7fe9340a51c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005e10 tx=0x7fe93c005da0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:29.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.222+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe944016030 con 0x7fe94c10c080 2024-09-12T12:26:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.432+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe94c1a73a0 con 0x7fe94c10c080 2024-09-12T12:26:29.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.440+0000 7fe948ff9640 1 -- 172.21.15.81:0/3756919851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740895 (secure 0 0 0) 0x7fe94409c300 con 0x7fe94c10c080 2024-09-12T12:26:29.449 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:26:29.449 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "active_gid": 15219, 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "active_name": "x", 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addrs": { 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 96268870 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 96268870 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addr": "172.21.15.81:6801/96268870", 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "active_change": "2024-09-12T12:16:25.570589+0000", 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "available": true, 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "standbys": [ 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24754, 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "z", 2024-09-12T12:26:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540701547738038271, 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.453 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.455 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.456 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.461 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-12T12:26:29.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.464 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-12T12:26:29.466 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-12T12:26:29.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-12T12:26:29.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-12T12:26:29.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.470 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.471 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.473 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.474 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T12:26:29.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.477 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.478 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.479 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T12:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-12T12:26:29.483 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.486 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.487 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.488 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.489 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.490 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:26:29.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-12T12:26:29.495 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.498 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.501 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.502 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:26:29.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:26:29.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-12T12:26:29.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-12T12:26:29.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-12T12:26:29.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-12T12:26:29.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-12T12:26:29.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-12T12:26:29.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-12T12:26:29.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-12T12:26:29.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:26:29.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-12T12:26:29.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.516 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.526 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.527 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.531 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-12T12:26:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:26:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.545 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:26:29.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:26:29.549 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.550 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.551 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.554 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.555 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.560 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.566 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:26:29.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:26:29.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.572 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.584 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.586 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.590 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.596 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.599 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.608 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.612 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.615 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.616 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-12T12:26:29.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:26:29.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:29.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:29.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.621 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.625 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.626 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-12T12:26:29.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.628 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.630 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.631 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.632 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-12T12:26:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.636 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-12T12:26:29.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:29.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.639 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-12T12:26:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.641 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.643 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.644 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.645 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.646 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-12T12:26:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:26:29.649 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:26:29.652 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.653 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.654 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.655 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.657 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.659 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.660 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.663 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-12T12:26:29.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.667 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.668 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.669 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.670 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.671 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.672 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.675 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.679 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.680 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.681 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.682 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.685 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.689 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.690 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.691 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-12T12:26:29.692 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-12T12:26:29.696 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.697 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.705 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.706 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.708 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.715 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.716 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.717 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T12:26:29.719 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-12T12:26:29.720 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.738 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-12T12:26:29.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:26:29.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-12T12:26:29.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-12T12:26:29.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.752 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.757 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-12T12:26:29.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.763 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.765 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.768 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.773 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.777 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.778 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.785 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.786 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.789 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.792 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.794 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.799 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.802 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.803 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.810 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-12T12:26:29.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-12T12:26:29.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.813 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.814 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.819 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.820 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.823 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.825 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.828 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.829 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.831 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:29.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.838 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.839 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.840 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.841 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.843 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-12T12:26:29.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.845 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.847 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.851 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.853 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-12T12:26:29.854 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-12T12:26:29.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.858 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.859 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.860 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.861 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.862 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.863 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.865 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.868 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.870 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.871 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.873 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.874 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.875 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.876 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.878 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-12T12:26:29.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.881 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.882 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-12T12:26:29.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.884 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.887 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.888 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.889 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.890 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.891 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-12T12:26:29.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:26:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24812, 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "y", 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540701547738038271, 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.896 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.898 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.900 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.901 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.905 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.908 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.909 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-12T12:26:29.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.912 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.913 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.916 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.917 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.918 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:26:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T12:26:29.920 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.921 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.925 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.926 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.927 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.928 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-12T12:26:29.929 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.930 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.931 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.933 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:29.934 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.935 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:26:29.938 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:26:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.941 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.942 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.944 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.945 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.946 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.947 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-12T12:26:29.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-12T12:26:29.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:26:29.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.951 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.952 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.953 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.956 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.958 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.959 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:26:29.963 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.965 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.966 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.967 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.969 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.970 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.974 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.976 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:29.977 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:29.978 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.979 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.982 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.984 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.985 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.986 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.987 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.989 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.990 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.991 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:26:29.993 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:26:29.994 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.995 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.996 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:26:29.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-12T12:26:29.999 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.001 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.002 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.003 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.004 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.005 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.007 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-12T12:26:30.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.011 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.012 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:26:30.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.014 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.015 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.016 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.017 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.018 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:26:30.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.020 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.021 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.022 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.023 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.024 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:26:30.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.033 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.034 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.036 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.037 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.046 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.048 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.049 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.052 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.053 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.054 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.059 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.062 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.064 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.065 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-12T12:26:30.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:26:30.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:30.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:30.070 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T12:26:30.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-12T12:26:30.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T12:26:30.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.074 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.075 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.080 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.080 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.081 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.082 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.088 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.089 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:26:30.090 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:26:30.091 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:26:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-12T12:26:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-12T12:26:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:26:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-12T12:26:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-12T12:26:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-12T12:26:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-12T12:26:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-12T12:26:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T12:26:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.225 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.227 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.230 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.234 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.235 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.236 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.237 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.240 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.241 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.242 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.244 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.246 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.247 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.249 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.252 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.253 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.254 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.255 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-12T12:26:30.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-12T12:26:30.258 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.259 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.260 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.262 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.263 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.265 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-12T12:26:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.267 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-12T12:26:30.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.271 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.272 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.274 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.275 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.277 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.280 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.284 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.288 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.291 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:26:30.294 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-12T12:26:30.295 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.296 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.297 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.298 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.299 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-12T12:26:30.301 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:26:30.302 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.303 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.304 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.305 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.306 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.307 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:26:30.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.310 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.312 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.314 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.315 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.317 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.320 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.321 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.323 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.324 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.325 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.327 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.329 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.332 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.333 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.334 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.335 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.336 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.337 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.338 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.340 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.342 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.344 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.345 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.346 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.347 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.348 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.349 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "modules": [ 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard", 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "iostat", 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nfs", 2024-09-12T12:26:30.350 INFO:teuthology.orchestra.run.smithi081.stdout: "restful", 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_schedule" 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.352 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.353 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.354 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.355 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.359 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-12T12:26:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T12:26:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:26:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-12T12:26:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-12T12:26:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-12T12:26:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.375 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.377 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.379 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.380 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.383 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T12:26:30.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.386 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.387 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-12T12:26:30.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-12T12:26:30.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-12T12:26:30.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.391 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.393 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.394 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.395 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.396 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.397 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.399 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.400 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.402 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-12T12:26:30.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-12T12:26:30.406 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-12T12:26:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.408 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.409 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.414 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T12:26:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.417 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.418 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.419 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.420 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.421 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.422 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.423 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.424 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.425 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.427 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.429 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-12T12:26:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-12T12:26:30.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.435 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T12:26:30.437 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.438 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T12:26:30.439 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.440 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.441 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.442 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.443 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.444 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-12T12:26:30.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-12T12:26:30.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.450 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.451 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-12T12:26:30.453 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.454 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.456 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.458 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.460 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T12:26:30.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.462 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.468 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.470 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.473 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:30.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T12:26:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T12:26:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T12:26:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T12:26:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T12:26:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-12T12:26:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-12T12:26:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-12T12:26:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-12T12:26:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-12T12:26:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T12:26:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-09-12T12:26:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-09-12T12:26:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-12T12:26:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T12:26:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-12T12:26:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T12:26:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.642 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.644 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.645 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.648 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.649 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.651 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.653 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T12:26:30.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-12T12:26:30.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.664 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-12T12:26:30.665 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-12T12:26:30.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-12T12:26:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T12:26:30.669 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.670 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.671 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.675 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.676 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.677 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.678 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.679 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.681 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.689 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.690 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.696 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.697 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.698 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-12T12:26:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-12T12:26:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-12T12:26:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-12T12:26:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-12T12:26:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-12T12:26:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-12T12:26:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-12T12:26:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-12T12:26:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-12T12:26:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-12T12:26:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-12T12:26:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-12T12:26:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-12T12:26:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-12T12:26:30.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-12T12:26:30.794 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-12T12:26:30.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.797 INFO:teuthology.orchestra.run.smithi081.stdout: "services": { 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard": "https://172.21.15.81:8443/" 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "always_on_modules": { 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus": [ 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T12:26:30.798 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific": [ 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T12:26:30.799 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy": [ 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T12:26:30.800 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "reef": [ 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "squid": [ 2024-09-12T12:26:30.801 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "last_failure_osd_epoch": 80, 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: "active_clients": [ 2024-09-12T12:26:30.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 4124651781 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "libcephsqlite", 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:30.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 279537069 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1732076892 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 586542353 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-12T12:26:30.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3267327692 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-09-12T12:26:30.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3923730164 2024-09-12T12:26:30.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:30.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-12T12:26:30.807 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:26:30.808 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:29 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3666383650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:26:30.808 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:29 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1728900429' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:26:30.808 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:29 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3756919851' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:26:30.809 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:29 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3666383650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:26:30.809 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:29 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1728900429' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:26:30.809 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:29 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3756919851' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:26:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fe9340a2d00 msgr2=0x7fe9340a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fe9340a2d00 0x7fe9340a51c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005e10 tx=0x7fe93c005da0 comp rx=0 tx=0).stop 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 msgr2=0x7fe94c1013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 0x7fe94c1013c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe94400eaa0 tx=0x7fe94400ef60 comp rx=0 tx=0).stop 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 shutdown_connections 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fe9340a2d00 0x7fe9340a51c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe94c10c080 0x7fe94c1013c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe94c103610 0x7fe94c100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 --2- 172.21.15.81:0/3756919851 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe94c102cf0 0x7fe94c100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 >> 172.21.15.81:0/3756919851 conn(0x7fe94c0fc6c0 msgr2=0x7fe94c0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 shutdown_connections 2024-09-12T12:26:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:29.445+0000 7fe951e23640 1 -- 172.21.15.81:0/3756919851 wait complete. 2024-09-12T12:26:30.816 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T12:26:30.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T12:26:30.817 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:29 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3666383650' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T12:26:30.817 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:29 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1728900429' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T12:26:30.817 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:29 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3756919851' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T12:26:31.073 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:31.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:30 smithi081 ceph-mon[30948]: pgmap v313: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:31.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:30 smithi173 ceph-mon[35326]: pgmap v313: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:31.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:30 smithi103 ceph-mon[35094]: pgmap v313: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:31.537 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:26:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1834, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1836, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 5933303, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 583213, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.153625468, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.053406281, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.040468237, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.046036743, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1834, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.066187489, 2024-09-12T12:26:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000036089 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 436, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 401, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 10055816, 2024-09-12T12:26:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 183296, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.062290448, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.020003726, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.046976470, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.005477448, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 401, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.023191603, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000057834 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1620096, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 124080 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 50, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 198, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 4207030, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 443696, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-09-12T12:26:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.017370274, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009420990, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.004830888, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000922345, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 195, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.014145668, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000072541 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T12:26:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 428432 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3485, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.083310146, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000023905 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 2908, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 2908, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 2908, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-09-12T12:26:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-12T12:26:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-12T12:26:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-12T12:26:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 8008, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 11, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-12T12:26:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 22182721, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 22180633, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 8008 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-12T12:26:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 567, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 2827, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 2260, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 83, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 189, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 106, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 2908, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 4416, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 1508, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 55876, 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215328 2024-09-12T12:26:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-12T12:26:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 2, 2024-09-12T12:26:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 3, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 1, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 2, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2615, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T12:26:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 229196, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 680, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 175, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 3539159, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 38783, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-12T12:26:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2068, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2068, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2068, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.061978842, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000513529 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2068, 2024-09-12T12:26:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2069 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2068, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2068, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1313, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 753, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-12T12:26:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-12T12:26:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-12T12:26:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 88, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 7, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 7, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-12T12:26:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:26:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2316, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 19972205, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2316, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2316, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 19972205, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2068, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 17991047, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2068, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 17991047, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2068, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2068, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2068, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2068, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x55c8d863cb40": { 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:31.583 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:26:32.496 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-12T12:26:32.497 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-12T12:26:32.497 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-12T12:26:32.497 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-12T12:26:32.497 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-12T12:26:32.497 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:32.497 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:32.497 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T12:26:32.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T12:26:32.745 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:33.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:32 smithi081 ceph-mon[30948]: pgmap v314: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:33.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:32 smithi173 ceph-mon[35326]: pgmap v314: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:33.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:32 smithi103 ceph-mon[35094]: pgmap v314: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:33.216 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:26:33.216 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 212, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 202, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1440352, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 124064, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.039772973, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.015011703, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.035655033, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 201, 2024-09-12T12:26:33.217 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.011888085, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000059144 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1440352, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 6, 2024-09-12T12:26:33.218 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 157, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3344, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 184960, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.014733688, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.008928134, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.003779356, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 155, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.018191048, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000117361 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:33.219 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 184960 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.000285184, 2024-09-12T12:26:33.220 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000218401, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:26:33.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:33.222 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:33.223 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:33.224 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148977, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 30, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:33.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 214, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1410479, 2024-09-12T12:26:33.226 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 214, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 214, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1410479, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:33.227 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T12:26:33.946 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T12:26:33.946 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T12:26:33.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T12:26:34.191 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 1159, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1159, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 350729, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 367739, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 6, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 2, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.118164334, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.046756705, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.026711992, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.033898623, 2024-09-12T12:26:34.759 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1158, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.047717040, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000041206 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.760 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 917, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 1067, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 11644529, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 721427, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 7, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 5, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.080698982, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.027634211, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.026415319, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.019600767, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 1064, 2024-09-12T12:26:34.761 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.036964230, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000034740 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 430400 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 250, 2024-09-12T12:26:34.762 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 217, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1618692, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 125237, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.039352369, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.014259987, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.038176095, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000067911, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 216, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.013501115, 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000062505 2024-09-12T12:26:34.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1617344, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 124272 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 1, 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T12:26:34.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-MDSRank": { 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3517, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.080660108, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000022934 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "queue_len": 0, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "complete_latency": { 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.765 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": { 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "request": 0, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "reply": 0, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "reply_latency": { 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_reply": 0, 2024-09-12T12:26:34.766 INFO:teuthology.orchestra.run.smithi081.stdout: "forward": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_commit": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_split": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_merge": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes": 2317, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_top": 0, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_bottom": 2317, 2024-09-12T12:26:34.767 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pin_tail": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_pinned": 2317, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_expired": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "subtrees": 1, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_hit": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_forward": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_discover": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:34.768 INFO:teuthology.orchestra.run.smithi081.stdout: "traverse_lock": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "load_cent": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "q": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "exported": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "exported_inodes": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "imported": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "imported_inodes": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rfiles": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rbytes": 0, 2024-09-12T12:26:34.769 INFO:teuthology.orchestra.run.smithi081.stdout: "root_rsnaps": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:34.770 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_cap_release": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "process_request_cap_release": 0 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache": { 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_update_receipt": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_try_discover": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_send_discover": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "dir_handle_discover": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:34.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_created": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_enqueued": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "strays_migrated": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_started": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_completed": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_exportdir": 0, 2024-09-12T12:26:34.772 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_flush": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ireq_inodestats": 0 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log": { 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "evlrg": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "evadd": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "evex": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "evtrm": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ev": 5439, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "evexg": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "evexd": 0, 2024-09-12T12:26:34.773 INFO:teuthology.orchestra.run.smithi081.stdout: "segadd": 0, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "segex": 0, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "segtrm": 0, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "seg": 8, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "segmjr": 2, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "segexg": 0, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "segexd": 0, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "expos": 4194304, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "wrpos": 15601727, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "rdpos": 15599639, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "jlat": { 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.777 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "replayed": 5439 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mem": { 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 438, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "ino+": 2709, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "ino-": 2271, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "dir": 55, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "dir+": 179, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "dir-": 124, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "dn": 2317, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "dn+": 4400, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "dn-": 2083, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "cap": 0, 2024-09-12T12:26:34.778 INFO:teuthology.orchestra.run.smithi081.stdout: "cap+": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "cap-": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "rss": 52944, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "heap": 215328 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_server": { 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_client_request": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "dispatch_server_request": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_request": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_client_session": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "handle_peer_request": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "req_create_latency": { 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getattr_latency": { 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "req_link_latency": { 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.780 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookup_latency": { 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupino_latency": { 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.781 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupname_latency": { 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.782 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "req_lssnap_latency": { 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mkdir_latency": { 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mknod_latency": { 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "req_mksnap_latency": { 2024-09-12T12:26:34.784 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "req_open_latency": { 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "req_readdir_latency": { 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rename_latency": { 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.786 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmdir_latency": { 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.787 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setattr_latency": { 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.788 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setlayout_latency": { 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "req_setxattr_latency": { 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "req_symlink_latency": { 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.789 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "req_unlink_latency": { 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.790 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessions": { 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "session_count": 1, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "session_add": 3, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "session_remove": 2, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_open": 2, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "sessions_stale": 0, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "total_load": 0, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "average_load": 0, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "avg_session_uptime": 2621, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:34.791 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:34.792 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T12:26:34.793 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 214806, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 524, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:34.794 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 175, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 2778277, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 35117, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter": { 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "op_active": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "op_laggy": 0, 2024-09-12T12:26:34.795 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send": 2073, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "op_send_bytes": 21, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "op_resend": 3, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "op_reply": 2073, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "op_latency": { 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2073, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 1.251975052, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000603943 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "op_inflight": 0, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "oplen_avg": { 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 2073, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 2074 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.796 INFO:teuthology.orchestra.run.smithi081.stdout: "op": 2073, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "op_r": 2073, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "op_w": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "op_rmw": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "op_pg": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_stat": 1321, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_create": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_read": 750, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_write": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writefull": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_writesame": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_append": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_zero": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_truncate": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_delete": 0, 2024-09-12T12:26:34.797 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_mapext": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_getxattr": 1, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_setxattr": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_call": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_watch": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_notify": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:34.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osdop_other": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_active": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_send": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_resend": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "linger_ping": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_active": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_send": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "poolop_resend": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_active": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_send": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "poolstat_resend": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_active": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_send": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "statfs_resend": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "command_active": 0, 2024-09-12T12:26:34.799 INFO:teuthology.orchestra.run.smithi081.stdout: "command_send": 0, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "command_resend": 0, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "map_epoch": 88, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "map_full": 0, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "map_inc": 11, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_sessions": 6, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_open": 6, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_session_close": 0, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_laggy": 0, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_wr": 0, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_rd": 2, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_del": 0 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "oft": { 2024-09-12T12:26:34.800 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_objs": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_updates": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "omap_total_removes": 0 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "osd-slow-ops": { 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "slow_ops_count": 0 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "purge_queue": { 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executing_high_water": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed_ops": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_executed": 0, 2024-09-12T12:26:34.801 INFO:teuthology.orchestra.run.smithi081.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 2322, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 13389414, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 2322, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2322, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 13389414, 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2073, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 11407428, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2073, 2024-09-12T12:26:34.803 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 11407428, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 1024, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:34.804 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 2073, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 2073, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 2073, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 2073, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-write_buf_throttle-0x559253e7cb40": { 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 3758096384, 2024-09-12T12:26:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:34.807 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:26:35.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:34 smithi081 ceph-mon[30948]: pgmap v315: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:34 smithi173 ceph-mon[35326]: pgmap v315: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:35.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:34 smithi103 ceph-mon[35094]: pgmap v315: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:35.662 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:35.662 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T12:26:35.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T12:26:36.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:35 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:36.111 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:35 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:36.112 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:35 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T12:26:36.659 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:37.046 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:36 smithi081 ceph-mon[30948]: pgmap v316: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:37.046 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:36 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.046 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:36 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.046 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:36 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.046 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:36 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:36 smithi173 ceph-mon[35326]: pgmap v316: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:37.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:36 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:36 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:36 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:36 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001065100, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000179841, 2024-09-12T12:26:37.156 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:26:37.157 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 214, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 204, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1440896, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 125344, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.037322109, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.014178431, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.033905563, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:26:37.158 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 203, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010968543, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000054032 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1440896, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 125344 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.159 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 6, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 159, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3344, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 185312, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.015863826, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009980277, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.003713288, 2024-09-12T12:26:37.160 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 157, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.020578791, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000131075 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-12T12:26:37.161 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 185312 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:37.162 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:37.163 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:37.164 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148994, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 31, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-09-12T12:26:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-09-12T12:26:37.166 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 216, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1410739, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 216, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 216, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1410739, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:37.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-12T12:26:37.168 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-12T12:26:37.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:36 smithi103 ceph-mon[35094]: pgmap v316: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:37.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:36 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:36 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:36 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:36 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:37.871 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T12:26:37.871 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T12:26:37.871 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-12T12:26:37.871 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-12T12:26:37.871 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T12:26:37.872 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T12:26:37.872 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T12:26:37.872 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T12:26:37.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-12T12:26:38.111 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:37 smithi081 ceph-mon[30948]: Unable to set osd_memory_target on smithi103 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T12:26:38.126 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:26:38.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-12T12:26:38.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:37 smithi173 ceph-mon[35326]: Unable to set osd_memory_target on smithi103 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T12:26:38.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi173 to 176.0M 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: Unable to set osd_memory_target on smithi173 to 184596070: error parsing value: Value '184596070' is below minimum 939524096 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-09-12T12:26:38.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:37 smithi103 ceph-mon[35094]: Unable to set osd_memory_target on smithi103 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-12T12:26:38.618 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 23043, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 27836, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 7660039, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 51439959, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 11, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 4, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 1.578994409, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.708431737, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.771554174, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.211070161, 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:38.619 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 27840, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 10.650403876, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000382557 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 37589, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.006305704, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000167 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 310736 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.620 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 46722, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 81626, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 17857513, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 66659912, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 19, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 7, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 3.201409397, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 1.433263625, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 11.938898438, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.313801716, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 81628, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 15.707378330, 2024-09-12T12:26:38.621 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000192426 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 103656, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.015299783, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000147 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 12700688, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 34125536 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 14120, 2024-09-12T12:26:38.622 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 15549, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 6273696, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 33650925, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 52, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 9, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 1.082203950, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.509748945, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.524655468, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.132617525, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 15538, 2024-09-12T12:26:38.623 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 3.305802337, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000212755 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 20261, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.003663644, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000180 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1794848, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 166512 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 1, 2024-09-12T12:26:38.624 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-MDSRank": { 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4047, 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 19.688152450, 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.004864875 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:38.625 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 6766, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.964295374, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000142520 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "request": 16272, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "reply": 16112, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "reply_latency": { 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 16112, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 51.824492348, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.003216515 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_reply": 0, 2024-09-12T12:26:38.626 INFO:teuthology.orchestra.run.smithi103.stdout: "forward": 160, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_complete": 8, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_commit": 1455, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_split": 17, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_merge": 4, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes": 7415, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_top": 3154, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_bottom": 4012, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pin_tail": 249, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pinned": 259, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_expired": 7398, 2024-09-12T12:26:38.627 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_with_caps": 3, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": 3, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "subtrees": 6, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse": 18910, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_hit": 17993, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_forward": 16, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_discover": 393, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_lock": 0, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "load_cent": 0, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "q": 0, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "exported": 86, 2024-09-12T12:26:38.628 INFO:teuthology.orchestra.run.smithi103.stdout: "exported_inodes": 6887, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "imported": 82, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "imported_inodes": 3528, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rfiles": 4, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rbytes": 234, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rsnaps": 6, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:38.629 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_inode_file_caps": 237, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_revoke": 3745, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_grant": 15100, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps": 14274, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps_dirty": 8874, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_cap_release": 716, 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: "process_request_cap_release": 6322 2024-09-12T12:26:38.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache": { 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update": 2301, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update_receipt": 1073, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_try_discover": 706, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_send_discover": 670, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_handle_discover": 4681, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays": 244, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_created": 4041, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_enqueued": 3797, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_migrated": 0, 2024-09-12T12:26:38.631 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_started": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_completed": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_path": 3, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_inode": 1923, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_exportdir": 87, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_flush": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragmentdir": 21, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_inodestats": 0 2024-09-12T12:26:38.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log": { 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "evlrg": 0, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "evadd": 31081, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "evex": 31004, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "evtrm": 31004, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "ev": 77, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "evexg": 0, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "evexd": 2386, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "segadd": 47, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "segex": 46, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "segtrm": 46, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "seg": 1, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "segmjr": 1, 2024-09-12T12:26:38.633 INFO:teuthology.orchestra.run.smithi103.stdout: "segexg": 0, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "segexd": 3, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "expos": 79478657, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "wrpos": 79611214, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "rdpos": 0, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "jlat": { 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2679, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 46.730692008, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.017443334 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "replayed": 0 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mem": { 2024-09-12T12:26:38.634 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 3299, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "ino+": 14114, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "ino-": 10815, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "dir": 333, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "dir+": 1167, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "dir-": 834, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "dn": 7420, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "dn+": 18615, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "dn-": 11195, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "cap": 3, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "cap+": 11105, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "cap-": 11102, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "rss": 115084, 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: "heap": 231712 2024-09-12T12:26:38.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server": { 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_client_request": 19524, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_server_request": 2712, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_request": 16272, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_session": 113, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_peer_request": 5995, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "req_create_latency": { 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 9197, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 14.772566874, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001606237 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getattr_latency": { 2024-09-12T12:26:38.636 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 171, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.260818619, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001525255 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "req_link_latency": { 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.637 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookup_latency": { 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1267, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 10.186249822, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.008039660 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupino_latency": { 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000198686, 2024-09-12T12:26:38.638 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000198686 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupname_latency": { 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.639 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lssnap_latency": { 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 10, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.001466961, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000146696 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mkdir_latency": { 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 623, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.444264561, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000713105 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.640 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mknod_latency": { 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mksnap_latency": { 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 10, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.582039647, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.058203964 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "req_open_latency": { 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000191919, 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000191919 2024-09-12T12:26:38.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "req_readdir_latency": { 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 774, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 1.383243083, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001787135 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rename_latency": { 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.002051937, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001025968 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.642 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmdir_latency": { 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 310, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 5.179881033, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.016709293 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.020166476, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.005041619 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setattr_latency": { 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 13.079084901, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 3.269771225 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.644 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setlayout_latency": { 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.645 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setxattr_latency": { 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 7, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.018531203, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.002647314 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "req_symlink_latency": { 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "req_unlink_latency": { 2024-09-12T12:26:38.646 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3731, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 5.893736626, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001579666 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessions": { 2024-09-12T12:26:38.647 INFO:teuthology.orchestra.run.smithi103.stdout: "session_count": 2, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "session_add": 5, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "session_remove": 3, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_open": 2, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_stale": 0, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "total_load": 119, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "average_load": 59, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "avg_session_uptime": 593, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 360, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 360, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:38.648 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:38.649 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:38.650 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 2363293, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 3849, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:38.651 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 175, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 13754312, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 210936, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-12T12:26:38.652 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter": { 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_active": 0, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_laggy": 0, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send": 17999, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send_bytes": 92711131, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_resend": 36, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_reply": 17999, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_latency": { 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 17999, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 1639.704277296, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.091099743 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "op_inflight": 0, 2024-09-12T12:26:38.653 INFO:teuthology.orchestra.run.smithi103.stdout: "oplen_avg": { 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 17999, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 38734 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "op": 17999, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "op_r": 75, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "op_w": 17924, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "op_rmw": 0, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "op_pg": 0, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_stat": 803, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_create": 9094, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_read": 67, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_write": 2746, 2024-09-12T12:26:38.654 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writefull": 105, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writesame": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_append": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_zero": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_truncate": 17, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_delete": 4401, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_mapext": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_getxattr": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_setxattr": 18188, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:38.655 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_call": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_watch": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_notify": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_other": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_active": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_send": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_resend": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_ping": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_active": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_send": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_resend": 0, 2024-09-12T12:26:38.656 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_active": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_send": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_resend": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_active": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_send": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_resend": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "command_active": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "command_send": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "command_resend": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "map_epoch": 88, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "map_full": 0, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "map_inc": 11, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_sessions": 12, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_open": 12, 2024-09-12T12:26:38.657 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_close": 0, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_laggy": 0, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_wr": 2910, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_rd": 16, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_del": 387 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "oft": { 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_objs": 1, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_updates": 0, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_removes": 0 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "osd-slow-ops": { 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_ops_count": 1927 2024-09-12T12:26:38.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.659 INFO:teuthology.orchestra.run.smithi103.stdout: "purge_queue": { 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops_high_water": 20, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing": 0, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_high_water": 6, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed_ops": 3829, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed": 3797, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:38.660 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 83881, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 22545714, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 83881, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 83881, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 22545714, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.661 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:38.662 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 17999, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 93111220, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 17999, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 93111220, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:38.663 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 1024, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 17999, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 17999, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 17999, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 17999, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.664 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 3797, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 400217, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 3797, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 67, 2024-09-12T12:26:38.665 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 400217, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle-0x55ce3cf44960": { 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 31081, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 75416910, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:38.666 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 31081, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 2679, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 75416910, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:38.667 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T12:26:39.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: pgmap v317: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:39.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.185 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: Unable to set osd_memory_target on smithi081 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:39.186 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:38 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: pgmap v317: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T12:26:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: Unable to set osd_memory_target on smithi081 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:26:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:39.361 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:38 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: pgmap v317: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:39.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: Adjusting osd_memory_target on smithi081 to 176.0M 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: Unable to set osd_memory_target on smithi081 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T12:26:39.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:38 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds.exported=86 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds.imported=82 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2301 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=1073 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-12T12:26:39.519 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-12T12:26:39.519 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T12:26:39.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T12:26:39.776 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:26:40.255 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T12:26:40.255 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 3720, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 3454, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1634487, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 9493431, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 16, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.274087274, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.129086329, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.133218783, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.026465143, 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:40.256 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3452, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.153254514, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000044395 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 5240, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000922166, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000175 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 308752 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 4966, 2024-09-12T12:26:40.257 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 5242, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1790229, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 4870101, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 13, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 10, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.283965476, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.114448725, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.163766244, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.026761694, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 5239, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.232864208, 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000044448 2024-09-12T12:26:40.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 7873, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.001345739, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000170 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 128944 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 18312, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 23578, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 10167442, 2024-09-12T12:26:40.259 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 14787134, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 11, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 6, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 1.221741751, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.580493428, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.789199784, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.035773422, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 23578, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 1.053921180, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000044699 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:40.260 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 35713, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.006731172, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000188 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 4055824, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 7093040 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 1, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-MDSRank": { 2024-09-12T12:26:40.261 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1019, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 3.383213111, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.003320130 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3321, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.327444974, 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000098598 2024-09-12T12:26:40.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "request": 3326, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "reply": 3259, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "reply_latency": { 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3259, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 4.826297251, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001480913 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_reply": 0, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "forward": 67, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:40.263 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_commit": 20, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_split": 1, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_merge": 0, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes": 1006, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_top": 1, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_bottom": 1, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pin_tail": 1004, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pinned": 1004, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_expired": 2039, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": 0, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "subtrees": 2, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse": 6873, 2024-09-12T12:26:40.264 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_hit": 4991, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_forward": 53, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_discover": 786, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_lock": 0, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "load_cent": 0, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "q": 0, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "exported": 19, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "exported_inodes": 884, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "imported": 19, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "imported_inodes": 1680, 2024-09-12T12:26:40.265 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rfiles": 2774, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rbytes": 17430556, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rsnaps": 2, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:40.266 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_inode_file_caps": 2, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_revoke": 1377, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_grant": 2923, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps": 2725, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps_dirty": 1673, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_cap_release": 26, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "process_request_cap_release": 2883 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache": { 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update": 266, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update_receipt": 2404, 2024-09-12T12:26:40.267 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_try_discover": 1589, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_send_discover": 1562, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_handle_discover": 477, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays": 65, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_created": 1892, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_enqueued": 1827, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_migrated": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_started": 0, 2024-09-12T12:26:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_completed": 0, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_path": 3, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_inode": 1226, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_exportdir": 20, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_flush": 0, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragmentdir": 1, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_inodestats": 0 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log": { 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "evlrg": 0, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "evadd": 8008, 2024-09-12T12:26:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: "evex": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "evtrm": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "ev": 8008, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "evexg": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "evexd": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "segadd": 11, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "segex": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "segtrm": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "seg": 11, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "segmjr": 2, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "segexg": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "segexd": 0, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "expos": 4194304, 2024-09-12T12:26:40.270 INFO:teuthology.orchestra.run.smithi103.stdout: "wrpos": 22182721, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "rdpos": 0, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "jlat": { 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 767, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 47.194608743, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.061531432 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "replayed": 0 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mem": { 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 496, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "ino+": 3414, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "ino-": 2918, 2024-09-12T12:26:40.271 INFO:teuthology.orchestra.run.smithi103.stdout: "dir": 92, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "dir+": 946, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "dir-": 854, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "dn": 1006, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "dn+": 5419, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "dn-": 4413, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "cap": 0, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "cap+": 1985, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "cap-": 1985, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "rss": 77736, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "heap": 223520 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.272 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server": { 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_client_request": 4914, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_server_request": 81, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_request": 3326, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_session": 19, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_peer_request": 1090, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "req_create_latency": { 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 409, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.481971257, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001178413 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getattr_latency": { 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.273 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "req_link_latency": { 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookup_latency": { 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 833, 2024-09-12T12:26:40.274 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.253613813, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000304458 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupino_latency": { 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.275 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupname_latency": { 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.277 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lssnap_latency": { 2024-09-12T12:26:40.277 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.277 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.277 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mkdir_latency": { 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mknod_latency": { 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mksnap_latency": { 2024-09-12T12:26:40.278 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "req_open_latency": { 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "req_readdir_latency": { 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 125, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.125943856, 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001007550 2024-09-12T12:26:40.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rename_latency": { 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:40.280 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmdir_latency": { 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 98, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 1.447036919, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.014765682 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.281 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setattr_latency": { 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setlayout_latency": { 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setxattr_latency": { 2024-09-12T12:26:40.283 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "req_symlink_latency": { 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "req_unlink_latency": { 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1794, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 2.517731406, 2024-09-12T12:26:40.284 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001403417 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessions": { 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "session_count": 2, 2024-09-12T12:26:40.285 INFO:teuthology.orchestra.run.smithi103.stdout: "session_add": 3, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "session_remove": 1, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_open": 2, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_stale": 0, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "total_load": 1829, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "average_load": 914, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "avg_session_uptime": 576, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:40.286 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:40.287 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:40.288 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 843161, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 733, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:40.289 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:40.290 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:40.290 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:40.290 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:40.292 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 175, 2024-09-12T12:26:40.292 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:40.292 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:40.292 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:40.292 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 2092146, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 33773, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter": { 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "op_active": 0, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "op_laggy": 0, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send": 2822, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send_bytes": 18535884, 2024-09-12T12:26:40.293 INFO:teuthology.orchestra.run.smithi103.stdout: "op_resend": 33, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "op_reply": 2822, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "op_latency": { 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2822, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 48.143068499, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.017059910 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "op_inflight": 0, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "oplen_avg": { 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2822, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 2905 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "op": 2822, 2024-09-12T12:26:40.294 INFO:teuthology.orchestra.run.smithi103.stdout: "op_r": 52, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "op_w": 2770, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "op_rmw": 0, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "op_pg": 0, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_stat": 0, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_create": 10, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_read": 52, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_write": 819, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writefull": 37, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writesame": 0, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_append": 0, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_zero": 0, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_truncate": 1, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_delete": 1843, 2024-09-12T12:26:40.295 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_mapext": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_getxattr": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_setxattr": 20, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_call": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_watch": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_notify": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls": 0, 2024-09-12T12:26:40.296 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_other": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_active": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_send": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_resend": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_ping": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_active": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_send": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_resend": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_active": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_send": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_resend": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_active": 0, 2024-09-12T12:26:40.297 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_send": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_resend": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "command_active": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "command_send": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "command_resend": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "map_epoch": 88, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "map_full": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "map_inc": 11, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_sessions": 12, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_open": 12, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_close": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_laggy": 0, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_wr": 98, 2024-09-12T12:26:40.298 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_rd": 0, 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_del": 25 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: "oft": { 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_objs": 1, 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_updates": 0, 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_removes": 0 2024-09-12T12:26:40.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "osd-slow-ops": { 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_ops_count": 1229 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "purge_queue": { 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing": 0, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_high_water": 6, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed_ops": 1827, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed": 1827, 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:40.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 26994, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 10847181, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 26994, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 26994, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 10847181, 2024-09-12T12:26:40.301 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:40.302 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 2822, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 18726611, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 2822, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 18726611, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 1024, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:40.303 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 2822, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 2822, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 2822, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 2822, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 1827, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 190727, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 1827, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 52, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 190727, 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle-0x55742f70e960": { 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 8008, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 17988417, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 8008, 2024-09-12T12:26:40.306 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 767, 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 17988417, 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:40.307 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds.exported=19 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds.imported=19 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=266 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=2404 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=2 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:40.976 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:40.977 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T12:26:40.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T12:26:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:26:41.344 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:40 smithi103 ceph-mon[35094]: pgmap v318: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:41.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:40 smithi081 ceph-mon[30948]: pgmap v318: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:41.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:40 smithi173 ceph-mon[35326]: pgmap v318: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 22560, 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 27565, 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 10274762, 2024-09-12T12:26:41.821 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 27060764, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 11, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 5, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 1.434730800, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.677852106, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.896537956, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.047658929, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 27564, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 1.105177954, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000040094 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:41.822 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 42277, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.007089273, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000167 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2910048, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 8174624 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2751, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 3394, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 865192, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 2211219, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 15, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 8, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.194732071, 2024-09-12T12:26:41.823 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.083016207, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.091663122, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.021408773, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3391, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.113525150, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000033478 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4002, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000757565, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000189 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2832, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 438192 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 3746, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 4116, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 2981522, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 5674447, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 15, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 9, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.309987044, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.138474374, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.172051532, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.025711114, 2024-09-12T12:26:41.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4115, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.163265439, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000039675 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 5271, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000950369, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000180 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1648032, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 137824 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-12T12:26:41.826 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 1, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-MDSRank": { 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2036, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 4.724094477, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.002320282 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:41.827 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3438, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.398206712, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000115825 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "request": 3824, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "reply": 3763, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "reply_latency": { 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3763, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 5.952143616, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001581754 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_reply": 0, 2024-09-12T12:26:41.828 INFO:teuthology.orchestra.run.smithi103.stdout: "forward": 59, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_commit": 11, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_split": 0, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_merge": 0, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes": 2306, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_top": 0, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_bottom": 1, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pin_tail": 2305, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pinned": 2305, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_expired": 1880, 2024-09-12T12:26:41.829 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": 0, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "subtrees": 2, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse": 7200, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_hit": 5685, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_forward": 44, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_discover": 738, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_lock": 1, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "load_cent": 0, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "q": 0, 2024-09-12T12:26:41.830 INFO:teuthology.orchestra.run.smithi103.stdout: "exported": 19, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "exported_inodes": 874, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "imported": 19, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "imported_inodes": 1789, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rfiles": 2774, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rbytes": 17430556, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rsnaps": 2, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:41.831 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_inode_file_caps": 12, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_revoke": 2227, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_grant": 2923, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:41.832 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps": 3489, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps_dirty": 1751, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_cap_release": 31, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "process_request_cap_release": 2743 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache": { 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update": 392, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update_receipt": 2225, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_try_discover": 1478, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_send_discover": 1424, 2024-09-12T12:26:41.833 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_handle_discover": 667, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays": 85, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_created": 2009, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_enqueued": 1924, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_migrated": 0, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:41.834 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_started": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_completed": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_path": 3, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_inode": 1926, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_exportdir": 19, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_flush": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_inodestats": 0 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log": { 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "evlrg": 0, 2024-09-12T12:26:41.835 INFO:teuthology.orchestra.run.smithi103.stdout: "evadd": 8781, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "evex": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "evtrm": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "ev": 8781, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "evexg": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "evexd": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "segadd": 13, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "segex": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "segtrm": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "seg": 13, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "segmjr": 2, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "segexg": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "segexd": 0, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "expos": 4194304, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "wrpos": 25601372, 2024-09-12T12:26:41.836 INFO:teuthology.orchestra.run.smithi103.stdout: "rdpos": 0, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "jlat": { 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1394, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 8.525417484, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.006115794 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "replayed": 0 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mem": { 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1191, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "ino+": 4067, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "ino-": 2876, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "dir": 118, 2024-09-12T12:26:41.837 INFO:teuthology.orchestra.run.smithi103.stdout: "dir+": 871, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "dir-": 753, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "dn": 2306, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "dn+": 6110, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "dn-": 3804, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "cap": 0, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "cap+": 2673, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "cap-": 2673, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "rss": 78868, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "heap": 223520 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server": { 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_client_request": 5061, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_server_request": 92, 2024-09-12T12:26:41.838 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_request": 3824, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_session": 24, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_peer_request": 781, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "req_create_latency": { 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 502, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.555646926, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001106866 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getattr_latency": { 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000199504, 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000199504 2024-09-12T12:26:41.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "req_link_latency": { 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookup_latency": { 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1090, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.946872589, 2024-09-12T12:26:41.840 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000868690 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupino_latency": { 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupname_latency": { 2024-09-12T12:26:41.841 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.842 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lssnap_latency": { 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mkdir_latency": { 2024-09-12T12:26:41.843 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mknod_latency": { 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mksnap_latency": { 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "req_open_latency": { 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "req_readdir_latency": { 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 161, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.158557967, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000984832 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rename_latency": { 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmdir_latency": { 2024-09-12T12:26:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 85, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 1.680354398, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.019768875 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setattr_latency": { 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setlayout_latency": { 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setxattr_latency": { 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "req_symlink_latency": { 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "req_unlink_latency": { 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1924, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 2.610512232, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001356815 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessions": { 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "session_count": 2, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "session_add": 4, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "session_remove": 2, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_open": 2, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_stale": 0, 2024-09-12T12:26:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "total_load": 2406, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "average_load": 1203, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "avg_session_uptime": 587, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 1005438, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 1470, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-12T12:26:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 175, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 4688447, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 72578, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter": { 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_active": 0, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_laggy": 0, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send": 3500, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send_bytes": 21806445, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_resend": 33, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_reply": 3500, 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "op_latency": { 2024-09-12T12:26:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3500, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 9.854809298, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.002815659 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "op_inflight": 0, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "oplen_avg": { 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3500, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 3582 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "op": 3500, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "op_r": 34, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "op_w": 3466, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "op_rmw": 0, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "op_pg": 0, 2024-09-12T12:26:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_stat": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_create": 10, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_read": 34, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_write": 1428, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writefull": 30, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writesame": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_append": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_zero": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_truncate": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_delete": 1941, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_mapext": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_getxattr": 0, 2024-09-12T12:26:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_setxattr": 20, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_call": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_watch": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_notify": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_other": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_active": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_send": 0, 2024-09-12T12:26:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_resend": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_ping": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_active": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_send": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_resend": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_active": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_send": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_resend": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_active": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_send": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_resend": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "command_active": 0, 2024-09-12T12:26:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "command_send": 0, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "command_resend": 0, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "map_epoch": 88, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "map_full": 0, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "map_inc": 11, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_sessions": 12, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_open": 12, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_close": 0, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_laggy": 0, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_wr": 90, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_rd": 0, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_del": 29 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "oft": { 2024-09-12T12:26:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_objs": 1, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_updates": 0, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_removes": 0 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "osd-slow-ops": { 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_ops_count": 1929 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "purge_queue": { 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing": 0, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_high_water": 6, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed_ops": 1924, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed": 1924, 2024-09-12T12:26:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 29053, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 11126085, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 29053, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 29053, 2024-09-12T12:26:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 11126085, 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 3500, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 22011809, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 3500, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 22011809, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 1024, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 3500, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 3500, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 3500, 2024-09-12T12:26:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 3500, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 1924, 2024-09-12T12:26:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 205364, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 1924, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 34, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 205364, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle-0x5633a6802960": { 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 8781, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 21407068, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 8781, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 1394, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 21407068, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:41.871 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds.exported=19 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds.imported=19 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=392 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2225 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=2 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:42.628 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:42.628 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T12:26:42.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T12:26:42.874 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T12:26:43.263 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:42 smithi103 ceph-mon[35094]: pgmap v319: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:43.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:42 smithi081 ceph-mon[30948]: pgmap v319: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:43.365 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T12:26:43.365 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 970, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 937, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1859760, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 356762, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.120386565, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.046713832, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.057598755, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.021340148, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 936, 2024-09-12T12:26:43.366 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.054790164, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000058536 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1619520, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 129392 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 494, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 650, 2024-09-12T12:26:43.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 4316424, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 589590, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 7, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 5, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.055625114, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.019639483, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.015295498, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.015642215, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 647, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.027263445, 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000042138 2024-09-12T12:26:43.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 433072 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 918, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 918, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 17453365, 2024-09-12T12:26:43.369 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 291107, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 4, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.078131120, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.021453308, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.030138815, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.021127631, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 917, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.030547109, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000033312 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:43.370 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 1, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-MDSRank": { 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:43.371 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3543, 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.087061434, 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000024572 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "request": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "reply": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "reply_latency": { 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_reply": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "forward": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_commit": 0, 2024-09-12T12:26:43.373 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_split": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_merge": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes": 4228, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_top": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_bottom": 4228, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pin_tail": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pinned": 4228, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_expired": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "subtrees": 1, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_hit": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_forward": 0, 2024-09-12T12:26:43.374 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_discover": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_lock": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "load_cent": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "q": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "exported": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "exported_inodes": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "imported": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "imported_inodes": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rfiles": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rbytes": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rsnaps": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:26:43.376 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_cap_release": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "process_request_cap_release": 0 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache": { 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update_receipt": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_try_discover": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_send_discover": 0, 2024-09-12T12:26:43.377 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_handle_discover": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_created": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_enqueued": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_migrated": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_started": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_completed": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:26:43.378 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_exportdir": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_flush": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_inodestats": 0 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log": { 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "evlrg": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "evadd": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "evex": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "evtrm": 0, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ev": 8781, 2024-09-12T12:26:43.379 INFO:teuthology.orchestra.run.smithi103.stdout: "evexg": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "evexd": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "segadd": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "segex": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "segtrm": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "seg": 13, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "segmjr": 2, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "segexg": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "segexd": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "expos": 4194304, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "wrpos": 25601372, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "rdpos": 25599284, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "jlat": { 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.380 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "replayed": 8781 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mem": { 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1185, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "ino+": 3514, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "ino-": 2329, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "dir": 109, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "dir+": 163, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "dir-": 54, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "dn": 4228, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "dn+": 5159, 2024-09-12T12:26:43.381 INFO:teuthology.orchestra.run.smithi103.stdout: "dn-": 931, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "cap": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "cap+": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "cap-": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "rss": 60576, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "heap": 215328 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server": { 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_client_request": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_server_request": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_request": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_session": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_peer_request": 0, 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "req_create_latency": { 2024-09-12T12:26:43.382 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getattr_latency": { 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.383 INFO:teuthology.orchestra.run.smithi103.stdout: "req_link_latency": { 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookup_latency": { 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.384 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupino_latency": { 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupname_latency": { 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.385 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lssnap_latency": { 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.386 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mkdir_latency": { 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mknod_latency": { 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.387 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mksnap_latency": { 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "req_open_latency": { 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "req_readdir_latency": { 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.388 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rename_latency": { 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:43.389 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmdir_latency": { 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:43.390 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setattr_latency": { 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.391 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setlayout_latency": { 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setxattr_latency": { 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.392 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "req_symlink_latency": { 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "req_unlink_latency": { 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:43.393 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessions": { 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "session_count": 2, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "session_add": 4, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "session_remove": 2, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_open": 3, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_stale": 0, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "total_load": 0, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "average_load": 0, 2024-09-12T12:26:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: "avg_session_uptime": 2478, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:43.395 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:43.396 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:43.397 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 244803, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 1315, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:43.398 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 175, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 5942407, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 71690, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter": { 2024-09-12T12:26:43.399 INFO:teuthology.orchestra.run.smithi103.stdout: "op_active": 0, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_laggy": 0, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send": 2121, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send_bytes": 21, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_resend": 3, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_reply": 2121, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_latency": { 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2121, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.865983202, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000408290 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "op_inflight": 0, 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "oplen_avg": { 2024-09-12T12:26:43.400 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2121, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 2122 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "op": 2121, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "op_r": 2121, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "op_w": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "op_rmw": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "op_pg": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_stat": 1347, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_create": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_read": 772, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_write": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writefull": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writesame": 0, 2024-09-12T12:26:43.401 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_append": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_zero": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_truncate": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_delete": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_mapext": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_getxattr": 1, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_setxattr": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_call": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_watch": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_notify": 0, 2024-09-12T12:26:43.402 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_other": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_active": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_send": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_resend": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_ping": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_active": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_send": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_resend": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_active": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_send": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_resend": 0, 2024-09-12T12:26:43.403 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_active": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_send": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_resend": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "command_active": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "command_send": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "command_resend": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "map_epoch": 88, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "map_full": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "map_inc": 11, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_sessions": 6, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_open": 6, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_close": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_laggy": 0, 2024-09-12T12:26:43.404 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_wr": 0, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_rd": 2, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_del": 0 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "oft": { 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_objs": 0, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_updates": 0, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_removes": 0 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "osd-slow-ops": { 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_ops_count": 0 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "purge_queue": { 2024-09-12T12:26:43.405 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_high_water": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed_ops": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 2378, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 23399557, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 2378, 2024-09-12T12:26:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 2378, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 23399557, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:43.407 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 2121, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 21407577, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 2121, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 21407577, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 1024, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 2121, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 2121, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 2121, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 2121, 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:43.409 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:43.410 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 0, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 0, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle-0x5572f6158b40": { 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-09-12T12:26:43.411 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-12T12:26:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-12T12:26:43.413 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-12T12:26:43.413 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.413 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T12:26:43.413 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T12:26:43.413 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:42 smithi173 ceph-mon[35326]: pgmap v319: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:44.147 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:44.147 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T12:26:44.148 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T12:26:44.408 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:26:44.903 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T12:26:44.903 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:44.903 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 15750, 2024-09-12T12:26:44.903 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 15217, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 8220683, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 9450460, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 10, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.765988369, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.322011204, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.520943704, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.021969997, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 15218, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.432464761, 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000028417 2024-09-12T12:26:44.904 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28860, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.004245923, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000147 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 5195, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 10103, 2024-09-12T12:26:44.905 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 1893257, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 5858995, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 18, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.362215503, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.166739405, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.199007858, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.023724036, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10098, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.308268524, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000030527 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:44.906 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 10648, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001613775, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000151 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1672976, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 5455408 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 3155, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2759, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 2800358, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 8522643, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 12, 2024-09-12T12:26:44.907 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.216847775, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.094473686, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.134561436, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.016620421, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2758, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.095224846, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000034526 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4003, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000547618, 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000136 2024-09-12T12:26:44.908 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1630512, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 442704 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 822, 2024-09-12T12:26:44.909 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.539637079, 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001873037 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2708, 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.209031923, 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000077190 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T12:26:44.910 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 2768, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 2766, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2766, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 27.829825841, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.010061397 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 2, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 11, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T12:26:44.911 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 840, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 7, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 7, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 826, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 829, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 2592, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 1, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 1, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 6, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 7191, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 4798, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 2, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 904, 2024-09-12T12:26:44.912 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 42, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 1475, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 44, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 2276, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:44.913 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 2774, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 17430556, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 2, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 6, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 828, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 1745, 2024-09-12T12:26:44.914 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 1493, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 741, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 41, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 2733 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 227, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 2577, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 1731, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 1620, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 325, 2024-09-12T12:26:44.915 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 40, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 1534, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 1494, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 3, 2024-09-12T12:26:44.916 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 1021, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 42, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 5439, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T12:26:44.917 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 5439, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 8, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 8, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 15601727, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 401, 2024-09-12T12:26:44.918 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.938154551, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002339537 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 459, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 3363, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 2904, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 79, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 988, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 909, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 840, 2024-09-12T12:26:44.919 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 5406, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 4566, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 1, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 1650, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 1649, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 71704, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 4929, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 130, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 2768, 2024-09-12T12:26:44.920 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 17, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 1470, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 25, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.050791581, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002031663 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000241745, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000241745 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:44.921 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1120, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.305308237, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000272596 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.922 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000233590, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000233590 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.923 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.924 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.925 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.926 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 85, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.066906455, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000787134 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.927 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 49, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.717495360, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.014642762 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:44.928 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.929 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.930 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T12:26:44.931 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1485, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 26.688848873, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.017972288 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T12:26:44.932 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 2, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 1821, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 1821, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 617, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:44.933 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:44.934 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:44.935 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 648632, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 631, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T12:26:44.936 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 175, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 1871258, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 33181, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T12:26:44.937 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 2101, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 11663406, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 28, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 2101, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2101, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 5.764870466, 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.002743869 2024-09-12T12:26:44.938 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2101, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2164 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 2101, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 52, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 2049, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 52, 2024-09-12T12:26:44.939 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 453, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 35, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 1508, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:44.940 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T12:26:44.941 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 88, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 11, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-12T12:26:44.942 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 65, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 21 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T12:26:44.943 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 1025 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 6, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 1494, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 1494, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:44.944 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 24096, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 10525659, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 24096, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 24096, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 10525659, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.945 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 2101, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 11817972, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2101, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 11817972, 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:44.946 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 2101, 2024-09-12T12:26:44.947 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 2101, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2101, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 2101, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1494, 2024-09-12T12:26:44.948 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 154566, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1494, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 52, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 154566, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x561453196960": { 2024-09-12T12:26:44.949 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 5439, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 11407423, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 5439, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 401, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 11407423, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:44.950 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.951 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:44.951 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T12:26:45.070 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:44 smithi173 ceph-mon[35326]: pgmap v320: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:26:45.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:44 smithi081 ceph-mon[30948]: pgmap v320: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:26:45.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:44 smithi103 ceph-mon[35094]: pgmap v320: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:26:45.842 INFO:tasks.check_counter:Daemon mds.c mds.exported=42 2024-09-12T12:26:45.842 INFO:tasks.check_counter:Daemon mds.c mds.imported=44 2024-09-12T12:26:45.842 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=227 2024-09-12T12:26:45.843 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2577 2024-09-12T12:26:45.843 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=2 2024-09-12T12:26:45.843 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:45.843 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:45.843 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T12:26:45.843 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T12:26:46.096 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1437, 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1439, 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 25592428, 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 456976, 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 8, 2024-09-12T12:26:46.702 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.156157824, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.044170350, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.050968961, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.046849989, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1437, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.062576471, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000043546 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 160, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 315, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 25209586, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 486438, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 8, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.037307837, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.009496034, 2024-09-12T12:26:46.704 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.021305169, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.003733234, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 312, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.023999839, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000076922 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 436128 2024-09-12T12:26:46.705 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 991, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 956, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 26895843, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 361815, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 5, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.123854872, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.043076979, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.071029538, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.017847689, 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:46.706 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 956, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.048714747, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000050956 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1622160, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 128720 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T12:26:46.707 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3834, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.196090418, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000051145 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:46.708 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.709 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 11077, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 4990, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 6087, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 258, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-12T12:26:46.710 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-12T12:26:46.711 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 4, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 234, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 6, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:46.712 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.713 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T12:26:46.714 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T12:26:46.715 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 31081, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 4, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 15, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 79478657, 2024-09-12T12:26:46.716 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 79611214, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 79611102, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 31081 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 3293, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 13771, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 10478, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 302, 2024-09-12T12:26:46.717 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 776, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 474, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 11077, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 18216, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 7139, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 73844, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215328 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-12T12:26:46.718 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:46.719 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.720 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.721 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T12:26:46.722 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.723 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.724 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:46.725 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.726 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.727 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.728 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.729 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 2, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 5, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 3, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 4, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-09-12T12:26:46.730 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 3147, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:46.731 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:46.732 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:46.733 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 360748, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 3591, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 175, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:46.734 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 16034678, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 200111, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 2328, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 26, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 4, 2024-09-12T12:26:46.735 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 2328, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2328, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.810959221, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000777903 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2328, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2329 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 2328, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 2328, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-09-12T12:26:46.736 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 1461, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 864, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:46.737 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 2, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T12:26:46.738 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T12:26:46.739 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 88, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 11, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 10, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 10, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T12:26:46.740 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-12T12:26:46.741 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2584, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 77449383, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2584, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2584, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 77449383, 2024-09-12T12:26:46.742 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:46.743 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 2328, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 75424079, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2328, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 75424079, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:46.744 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 2328, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 2328, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2328, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 2328, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.745 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.746 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x5578b6042b40": { 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:46.747 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:46.748 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T12:26:47.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:46 smithi081 ceph-mon[30948]: pgmap v321: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:26:47.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:46 smithi173 ceph-mon[35326]: pgmap v321: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:26:47.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:46 smithi103 ceph-mon[35094]: pgmap v321: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:47.503 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:47.503 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T12:26:47.504 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T12:26:47.751 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:26:48.217 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T12:26:48.217 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:48.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 5595, 2024-09-12T12:26:48.217 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 4314, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 2367841, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 12676190, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 17, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.308323904, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.145872697, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.158850332, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.032852263, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4312, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.146256124, 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000033918 2024-09-12T12:26:48.218 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6786, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001403288, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000206 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 312336 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 7137, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 6552, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 4181137, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 8979796, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 8, 2024-09-12T12:26:48.219 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 6, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.442019411, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.187150524, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.252421899, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.045690511, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 6553, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.356688343, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000054431 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 9671, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.001482738, 2024-09-12T12:26:48.220 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000153 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1642336, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 132336 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 21222, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 28934, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 10246517, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 19302706, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 15, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 7, 2024-09-12T12:26:48.221 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 1.219668122, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.549820786, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.934477557, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.037661959, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 28930, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.887725583, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000030685 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 42684, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.006473209, 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000151 2024-09-12T12:26:48.222 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3791664, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 10694944 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1871, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 5.857473275, 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.003130664 2024-09-12T12:26:48.223 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3879, 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.830434172, 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000214084 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 4405, 2024-09-12T12:26:48.224 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 4335, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4335, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 6.293665092, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001451825 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 70, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 20, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 1, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T12:26:48.225 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 2478, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 1, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 2477, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 2477, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 2436, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 2, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 7151, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 6040, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 38, 2024-09-12T12:26:48.226 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 768, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 8, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 1072, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 10, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 1919, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:48.227 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 2774, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 17430556, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 2, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:48.228 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 21, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 1885, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 5665, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 4805, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 2951, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 28, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 2815 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T12:26:48.229 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 345, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 2261, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 1505, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 1468, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 594, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 75, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 2285, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 2210, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:48.230 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 3, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 2095, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 8, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 1, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T12:26:48.231 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 11696, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 11696, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 17, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T12:26:48.232 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 17, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 33897114, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 0, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1757, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 48.685929712, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.027709692 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 0 2024-09-12T12:26:48.233 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 1227, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 4986, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 3759, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 129, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 904, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 775, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 2478, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 7124, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 4646, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-12T12:26:48.234 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 3199, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 3199, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 84044, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 223520 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 5168, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 216, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 4405, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 20, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 625, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1015, 2024-09-12T12:26:48.235 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.091936683, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001075799 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.002658938, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000886312 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.236 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 860, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.274755847, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000319483 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.237 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.238 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.239 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.240 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.241 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 170, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.172811331, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001016537 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.242 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 75, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.226373901, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.016351652 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:48.243 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.434906407, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.217453203 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.244 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.245 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2210, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 3.090221985, 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001398290 2024-09-12T12:26:48.246 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 2, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-12T12:26:48.247 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 2530, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 2530, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 1884, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:48.248 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:48.249 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:48.250 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 933124, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 1458, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 175, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:48.251 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 4897650, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 71958, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 4159, 2024-09-12T12:26:48.252 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 30364880, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 32, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 4159, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4159, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 22.339498093, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.005371362 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 4159, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 4238 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.253 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 4159, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 38, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 4121, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 0, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 10, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 38, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 1795, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 29, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 1, 2024-09-12T12:26:48.254 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 2229, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 20, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T12:26:48.255 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T12:26:48.256 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 88, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 11, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 12, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 12, 2024-09-12T12:26:48.257 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 92, 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 0, 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 24 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 1, 2024-09-12T12:26:48.258 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 2098 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T12:26:48.260 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 6, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 2210, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 2210, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:48.261 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 33950, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 13244552, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 33950, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 33950, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 13244552, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.262 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 4159, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 30599922, 2024-09-12T12:26:48.263 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4159, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 30599922, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T12:26:48.264 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 4159, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 4159, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 4159, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 4159, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.265 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2210, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 235042, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2210, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:48.266 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 38, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 235042, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x561172860960": { 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:48.267 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 11696, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 29702810, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 11696, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1757, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 29702810, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:48.268 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:48.269 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.269 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:48.269 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds.exported=8 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds.imported=10 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=345 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=2261 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=2 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:48.903 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:48.903 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T12:26:48.904 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T12:26:49.149 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T12:26:49.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:48 smithi173 ceph-mon[35326]: pgmap v322: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:49.278 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:48 smithi103 ceph-mon[35094]: pgmap v322: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:49.359 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:48 smithi081 ceph-mon[30948]: pgmap v322: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:49.657 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-09-12T12:26:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T12:26:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 323, 2024-09-12T12:26:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 325, 2024-09-12T12:26:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 12667745, 2024-09-12T12:26:49.657 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 102778, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.038843595, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.008615197, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.017917671, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.008703034, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 323, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.017172366, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000053165 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.658 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 743, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 833, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 10130524, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 596419, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 5, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.101542629, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.037586221, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.057899655, 2024-09-12T12:26:49.659 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.014850756, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 833, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.048775511, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000058554 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 1623248, 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 443456 2024-09-12T12:26:49.660 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1333, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1366, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 9131266, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 547896, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.140632536, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.044177389, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.040512994, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.042429156, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1363, 2024-09-12T12:26:49.661 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.060454826, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000044354 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 124320 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-09-12T12:26:49.662 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3528, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.100209431, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000028404 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.663 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-09-12T12:26:49.664 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 4741, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 4741, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 4741, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 1, 2024-09-12T12:26:49.665 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-09-12T12:26:49.666 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T12:26:49.667 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-09-12T12:26:49.668 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-09-12T12:26:49.669 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 11696, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-09-12T12:26:49.670 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 17, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 2, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 33897114, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 33895026, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 11696 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-09-12T12:26:49.671 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 1276, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 4385, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 3109, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 119, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 167, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 48, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 4741, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 5839, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 1098, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 63332, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215328 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.672 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.673 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.674 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.675 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.676 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.677 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.678 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-09-12T12:26:49.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.680 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.681 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.682 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-09-12T12:26:49.683 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 3, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 2, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 1888, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T12:26:49.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-09-12T12:26:49.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T12:26:49.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T12:26:49.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T12:26:49.687 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T12:26:49.688 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-09-12T12:26:49.689 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 264027, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 1405, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-09-12T12:26:49.690 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7936, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 175, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 6512429, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 73533, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.691 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 2136, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 21, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 3, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 2136, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2136, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.267971437, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000593619 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-09-12T12:26:49.692 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 2136, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2137 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 2136, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 2136, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 1362, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 772, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-09-12T12:26:49.693 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-09-12T12:26:49.694 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-09-12T12:26:49.695 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 88, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 11, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 8, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 8, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-09-12T12:26:49.696 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-09-12T12:26:49.697 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2395, 2024-09-12T12:26:49.698 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 31697909, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2395, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2395, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 31697909, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.699 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 2136, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 29702815, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2136, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 29702815, 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:49.700 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:49.701 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 2136, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 2136, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2136, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 2136, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:49.702 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x564f5df68b40": { 2024-09-12T12:26:49.703 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-09-12T12:26:49.704 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-09-12T12:26:49.705 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.705 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-09-12T12:26:49.705 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-12T12:26:50.430 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T12:26:50.430 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T12:26:50.441 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T12:26:50.441 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:26:50.441 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:50.459 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-12T12:26:50.460 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T12:26:50.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T12:26:50.802 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:51.179 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:51 smithi081 ceph-mon[30948]: pgmap v323: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 -- 172.21.15.81:0/815098728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258106f10 msgr2=0x7ff25810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/815098728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258106f10 0x7ff25810ea90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff250009ca0 tx=0x7ff25002a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 -- 172.21.15.81:0/815098728 shutdown_connections 2024-09-12T12:26:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/815098728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258106f10 0x7ff25810ea90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/815098728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 0x7ff2581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/815098728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258101de0 0x7ff2581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 -- 172.21.15.81:0/815098728 >> 172.21.15.81:0/815098728 conn(0x7ff2580fd8c0 msgr2=0x7ff2580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 -- 172.21.15.81:0/815098728 shutdown_connections 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.259+0000 7ff25cd4e640 1 -- 172.21.15.81:0/815098728 wait complete. 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 Processor -- start 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 -- start start 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 0x7ff2581984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 0x7ff258198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258106f10 0x7ff25819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff258112090 con 0x7ff258101de0 2024-09-12T12:26:51.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff258111f10 con 0x7ff258102790 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.260+0000 7ff25cd4e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff258112210 con 0x7ff258106f10 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 0x7ff2581984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 0x7ff2581984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41100/0 (socket says 172.21.15.81:41100) 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 -- 172.21.15.81:0/982623703 learned_addr learned my addr 172.21.15.81:0/982623703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff24ffff640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 0x7ff258198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 -- 172.21.15.81:0/982623703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258106f10 msgr2=0x7ff25819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff256d9d640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258106f10 0x7ff25819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258106f10 0x7ff25819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 -- 172.21.15.81:0/982623703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 msgr2=0x7ff258198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 0x7ff258198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 -- 172.21.15.81:0/982623703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25819d4a0 con 0x7ff258101de0 2024-09-12T12:26:51.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff24ffff640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 0x7ff258198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25659c640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 0x7ff2581984f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff24800d770 tx=0x7ff24800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248017070 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff248005520 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25819d790 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248010460 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.261+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2581a5070 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.262+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2581021c0 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.263+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff248004ea0 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.264+0000 7ff24f7fe640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff2440a2cf0 0x7ff2440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.264+0000 7ff24ffff640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff2440a2cf0 0x7ff2440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.264+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7ff2480ceff0 con 0x7ff258101de0 2024-09-12T12:26:51.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.265+0000 7ff24ffff640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff2440a2cf0 0x7ff2440a51b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff240005fd0 tx=0x7ff240005850 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.268+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff24809bc50 con 0x7ff258101de0 2024-09-12T12:26:51.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:51 smithi173 ceph-mon[35326]: pgmap v323: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:51.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:51 smithi103 ceph-mon[35094]: pgmap v323: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.448+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff25810a0f0 con 0x7ff258101de0 2024-09-12T12:26:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.448+0000 7ff24f7fe640 1 -- 172.21.15.81:0/982623703 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v88) ==== 81+0+942 (secure 0 0 0) 0x7ff24809b550 con 0x7ff258101de0 2024-09-12T12:26:51.449 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/4236049851 2024-09-13T12:16:25.570397+0000 2024-09-12T12:26:51.449 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/4236049851 2024-09-13T12:16:25.570397+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/22849456 2024-09-13T12:16:25.570397+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2716402580 2024-09-13T12:07:24.724306+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2203121669 2024-09-13T12:07:48.253532+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2649443491 2024-09-13T12:16:25.570397+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/478495135 2024-09-13T12:07:24.724306+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2369792857 2024-09-13T12:07:48.253532+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4253084359 2024-09-13T12:07:24.724306+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2203121669 2024-09-13T12:07:48.253532+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2617771430 2024-09-13T12:07:48.253532+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2716402580 2024-09-13T12:07:24.724306+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1070489278 2024-09-13T12:07:24.724306+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/4279243684 2024-09-13T12:16:25.570397+0000 2024-09-12T12:26:51.450 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/904274119 2024-09-13T12:07:48.253532+0000 2024-09-12T12:26:51.451 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1340615058 2024-09-13T12:16:25.570397+0000 2024-09-12T12:26:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:listed 16 entries 2024-09-12T12:26:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff2440a2cf0 msgr2=0x7ff2440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff2440a2cf0 0x7ff2440a51b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff240005fd0 tx=0x7ff240005850 comp rx=0 tx=0).stop 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 msgr2=0x7ff2581984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 0x7ff2581984f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff24800d770 tx=0x7ff24800dc30 comp rx=0 tx=0).stop 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 shutdown_connections 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff2440a2cf0 0x7ff2440a51b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff258106f10 0x7ff25819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff258102790 0x7ff258198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 --2- 172.21.15.81:0/982623703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff258101de0 0x7ff2581984f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 >> 172.21.15.81:0/982623703 conn(0x7ff2580fd8c0 msgr2=0x7ff2580feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 shutdown_connections 2024-09-12T12:26:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:51.450+0000 7ff25cd4e640 1 -- 172.21.15.81:0/982623703 wait complete. 2024-09-12T12:26:52.092 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:52 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/982623703' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:26:52.120 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T12:26:52.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:52.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T12:26:52.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:26:52.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:52.210 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T12:26:52.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:52.263 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-12T12:26:52.306 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T12:26:52.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:52.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T12:26:52.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T12:26:52.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-12T12:26:52.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:52 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/982623703' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:26:52.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:52 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/982623703' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T12:26:52.487 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T12:26:52.498 INFO:tasks.cephadm:Teardown begin 2024-09-12T12:26:52.498 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T12:26:52.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:53.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:53 smithi081 ceph-mon[30948]: pgmap v324: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:53.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:53 smithi173 ceph-mon[35326]: pgmap v324: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.302+0000 7fa19e66b640 1 -- 172.21.15.81:0/1416585142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19810c170 msgr2=0x7fa19810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.302+0000 7fa19e66b640 1 --2- 172.21.15.81:0/1416585142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19810c170 0x7fa19810e610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa190009ca0 tx=0x7fa19002a950 comp rx=0 tx=0).stop 2024-09-12T12:26:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 -- 172.21.15.81:0/1416585142 shutdown_connections 2024-09-12T12:26:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 --2- 172.21.15.81:0/1416585142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa19810c170 0x7fa19810e610 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 --2- 172.21.15.81:0/1416585142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa198103660 0x7fa19810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 --2- 172.21.15.81:0/1416585142 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198102d40 0x7fa198103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 -- 172.21.15.81:0/1416585142 >> 172.21.15.81:0/1416585142 conn(0x7fa1980fc7a0 msgr2=0x7fa1980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 -- 172.21.15.81:0/1416585142 shutdown_connections 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 -- 172.21.15.81:0/1416585142 wait complete. 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 Processor -- start 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.303+0000 7fa19e66b640 1 -- start start 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 0x7fa1981984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198103660 0x7fa198198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa19810c170 0x7fa19819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa198112070 con 0x7fa198102d40 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa198111ef0 con 0x7fa19810c170 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa1981121f0 con 0x7fa198103660 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 0x7fa1981984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 0x7fa1981984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33500/0 (socket says 172.21.15.81:33500) 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 -- 172.21.15.81:0/3993418263 learned_addr learned my addr 172.21.15.81:0/3993418263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa1977fe640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198103660 0x7fa198198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19cc08640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa19810c170 0x7fa19819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 -- 172.21.15.81:0/3993418263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198103660 msgr2=0x7fa198198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198103660 0x7fa198198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 -- 172.21.15.81:0/3993418263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa19810c170 msgr2=0x7fa19819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa19810c170 0x7fa19819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 -- 172.21.15.81:0/3993418263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19819d480 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa197fff640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 0x7fa1981984d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa18800d950 tx=0x7fa18800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188017030 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19819d770 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa188004020 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188004a00 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.304+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1981a5050 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.305+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa198103120 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.306+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa1880041d0 con 0x7fa198102d40 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.307+0000 7fa1957fa640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa1800a2cf0 0x7fa1800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.307+0000 7fa1977fe640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa1800a2cf0 0x7fa1800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.307+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7fa1880cf520 con 0x7fa198102d40 2024-09-12T12:26:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.308+0000 7fa1977fe640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa1800a2cf0 0x7fa1800a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005e00 tx=0x7fa18c005c90 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.310+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa188024330 con 0x7fa198102d40 2024-09-12T12:26:53.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:53 smithi103 ceph-mon[35094]: pgmap v324: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-12T12:26:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.511+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa198199830 con 0x7fa198102d40 2024-09-12T12:26:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.512+0000 7fa1957fa640 1 -- 172.21.15.81:0/3993418263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11982 (secure 0 0 0) 0x7fa18809c180 con 0x7fa198102d40 2024-09-12T12:26:53.513 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:26:53.513 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":49,"btime":"2024-09-12T12:22:12:181372+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:22:11.217270+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:26:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 49 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa1800a2cf0 msgr2=0x7fa1800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa1800a2cf0 0x7fa1800a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005e00 tx=0x7fa18c005c90 comp rx=0 tx=0).stop 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 msgr2=0x7fa1981984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 0x7fa1981984d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa18800d950 tx=0x7fa18800de10 comp rx=0 tx=0).stop 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 shutdown_connections 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fa1800a2cf0 0x7fa1800a51b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa19810c170 0x7fa19819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa198103660 0x7fa198198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 --2- 172.21.15.81:0/3993418263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198102d40 0x7fa1981984d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 >> 172.21.15.81:0/3993418263 conn(0x7fa1980fc7a0 msgr2=0x7fa1980fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 shutdown_connections 2024-09-12T12:26:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:53.514+0000 7fa19e66b640 1 -- 172.21.15.81:0/3993418263 wait complete. 2024-09-12T12:26:54.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:54 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/3993418263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:54.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T12:26:54.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:54 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/3993418263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:54.413 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:54.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:54 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/3993418263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:55.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:55 smithi081 ceph-mon[30948]: pgmap v325: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 -- 172.21.15.81:0/1042631116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4100e20 msgr2=0x7f5ce4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 --2- 172.21.15.81:0/1042631116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4100e20 0x7f5ce4101200 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f5cd8009900 tx=0x7f5cd802a480 comp rx=0 tx=0).stop 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 -- 172.21.15.81:0/1042631116 shutdown_connections 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 --2- 172.21.15.81:0/1042631116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102ef0 0x7f5ce410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 --2- 172.21.15.81:0/1042631116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ce4102570 0x7f5ce41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 --2- 172.21.15.81:0/1042631116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4100e20 0x7f5ce4101200 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 -- 172.21.15.81:0/1042631116 >> 172.21.15.81:0/1042631116 conn(0x7f5ce40fc7d0 msgr2=0x7f5ce40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 -- 172.21.15.81:0/1042631116 shutdown_connections 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.904+0000 7f5cec530640 1 -- 172.21.15.81:0/1042631116 wait complete. 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 Processor -- start 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 -- start start 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ce4100e20 0x7f5ce41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102570 0x7f5ce4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 0x7f5ce419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41110a0 con 0x7f5ce4102ef0 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4110f20 con 0x7f5ce4102570 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5cec530640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4111220 con 0x7f5ce4100e20 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 0x7f5ce419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 0x7f5ce419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33508/0 (socket says 172.21.15.81:33508) 2024-09-12T12:26:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 -- 172.21.15.81:0/1149546205 learned_addr learned my addr 172.21.15.81:0/1149546205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ce9acb640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102570 0x7f5ce4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 -- 172.21.15.81:0/1149546205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ce4100e20 msgr2=0x7f5ce41985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ce4100e20 0x7f5ce41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 -- 172.21.15.81:0/1149546205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102570 msgr2=0x7f5ce4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102570 0x7f5ce4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 -- 172.21.15.81:0/1149546205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce419d560 con 0x7f5ce4102ef0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.905+0000 7f5ceaacd640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 0x7f5ce419ce80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00eaa0 tx=0x7f5cdc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.906+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00cdb0 con 0x7f5ce4102ef0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.906+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5cdc004b20 con 0x7f5ce4102ef0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.906+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce419d850 con 0x7f5ce4102ef0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.906+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc011760 con 0x7f5ce4102ef0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.906+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce41a5130 con 0x7f5ce4102ef0 2024-09-12T12:26:55.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.907+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce4101200 con 0x7f5ce4102ef0 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.908+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5cdc004cd0 con 0x7f5ce4102ef0 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.908+0000 7f5cd77fe640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5cd00a2d70 0x7f5cd00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.909+0000 7f5cea2cc640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5cd00a2d70 0x7f5cd00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.909+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f5cdc0cf630 con 0x7f5ce4102ef0 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.909+0000 7f5cea2cc640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5cd00a2d70 0x7f5cd00a5230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80096c0 tx=0x7f5cd8000bc0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:54.913+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5cdc016030 con 0x7f5ce4102ef0 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:26:55.162 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":49,"btime":"2024-09-12T12:22:12:181372+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4073646080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4073646080},{"type":"v1","addr":"172.21.15.81:6835","nonce":4073646080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3120489264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3120489264},{"type":"v1","addr":"172.21.15.81:6837","nonce":3120489264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T12:14:35.911015+0000","modified":"2024-09-12T12:22:11.217270+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24485,"mds_1":24461,"mds_2":24457,"mds_3":24437,"mds_4":24436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14598":{"gid":14598,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6839/3279635401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":3279635401},{"type":"v1","addr":"172.21.15.81:6839","nonce":3279635401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14610":{"gid":14610,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.81:6841/1006182135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":1006182135},{"type":"v1","addr":"172.21.15.81:6841","nonce":1006182135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24394":{"gid":24394,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6833/372466772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":372466772},{"type":"v1","addr":"172.21.15.173:6833","nonce":372466772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24407":{"gid":24407,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.103:6833/3064461197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":3064461197},{"type":"v1","addr":"172.21.15.103:6833","nonce":3064461197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6835/3014376257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3014376257},{"type":"v1","addr":"172.21.15.173:6835","nonce":3014376257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24436":{"gid":24436,"name":"c","rank":4,"incarnation":24,"state":"up:active","state_seq":10,"addr":"172.21.15.173:6837/359177011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":359177011},{"type":"v1","addr":"172.21.15.173:6837","nonce":359177011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6835/4242406176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":4242406176},{"type":"v1","addr":"172.21.15.103:6835","nonce":4242406176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.173:6839/2860435891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2860435891},{"type":"v1","addr":"172.21.15.173:6839","nonce":2860435891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.103:6837/4210602713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":4210602713},{"type":"v1","addr":"172.21.15.103:6837","nonce":4210602713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24485":{"gid":24485,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6839/3967449570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":3967449570},{"type":"v1","addr":"172.21.15.103:6839","nonce":3967449570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24485,"qdb_cluster":[24436,24437,24457,24461,24485]},"id":1}]} 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.116+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ce41a5300 con 0x7f5ce4102ef0 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.117+0000 7f5cd77fe640 1 -- 172.21.15.81:0/1149546205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11982 (secure 0 0 0) 0x7f5cdc09c290 con 0x7f5ce4102ef0 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 49 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5cd00a2d70 msgr2=0x7f5cd00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5cd00a2d70 0x7f5cd00a5230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80096c0 tx=0x7f5cd8000bc0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 msgr2=0x7f5ce419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 0x7f5ce419ce80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00eaa0 tx=0x7f5cdc00ef60 comp rx=0 tx=0).stop 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 shutdown_connections 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f5cd00a2d70 0x7f5cd00a5230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ce4102ef0 0x7f5ce419ce80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102570 0x7f5ce4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 --2- 172.21.15.81:0/1149546205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ce4100e20 0x7f5ce41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 >> 172.21.15.81:0/1149546205 conn(0x7f5ce40fc7d0 msgr2=0x7f5ce4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 shutdown_connections 2024-09-12T12:26:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:55.119+0000 7f5cec530640 1 -- 172.21.15.81:0/1149546205 wait complete. 2024-09-12T12:26:55.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:55 smithi173 ceph-mon[35326]: pgmap v325: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:55.438 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:55 smithi103 ceph-mon[35094]: pgmap v325: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:55.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T12:26:56.011 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:56.288 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:56 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1149546205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:56.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:56 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1149546205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:56.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:56 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1149546205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T12:26:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 -- 172.21.15.81:0/1561270794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 msgr2=0x7f80f810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 --2- 172.21.15.81:0/1561270794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f810eaf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009cd0 tx=0x7f80e802a8e0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 -- 172.21.15.81:0/1561270794 shutdown_connections 2024-09-12T12:26:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 --2- 172.21.15.81:0/1561270794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f810eaf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 --2- 172.21.15.81:0/1561270794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f8100ca0 0x7f80f8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 --2- 172.21.15.81:0/1561270794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f81002f0 0x7f80f81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 -- 172.21.15.81:0/1561270794 >> 172.21.15.81:0/1561270794 conn(0x7f80f8077210 msgr2=0x7f80f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 -- 172.21.15.81:0/1561270794 shutdown_connections 2024-09-12T12:26:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.500+0000 7f80fc93f640 1 -- 172.21.15.81:0/1561270794 wait complete. 2024-09-12T12:26:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 Processor -- start 2024-09-12T12:26:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 -- start start 2024-09-12T12:26:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f81002f0 0x7f80f81985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f8100ca0 0x7f80f8198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8112140 con 0x7f80f8106f50 2024-09-12T12:26:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f80f8111fc0 con 0x7f80f81002f0 2024-09-12T12:26:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80fc93f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f80f81122c0 con 0x7f80f8100ca0 2024-09-12T12:26:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80f6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80f6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f819ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33516/0 (socket says 172.21.15.81:33516) 2024-09-12T12:26:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80f6d9d640 1 -- 172.21.15.81:0/48118250 learned_addr learned my addr 172.21.15.81:0/48118250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80f659c640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f81002f0 0x7f80f81985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80f5d9b640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f8100ca0 0x7f80f8198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.501+0000 7f80f6d9d640 1 -- 172.21.15.81:0/48118250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f8100ca0 msgr2=0x7f80f8198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80f6d9d640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f8100ca0 0x7f80f8198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80f6d9d640 1 -- 172.21.15.81:0/48118250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f81002f0 msgr2=0x7f80f81985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80f6d9d640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f81002f0 0x7f80f81985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80f6d9d640 1 -- 172.21.15.81:0/48118250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f819d590 con 0x7f80f8106f50 2024-09-12T12:26:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80f6d9d640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f819ceb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009df0 tx=0x7f80e8032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8004240 con 0x7f80f8106f50 2024-09-12T12:26:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f819d820 con 0x7f80f8106f50 2024-09-12T12:26:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f80e80305a0 con 0x7f80f8106f50 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e80466c0 con 0x7f80f8106f50 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.502+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f81a5160 con 0x7f80f8106f50 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.503+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f81006d0 con 0x7f80f8106f50 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.504+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f80e8030750 con 0x7f80f8106f50 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.505+0000 7f80ef7fe640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f80e40a2cf0 0x7f80e40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.505+0000 7f80f659c640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f80e40a2cf0 0x7f80e40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.505+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7f80e802e030 con 0x7f80f8106f50 2024-09-12T12:26:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.506+0000 7f80f659c640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f80e40a2cf0 0x7f80e40a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80f00058c0 tx=0x7f80f000a2d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.509+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80e804b060 con 0x7f80f8106f50 2024-09-12T12:26:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.678+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80f810a180 con 0x7f80f8106f50 2024-09-12T12:26:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.680+0000 7f80ef7fe640 1 -- 172.21.15.81:0/48118250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23109 (secure 0 0 0) 0x7f80e80098b0 con 0x7f80f8106f50 2024-09-12T12:26:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-12T12:26:56.681 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":88,"fsid":"595bfb7a-70ff-11ef-bcea-c7b262605968","created":"2024-09-12T12:07:02.815407+0000","modified":"2024-09-12T12:26:13.330288+0000","last_up_change":"2024-09-12T12:13:46.233936+0000","last_in_change":"2024-09-12T12:13:22.627814+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T12:10:04.561261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T12:14:31.876252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T12:14:34.201036+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eec0ad60-853a-44dc-9453-3ec54f1ca452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6803","nonce":1527983778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6805","nonce":1527983778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6809","nonce":1527983778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1527983778},{"type":"v1","addr":"172.21.15.81:6807","nonce":1527983778}]},"public_addr":"172.21.15.81:6803/1527983778","cluster_addr":"172.21.15.81:6805/1527983778","heartbeat_back_addr":"172.21.15.81:6809/1527983778","heartbeat_front_addr":"172.21.15.81:6807/1527983778","state":["exists","up"]},{"osd":1,"uuid":"c632ebfd-7044-4070-839b-9abc5275937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6801","nonce":2968403799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6803","nonce":2968403799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6807","nonce":2968403799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2968403799},{"type":"v1","addr":"172.21.15.103:6805","nonce":2968403799}]},"public_addr":"172.21.15.103:6801/2968403799","cluster_addr":"172.21.15.103:6803/2968403799","heartbeat_back_addr":"172.21.15.103:6807/2968403799","heartbeat_front_addr":"172.21.15.103:6805/2968403799","state":["exists","up"]},{"osd":2,"uuid":"e4133af2-0de8-4d7c-a428-c04eee0d9b54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6801","nonce":3783460889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6803","nonce":3783460889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6807","nonce":3783460889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3783460889},{"type":"v1","addr":"172.21.15.173:6805","nonce":3783460889}]},"public_addr":"172.21.15.173:6801/3783460889","cluster_addr":"172.21.15.173:6803/3783460889","heartbeat_back_addr":"172.21.15.173:6807/3783460889","heartbeat_front_addr":"172.21.15.173:6805/3783460889","state":["exists","up"]},{"osd":3,"uuid":"255d0d9f-47b0-45d3-98c8-17ce85b3cf2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6811","nonce":839409711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6813","nonce":839409711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6817","nonce":839409711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":839409711},{"type":"v1","addr":"172.21.15.81:6815","nonce":839409711}]},"public_addr":"172.21.15.81:6811/839409711","cluster_addr":"172.21.15.81:6813/839409711","heartbeat_back_addr":"172.21.15.81:6817/839409711","heartbeat_front_addr":"172.21.15.81:6815/839409711","state":["exists","up"]},{"osd":4,"uuid":"233bf67e-6d2b-498b-ace5-aef1a3f5a107","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6809","nonce":1884074772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6811","nonce":1884074772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6815","nonce":1884074772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1884074772},{"type":"v1","addr":"172.21.15.103:6813","nonce":1884074772}]},"public_addr":"172.21.15.103:6809/1884074772","cluster_addr":"172.21.15.103:6811/1884074772","heartbeat_back_addr":"172.21.15.103:6815/1884074772","heartbeat_front_addr":"172.21.15.103:6813/1884074772","state":["exists","up"]},{"osd":5,"uuid":"dfaddbb0-cfb9-4a0d-907e-47556befc325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6809","nonce":1780701631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6811","nonce":1780701631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6815","nonce":1780701631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1780701631},{"type":"v1","addr":"172.21.15.173:6813","nonce":1780701631}]},"public_addr":"172.21.15.173:6809/1780701631","cluster_addr":"172.21.15.173:6811/1780701631","heartbeat_back_addr":"172.21.15.173:6815/1780701631","heartbeat_front_addr":"172.21.15.173:6813/1780701631","state":["exists","up"]},{"osd":6,"uuid":"e5583451-c189-446a-996a-c0289f513116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6819","nonce":3383572766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6821","nonce":3383572766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6825","nonce":3383572766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3383572766},{"type":"v1","addr":"172.21.15.81:6823","nonce":3383572766}]},"public_addr":"172.21.15.81:6819/3383572766","cluster_addr":"172.21.15.81:6821/3383572766","heartbeat_back_addr":"172.21.15.81:6825/3383572766","heartbeat_front_addr":"172.21.15.81:6823/3383572766","state":["exists","up"]},{"osd":7,"uuid":"d9081e5c-accf-4824-9a98-7b13e7037047","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6817","nonce":4035639207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6819","nonce":4035639207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6823","nonce":4035639207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4035639207},{"type":"v1","addr":"172.21.15.103:6821","nonce":4035639207}]},"public_addr":"172.21.15.103:6817/4035639207","cluster_addr":"172.21.15.103:6819/4035639207","heartbeat_back_addr":"172.21.15.103:6823/4035639207","heartbeat_front_addr":"172.21.15.103:6821/4035639207","state":["exists","up"]},{"osd":8,"uuid":"c1b297bd-6351-4c68-b4c1-985906cdbade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6817","nonce":754254770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6819","nonce":754254770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6823","nonce":754254770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":754254770},{"type":"v1","addr":"172.21.15.173:6821","nonce":754254770}]},"public_addr":"172.21.15.173:6817/754254770","cluster_addr":"172.21.15.173:6819/754254770","heartbeat_back_addr":"172.21.15.173:6823/754254770","heartbeat_front_addr":"172.21.15.173:6821/754254770","state":["exists","up"]},{"osd":9,"uuid":"2bdbbf2c-ec45-4561-b86a-93e24b7a8359","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6827","nonce":4277266165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6829","nonce":4277266165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6833","nonce":4277266165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":4277266165},{"type":"v1","addr":"172.21.15.81:6831","nonce":4277266165}]},"public_addr":"172.21.15.81:6827/4277266165","cluster_addr":"172.21.15.81:6829/4277266165","heartbeat_back_addr":"172.21.15.81:6833/4277266165","heartbeat_front_addr":"172.21.15.81:6831/4277266165","state":["exists","up"]},{"osd":10,"uuid":"b8bad4f9-e18c-4226-bb8e-30a1a5a80985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6825","nonce":2351516633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6827","nonce":2351516633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6831","nonce":2351516633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2351516633},{"type":"v1","addr":"172.21.15.103:6829","nonce":2351516633}]},"public_addr":"172.21.15.103:6825/2351516633","cluster_addr":"172.21.15.103:6827/2351516633","heartbeat_back_addr":"172.21.15.103:6831/2351516633","heartbeat_front_addr":"172.21.15.103:6829/2351516633","state":["exists","up"]},{"osd":11,"uuid":"73635e20-81fb-4323-ba44-febfdf20688f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6825","nonce":2112038655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6827","nonce":2112038655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6831","nonce":2112038655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2112038655},{"type":"v1","addr":"172.21.15.173:6829","nonce":2112038655}]},"public_addr":"172.21.15.173:6825/2112038655","cluster_addr":"172.21.15.173:6827/2112038655","heartbeat_back_addr":"172.21.15.173:6831/2112038655","heartbeat_front_addr":"172.21.15.173:6829/2112038655","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:11.366660+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:09:37.069773+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:02.228374+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:27.380812+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:10:52.369519+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:16.584167+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:11:41.490076+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:05.398810+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:29.437847+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:12:54.848732+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:19.419789+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T12:13:44.302551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6801/4236049851":"2024-09-13T12:16:25.570397+0000","172.21.15.81:6800/4236049851":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/22849456":"2024-09-13T12:16:25.570397+0000","172.21.15.81:6800/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6800/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2649443491":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/478495135":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/2369792857":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/4253084359":"2024-09-13T12:07:24.724306+0000","172.21.15.81:6801/2203121669":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/2617771430":"2024-09-13T12:07:48.253532+0000","172.21.15.81:6801/2716402580":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/1070489278":"2024-09-13T12:07:24.724306+0000","172.21.15.81:0/4279243684":"2024-09-13T12:16:25.570397+0000","172.21.15.81:0/904274119":"2024-09-13T12:07:48.253532+0000","172.21.15.81:0/1340615058":"2024-09-13T12:16:25.570397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T12:26:56.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f80e40a2cf0 msgr2=0x7f80e40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f80e40a2cf0 0x7f80e40a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f80f00058c0 tx=0x7f80f000a2d0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 msgr2=0x7f80f819ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f819ceb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009df0 tx=0x7f80e8032c00 comp rx=0 tx=0).stop 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 shutdown_connections 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f80e40a2cf0 0x7f80e40a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80f8106f50 0x7f80f819ceb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80f8100ca0 0x7f80f8198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 --2- 172.21.15.81:0/48118250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80f81002f0 0x7f80f81985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 >> 172.21.15.81:0/48118250 conn(0x7f80f8077210 msgr2=0x7f80f8105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 shutdown_connections 2024-09-12T12:26:56.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:56.682+0000 7f80fc93f640 1 -- 172.21.15.81:0/48118250 wait complete. 2024-09-12T12:26:57.277 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:57 smithi081 ceph-mon[30948]: pgmap v326: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:57.278 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:57 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/48118250' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:57.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T12:26:57.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:57 smithi173 ceph-mon[35326]: pgmap v326: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:57.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:57 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/48118250' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:57 smithi103 ceph-mon[35094]: pgmap v326: 97 pgs: 97 active+clean; 83 MiB data, 999 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-12T12:26:57.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:57 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/48118250' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T12:26:57.557 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 -- 172.21.15.81:0/4146511574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c101220 msgr2=0x7fba3c101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 --2- 172.21.15.81:0/4146511574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c101220 0x7fba3c101660 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fba30009900 tx=0x7fba3002a410 comp rx=0 tx=0).stop 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 -- 172.21.15.81:0/4146511574 shutdown_connections 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 --2- 172.21.15.81:0/4146511574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba3c101ba0 0x7fba3c10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 --2- 172.21.15.81:0/4146511574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c101220 0x7fba3c101660 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 --2- 172.21.15.81:0/4146511574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c105a70 0x7fba3c105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 -- 172.21.15.81:0/4146511574 >> 172.21.15.81:0/4146511574 conn(0x7fba3c0fbee0 msgr2=0x7fba3c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 -- 172.21.15.81:0/4146511574 shutdown_connections 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.012+0000 7fba41781640 1 -- 172.21.15.81:0/4146511574 wait complete. 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 Processor -- start 2024-09-12T12:26:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 -- start start 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c101220 0x7fba3c198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba3c101ba0 0x7fba3c198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 0x7fba3c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c1110f0 con 0x7fba3c105a70 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c110f70 con 0x7fba3c101220 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba41781640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c111270 con 0x7fba3c101ba0 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 0x7fba3c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 0x7fba3c19cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33538/0 (socket says 172.21.15.81:33538) 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba3b7fe640 1 -- 172.21.15.81:0/1649308701 learned_addr learned my addr 172.21.15.81:0/1649308701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba3a7fc640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba3c101ba0 0x7fba3c198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.013+0000 7fba3affd640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c101220 0x7fba3c198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba3b7fe640 1 -- 172.21.15.81:0/1649308701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba3c101ba0 msgr2=0x7fba3c198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba3b7fe640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba3c101ba0 0x7fba3c198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba3b7fe640 1 -- 172.21.15.81:0/1649308701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c101220 msgr2=0x7fba3c198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba3b7fe640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c101220 0x7fba3c198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba3b7fe640 1 -- 172.21.15.81:0/1649308701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c19d5d0 con 0x7fba3c105a70 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba3b7fe640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 0x7fba3c19cef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fba3400eaa0 tx=0x7fba3400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3400cdb0 con 0x7fba3c105a70 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba34004b20 con 0x7fba3c105a70 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c19d8c0 con 0x7fba3c105a70 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34011760 con 0x7fba3c105a70 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.014+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c1a51a0 con 0x7fba3c105a70 2024-09-12T12:26:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.015+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c101660 con 0x7fba3c105a70 2024-09-12T12:26:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.016+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fba34004cd0 con 0x7fba3c105a70 2024-09-12T12:26:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.017+0000 7fba23fff640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fba240a2d70 0x7fba240a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.017+0000 7fba3affd640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fba240a2d70 0x7fba240a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.017+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8455+0+0 (secure 0 0 0) 0x7fba340cf600 con 0x7fba3c105a70 2024-09-12T12:26:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.017+0000 7fba3affd640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fba240a2d70 0x7fba240a5230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009890 tx=0x7fba2c008040 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.021+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba34016030 con 0x7fba3c105a70 2024-09-12T12:26:58.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.224+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fba3c109fa0 con 0x7fba3c105a70 2024-09-12T12:26:58.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.226+0000 7fba23fff640 1 -- 172.21.15.81:0/1649308701 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) ==== 161+0+0 (secure 0 0 0) 0x7fba3409c260 con 0x7fba3c105a70 2024-09-12T12:26:58.226 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T12:26:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.229+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fba240a2d70 msgr2=0x7fba240a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.229+0000 7fba41781640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fba240a2d70 0x7fba240a5230 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009890 tx=0x7fba2c008040 comp rx=0 tx=0).stop 2024-09-12T12:26:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.229+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 msgr2=0x7fba3c19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.229+0000 7fba41781640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 0x7fba3c19cef0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fba3400eaa0 tx=0x7fba3400ef60 comp rx=0 tx=0).stop 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 shutdown_connections 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fba240a2d70 0x7fba240a5230 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba3c105a70 0x7fba3c19cef0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba3c101ba0 0x7fba3c198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 --2- 172.21.15.81:0/1649308701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c101220 0x7fba3c198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 >> 172.21.15.81:0/1649308701 conn(0x7fba3c0fbee0 msgr2=0x7fba3c1002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 shutdown_connections 2024-09-12T12:26:58.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:58.230+0000 7fba41781640 1 -- 172.21.15.81:0/1649308701 wait complete. 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a[30944]: 2024-09-12T12:26:58.225+0000 7f79ed71c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g[70765]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g[70765]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-mds[70787]: -- 172.21.15.81:0/1755402140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55726e36d860 con 0x55726e34b400 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g[70765]: starting mds.g at 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a[71178]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.527 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a[71178]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.528 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-mds[71182]: -- 172.21.15.81:0/1151923886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c3deedbc20 con 0x55c3deeb9000 2024-09-12T12:26:58.528 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:26:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a[71178]: starting mds.a at 2024-09-12T12:26:58.653 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i[65585]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i[65585]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-mds[65589]: -- 172.21.15.173:0/714885060 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df0f2d1c20 con 0x55df0f2ae800 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i[65585]: starting mds.i at 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f[64984]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f[64984]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-mds[64988]: -- 172.21.15.173:0/941194963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b418683860 con 0x55b418660800 2024-09-12T12:26:58.654 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f[64984]: starting mds.f at 2024-09-12T12:26:58.655 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l[64683]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.655 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l[64683]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.655 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:26:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l[64683]: starting mds.l at 2024-09-12T12:26:58.685 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h[65014]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.685 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h[65014]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.685 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-mds[65018]: -- 172.21.15.103:0/1375835628 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558354cb9860 con 0x558354c97000 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h[65014]: starting mds.h at 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k[64401]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k[64401]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-mds[64405]: -- 172.21.15.103:0/604615824 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558c7d7f860 con 0x5558c7d5c800 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k[64401]: starting mds.k at 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e[64714]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e[64714]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.686 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-mds[64718]: -- 172.21.15.103:0/3522807685 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555678633860 con 0x555678611400 2024-09-12T12:26:58.687 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e[64714]: starting mds.e at 2024-09-12T12:26:58.687 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: ignoring --setuser ceph since I am not root 2024-09-12T12:26:58.687 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: ignoring --setgroup ceph since I am not root 2024-09-12T12:26:58.687 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-mds[65318]: -- 172.21.15.103:0/1076903355 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55af716ef860 con 0x55af716cd000 2024-09-12T12:26:58.687 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:26:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: starting mds.b at 2024-09-12T12:26:58.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T12:26:59.102 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:26:59.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: pgmap v327: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-12T12:26:59.109 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1649308701' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:26:59.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:26:59.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:26:59.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/1649308701' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:26:59.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:26:59.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:26:59 smithi081 ceph-mon[30948]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T12:26:59.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: pgmap v327: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-12T12:26:59.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1649308701' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:26:59.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:26:59.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:26:59.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/1649308701' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:26:59.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:26:59.404 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:26:59 smithi173 ceph-mon[35326]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T12:26:59.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: pgmap v327: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-09-12T12:26:59.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1649308701' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T12:26:59.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T12:26:59.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T12:26:59.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/1649308701' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T12:26:59.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T12:26:59.436 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:26:59 smithi103 ceph-mon[35094]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-12T12:26:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 -- 172.21.15.81:0/3920153140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664106f10 msgr2=0x7ff66410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 --2- 172.21.15.81:0/3920153140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664106f10 0x7ff66410ea90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009ca0 tx=0x7ff65c02a8c0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 -- 172.21.15.81:0/3920153140 shutdown_connections 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 --2- 172.21.15.81:0/3920153140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664106f10 0x7ff66410ea90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 --2- 172.21.15.81:0/3920153140 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664102790 0x7ff6641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 --2- 172.21.15.81:0/3920153140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff664101de0 0x7ff6641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 -- 172.21.15.81:0/3920153140 >> 172.21.15.81:0/3920153140 conn(0x7ff6640fd8c0 msgr2=0x7ff6640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 -- 172.21.15.81:0/3920153140 shutdown_connections 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.587+0000 7ff66afe7640 1 -- 172.21.15.81:0/3920153140 wait complete. 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 Processor -- start 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 -- start start 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664101de0 0x7ff66419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 0x7ff66419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff664106f10 0x7ff66419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112090 con 0x7ff664102790 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff664111f10 con 0x7ff664106f10 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff66afe7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112210 con 0x7ff664101de0 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 0x7ff66419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 0x7ff66419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33604/0 (socket says 172.21.15.81:33604) 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 -- 172.21.15.81:0/2917847508 learned_addr learned my addr 172.21.15.81:0/2917847508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff668d83640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664101de0 0x7ff66419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 -- 172.21.15.81:0/2917847508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664101de0 msgr2=0x7ff66419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664101de0 0x7ff66419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 -- 172.21.15.81:0/2917847508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff664106f10 msgr2=0x7ff66419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff664106f10 0x7ff66419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 -- 172.21.15.81:0/2917847508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66419f5a0 con 0x7ff664102790 2024-09-12T12:26:59.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff663fff640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 0x7ff66419ab30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff65000d950 tx=0x7ff65000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.588+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650017070 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.589+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff650009c30 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.589+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66419f890 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.589+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65000f740 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.589+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a7170 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.590+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6641021c0 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.591+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff650010a80 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.591+0000 7ff661ffb640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff6540a2cf0 0x7ff6540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.592+0000 7ff668d83640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff6540a2cf0 0x7ff6540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.592+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8841+0+0 (secure 0 0 0) 0x7ff6500cf1c0 con 0x7ff664102790 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.592+0000 7ff668d83640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff6540a2cf0 0x7ff6540a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff658005e10 tx=0x7ff658005da0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:26:59.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.595+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff650009de0 con 0x7ff664102790 2024-09-12T12:26:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:26:59.794+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff6641a7500 con 0x7ff664102790 2024-09-12T12:27:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.233+0000 7ff661ffb640 1 -- 172.21.15.81:0/2917847508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) ==== 104+0+0 (secure 0 0 0) 0x7ff65009bca0 con 0x7ff664102790 2024-09-12T12:27:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff6540a2cf0 msgr2=0x7ff6540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff6540a2cf0 0x7ff6540a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff658005e10 tx=0x7ff658005da0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 msgr2=0x7ff66419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 0x7ff66419ab30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff65000d950 tx=0x7ff65000de10 comp rx=0 tx=0).stop 2024-09-12T12:27:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 shutdown_connections 2024-09-12T12:27:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7ff6540a2cf0 0x7ff6540a51b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff664106f10 0x7ff66419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff664102790 0x7ff66419ab30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 --2- 172.21.15.81:0/2917847508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff664101de0 0x7ff66419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 >> 172.21.15.81:0/2917847508 conn(0x7ff6640fd8c0 msgr2=0x7ff6640fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 shutdown_connections 2024-09-12T12:27:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:00.237+0000 7ff66afe7640 1 -- 172.21.15.81:0/2917847508 wait complete. 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.81:6838/3776068161,v1:172.21.15.81:6839/3776068161] up:boot 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.81:6840/2143352572,v1:172.21.15.81:6841/2143352572] up:boot 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6832/3684072447,v1:172.21.15.103:6833/3684072447] up:boot 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6832/2825420720,v1:172.21.15.173:6834/2825420720] up:boot 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6833/1826132607,v1:172.21.15.173:6835/1826132607] up:boot 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6834/2742529070,v1:172.21.15.103:6835/2742529070] up:boot 2024-09-12T12:27:00.569 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6836/1513585264,v1:172.21.15.103:6837/1513585264] up:boot 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.103:6838/2091399428,v1:172.21.15.103:6839/2091399428] up:boot 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6837/3639726933,v1:172.21.15.173:6839/3639726933] up:boot 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: mds.? [v2:172.21.15.173:6836/2096129698,v1:172.21.15.173:6838/2096129698] up:boot 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:27:00.570 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:27:00.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:27:00.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:27:00.571 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:00 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2917847508' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:27:00.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.81:6838/3776068161,v1:172.21.15.81:6839/3776068161] up:boot 2024-09-12T12:27:00.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.81:6840/2143352572,v1:172.21.15.81:6841/2143352572] up:boot 2024-09-12T12:27:00.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6832/3684072447,v1:172.21.15.103:6833/3684072447] up:boot 2024-09-12T12:27:00.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6832/2825420720,v1:172.21.15.173:6834/2825420720] up:boot 2024-09-12T12:27:00.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6833/1826132607,v1:172.21.15.173:6835/1826132607] up:boot 2024-09-12T12:27:00.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6834/2742529070,v1:172.21.15.103:6835/2742529070] up:boot 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6836/1513585264,v1:172.21.15.103:6837/1513585264] up:boot 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.103:6838/2091399428,v1:172.21.15.103:6839/2091399428] up:boot 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6837/3639726933,v1:172.21.15.173:6839/3639726933] up:boot 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: mds.? [v2:172.21.15.173:6836/2096129698,v1:172.21.15.173:6838/2096129698] up:boot 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:27:00.655 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:27:00.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:27:00.656 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:00 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2917847508' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:27:00.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.81:6838/3776068161,v1:172.21.15.81:6839/3776068161] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.81:6840/2143352572,v1:172.21.15.81:6841/2143352572] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6832/3684072447,v1:172.21.15.103:6833/3684072447] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6832/2825420720,v1:172.21.15.173:6834/2825420720] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6833/1826132607,v1:172.21.15.173:6835/1826132607] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6834/2742529070,v1:172.21.15.103:6835/2742529070] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6836/1513585264,v1:172.21.15.103:6837/1513585264] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.103:6838/2091399428,v1:172.21.15.103:6839/2091399428] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6837/3639726933,v1:172.21.15.173:6839/3639726933] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: mds.? [v2:172.21.15.173:6836/2096129698,v1:172.21.15.173:6838/2096129698] up:boot 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T12:27:00.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='mgr.15219 172.21.15.81:0/3723494056' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T12:27:00.687 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:00 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2917847508' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T12:27:00.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T12:27:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:01.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:01 smithi081 ceph-mon[30948]: pgmap v329: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-12T12:27:01.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:01 smithi081 ceph-mon[30948]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:27:01.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:01 smithi081 ceph-mon[30948]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:27:01.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:01 smithi081 ceph-mon[30948]: Cluster is now healthy 2024-09-12T12:27:01.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:01 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2917847508' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:27:01.493 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:01 smithi081 ceph-mon[30948]: fsmap 12 up:standby 2024-09-12T12:27:01.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:01 smithi173 ceph-mon[35326]: pgmap v329: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-12T12:27:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:01 smithi173 ceph-mon[35326]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:27:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:01 smithi173 ceph-mon[35326]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:27:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:01 smithi173 ceph-mon[35326]: Cluster is now healthy 2024-09-12T12:27:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:01 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2917847508' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:27:01.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:01 smithi173 ceph-mon[35326]: fsmap 12 up:standby 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 -- 172.21.15.81:0/768108568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0102d40 msgr2=0x7f4cf0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 --2- 172.21.15.81:0/768108568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0102d40 0x7f4cf0103120 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009900 tx=0x7f4cec02a480 comp rx=0 tx=0).stop 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 -- 172.21.15.81:0/768108568 shutdown_connections 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 --2- 172.21.15.81:0/768108568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4cf010c170 0x7f4cf010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 --2- 172.21.15.81:0/768108568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf0103660 0x7f4cf010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 --2- 172.21.15.81:0/768108568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0102d40 0x7f4cf0103120 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 -- 172.21.15.81:0/768108568 >> 172.21.15.81:0/768108568 conn(0x7f4cf00fc7a0 msgr2=0x7f4cf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 -- 172.21.15.81:0/768108568 shutdown_connections 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.674+0000 7f4cf752c640 1 -- 172.21.15.81:0/768108568 wait complete. 2024-09-12T12:27:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 Processor -- start 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 -- start start 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4cf0102d40 0x7f4cf019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 0x7f4cf019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf010c170 0x7f4cf019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0112090 con 0x7f4cf0103660 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0111f10 con 0x7f4cf010c170 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf752c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0112210 con 0x7f4cf0102d40 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf4ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 0x7f4cf019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf4ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 0x7f4cf019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33608/0 (socket says 172.21.15.81:33608) 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf4ac7640 1 -- 172.21.15.81:0/2681778158 learned_addr learned my addr 172.21.15.81:0/2681778158 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.675+0000 7f4cf52c8640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4cf0102d40 0x7f4cf019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf5ac9640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf010c170 0x7f4cf019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf4ac7640 1 -- 172.21.15.81:0/2681778158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4cf0102d40 msgr2=0x7f4cf019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf4ac7640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4cf0102d40 0x7f4cf019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf4ac7640 1 -- 172.21.15.81:0/2681778158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf010c170 msgr2=0x7f4cf019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf4ac7640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf010c170 0x7f4cf019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf4ac7640 1 -- 172.21.15.81:0/2681778158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf019f660 con 0x7f4cf0103660 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf4ac7640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 0x7f4cf019abf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c940 tx=0x7f4ce000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0004220 con 0x7f4cf0103660 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ce00043c0 con 0x7f4cf0103660 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf019f950 con 0x7f4cf0103660 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0004a00 con 0x7f4cf0103660 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.676+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf01a7230 con 0x7f4cf0103660 2024-09-12T12:27:01.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.677+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf0103120 con 0x7f4cf0103660 2024-09-12T12:27:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.678+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f4ce0005140 con 0x7f4cf0103660 2024-09-12T12:27:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.679+0000 7f4ce67fc640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f4cdc0a2d70 0x7f4cdc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.679+0000 7f4cf52c8640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f4cdc0a2d70 0x7f4cdc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.679+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8841+0+0 (secure 0 0 0) 0x7f4ce00cf0b0 con 0x7f4cf0103660 2024-09-12T12:27:01.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.679+0000 7f4cf52c8640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f4cdc0a2d70 0x7f4cdc0a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009230 tx=0x7f4cec0058d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:01 smithi103 ceph-mon[35094]: pgmap v329: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-12T12:27:01.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:01 smithi103 ceph-mon[35094]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T12:27:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:01 smithi103 ceph-mon[35094]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T12:27:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:01 smithi103 ceph-mon[35094]: Cluster is now healthy 2024-09-12T12:27:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:01 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2917847508' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T12:27:01.686 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:01 smithi103 ceph-mon[35094]: fsmap 12 up:standby 2024-09-12T12:27:01.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.683+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ce0014030 con 0x7f4cf0103660 2024-09-12T12:27:01.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:01.853+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4cf01a75c0 con 0x7f4cf0103660 2024-09-12T12:27:02.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.242+0000 7f4ce67fc640 1 -- 172.21.15.81:0/2681778158 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7f4ce009b540 con 0x7f4cf0103660 2024-09-12T12:27:02.243 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-12T12:27:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f4cdc0a2d70 msgr2=0x7f4cdc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f4cdc0a2d70 0x7f4cdc0a5230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009230 tx=0x7f4cec0058d0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 msgr2=0x7f4cf019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 0x7f4cf019abf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c940 tx=0x7f4ce000ce00 comp rx=0 tx=0).stop 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 shutdown_connections 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7f4cdc0a2d70 0x7f4cdc0a5230 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cf010c170 0x7f4cf019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cf0103660 0x7f4cf019abf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 --2- 172.21.15.81:0/2681778158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4cf0102d40 0x7f4cf019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 >> 172.21.15.81:0/2681778158 conn(0x7f4cf00fc7a0 msgr2=0x7f4cf00fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 shutdown_connections 2024-09-12T12:27:02.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:02.245+0000 7f4cf752c640 1 -- 172.21.15.81:0/2681778158 wait complete. 2024-09-12T12:27:02.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:02 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2681778158' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:27:02.507 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:02 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2681778158' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:27:02.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:02 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2681778158' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:27:02.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T12:27:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T12:27:03.553 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:03 smithi081 ceph-mon[30948]: pgmap v330: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.5 KiB/s wr, 23 op/s 2024-09-12T12:27:03.553 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:03 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/2681778158' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:27:03.553 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:03 smithi081 ceph-mon[30948]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:27:03.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:03 smithi173 ceph-mon[35326]: pgmap v330: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.5 KiB/s wr, 23 op/s 2024-09-12T12:27:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:03 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/2681778158' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:27:03.654 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:03 smithi173 ceph-mon[35326]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:27:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:03 smithi103 ceph-mon[35094]: pgmap v330: 97 pgs: 97 active+clean; 83 MiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.5 KiB/s wr, 23 op/s 2024-09-12T12:27:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:03 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/2681778158' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:27:03.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:03 smithi103 ceph-mon[35094]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T12:27:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/2659913864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100500 msgr2=0x7fdb581008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/2659913864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100500 0x7fdb581008e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009900 tx=0x7fdb4802a410 comp rx=0 tx=0).stop 2024-09-12T12:27:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/2659913864 shutdown_connections 2024-09-12T12:27:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/2659913864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb58106f70 0x7fdb5810eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/2659913864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb58100eb0 0x7fdb58106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/2659913864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100500 0x7fdb581008e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/2659913864 >> 172.21.15.81:0/2659913864 conn(0x7fdb580fc5c0 msgr2=0x7fdb580fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/2659913864 shutdown_connections 2024-09-12T12:27:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.699+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/2659913864 wait complete. 2024-09-12T12:27:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 Processor -- start 2024-09-12T12:27:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 -- start start 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb58100500 0x7fdb58101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 0x7fdb581019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb58106f70 0x7fdb58101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581120d0 con 0x7fdb58100eb0 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58111f50 con 0x7fdb58100500 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.700+0000 7fdb5c9fe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58112250 con 0x7fdb58106f70 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 0x7fdb581019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 0x7fdb581019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49546/0 (socket says 172.21.15.81:49546) 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 -- 172.21.15.81:0/811706011 learned_addr learned my addr 172.21.15.81:0/811706011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb5659c640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb58100500 0x7fdb58101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb56d9d640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb58106f70 0x7fdb58101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 -- 172.21.15.81:0/811706011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb58106f70 msgr2=0x7fdb58101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:03.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb58106f70 0x7fdb58101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 -- 172.21.15.81:0/811706011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb58100500 msgr2=0x7fdb58101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb58100500 0x7fdb58101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 -- 172.21.15.81:0/811706011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb581a6ab0 con 0x7fdb58100eb0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4ffff640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 0x7fdb581019c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c970 tx=0x7fdb4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004220 con 0x7fdb58100eb0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb581a6da0 con 0x7fdb58100eb0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdb400043c0 con 0x7fdb58100eb0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004a00 con 0x7fdb58100eb0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.701+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581a7250 con 0x7fdb58100eb0 2024-09-12T12:27:03.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.702+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb581008e0 con 0x7fdb58100eb0 2024-09-12T12:27:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.704+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdb40004be0 con 0x7fdb58100eb0 2024-09-12T12:27:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.704+0000 7fdb4f7fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdb440a2cf0 0x7fdb440a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T12:27:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.704+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8345+0+0 (secure 0 0 0) 0x7fdb400cf440 con 0x7fdb58100eb0 2024-09-12T12:27:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.704+0000 7fdb5659c640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdb440a2cf0 0x7fdb440a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T12:27:03.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.705+0000 7fdb5659c640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdb440a2cf0 0x7fdb440a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb48004770 tx=0x7fdb480058d0 comp rx=0 tx=0).ready entity=mgr.15219 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T12:27:03.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.707+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb40014030 con 0x7fdb58100eb0 2024-09-12T12:27:03.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:03.875+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb581029b0 con 0x7fdb58100eb0 2024-09-12T12:27:04.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.356+0000 7fdb4f7fe640 1 -- 172.21.15.81:0/811706011 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7fdb581029b0 con 0x7fdb58100eb0 2024-09-12T12:27:04.356 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-12T12:27:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.359+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdb440a2cf0 msgr2=0x7fdb440a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.359+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdb440a2cf0 0x7fdb440a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb48004770 tx=0x7fdb480058d0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.359+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 msgr2=0x7fdb581019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T12:27:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.359+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 0x7fdb581019c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c970 tx=0x7fdb4000ce30 comp rx=0 tx=0).stop 2024-09-12T12:27:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 shutdown_connections 2024-09-12T12:27:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:6800/96268870,v1:172.21.15.81:6801/96268870] conn(0x7fdb440a2cf0 0x7fdb440a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb58106f70 0x7fdb58101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58100eb0 0x7fdb581019c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 --2- 172.21.15.81:0/811706011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb58100500 0x7fdb58101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T12:27:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 >> 172.21.15.81:0/811706011 conn(0x7fdb580fc5c0 msgr2=0x7fdb581057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T12:27:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 shutdown_connections 2024-09-12T12:27:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-12T12:27:04.360+0000 7fdb5c9fe640 1 -- 172.21.15.81:0/811706011 wait complete. 2024-09-12T12:27:04.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:04 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/811706011' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:27:04.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:04 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/811706011' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:27:04.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:04 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/811706011' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T12:27:04.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:27:05.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:27:05.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:27:05.085 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T12:27:05.086 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:27:05.101 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:27:05.117 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T12:27:05.141 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T12:27:05.142 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T12:27:05.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a 2024-09-12T12:27:05.357 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 systemd[1]: Stopping Ceph mon.a for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:05.609 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 ceph-mon[30948]: pgmap v332: 65 pgs: 65 active+clean; 577 KiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:27:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 ceph-mon[30948]: from='client.? 172.21.15.81:0/811706011' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:27:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 ceph-mon[30948]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:27:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a[30944]: 2024-09-12T12:27:05.457+0000 7f79f2f27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a[30944]: 2024-09-12T12:27:05.457+0000 7f79f2f27640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T12:27:05.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 podman[92032]: 2024-09-12 12:27:05.529449776 +0000 UTC m=+0.202599540 container died 7a932bbc29bfb216e90a65f40df06f5666b3b3350911f873b2d9209bc939f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:05 smithi173 ceph-mon[35326]: pgmap v332: 65 pgs: 65 active+clean; 577 KiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:27:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:05 smithi173 ceph-mon[35326]: from='client.? 172.21.15.81:0/811706011' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:27:05.653 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:05 smithi173 ceph-mon[35326]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:27:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:05 smithi103 ceph-mon[35094]: pgmap v332: 65 pgs: 65 active+clean; 577 KiB data, 1011 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T12:27:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:05 smithi103 ceph-mon[35094]: from='client.? 172.21.15.81:0/811706011' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T12:27:05.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:05 smithi103 ceph-mon[35094]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T12:27:06.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 podman[92032]: 2024-09-12 12:27:05.88260971 +0000 UTC m=+0.555759470 container cleanup 7a932bbc29bfb216e90a65f40df06f5666b3b3350911f873b2d9209bc939f3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:06.110 INFO:journalctl@ceph.mon.a.smithi081.stdout:Sep 12 12:27:05 smithi081 bash[92032]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-a 2024-09-12T12:27:06.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T12:27:06.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:06.406 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T12:27:06.406 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T12:27:06.406 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.b 2024-09-12T12:27:06.685 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:06 smithi103 systemd[1]: Stopping Ceph mon.b for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:07.149 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-b[35090]: 2024-09-12T12:27:06.756+0000 7f9e57f33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:07.149 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-b[35090]: 2024-09-12T12:27:06.756+0000 7f9e57f33640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T12:27:07.150 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:06 smithi103 podman[70452]: 2024-09-12 12:27:06.870331666 +0000 UTC m=+0.259506167 container died 97a24c01293c257f2256e5b6647307f4b42b478865a64ef612910847712b976a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T12:27:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:07 smithi103 podman[70452]: 2024-09-12 12:27:07.274094008 +0000 UTC m=+0.663268499 container cleanup 97a24c01293c257f2256e5b6647307f4b42b478865a64ef612910847712b976a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T12:27:07.435 INFO:journalctl@ceph.mon.b.smithi103.stdout:Sep 12 12:27:07 smithi103 bash[70452]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-b 2024-09-12T12:27:07.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T12:27:07.738 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:07.738 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T12:27:07.739 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T12:27:07.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.c 2024-09-12T12:27:08.056 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:07 smithi173 systemd[1]: Stopping Ceph mon.c for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-c[35322]: 2024-09-12T12:27:08.055+0000 7fc4cd7c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-c[35322]: 2024-09-12T12:27:08.055+0000 7fc4cd7c7640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T12:27:08.403 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:08 smithi173 podman[70953]: 2024-09-12 12:27:08.219319902 +0000 UTC m=+0.281525544 container died 7a8df5e459ade7543bbfb544661b0d209081a03d909307cea0426ccd29bf77ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T12:27:08.866 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:08 smithi173 podman[70953]: 2024-09-12 12:27:08.581009787 +0000 UTC m=+0.643215434 container cleanup 7a8df5e459ade7543bbfb544661b0d209081a03d909307cea0426ccd29bf77ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-c, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-12T12:27:08.866 INFO:journalctl@ceph.mon.c.smithi173.stdout:Sep 12 12:27:08 smithi173 bash[70953]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mon-c 2024-09-12T12:27:09.015 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T12:27:09.062 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:09.063 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T12:27:09.063 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T12:27:09.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x 2024-09-12T12:27:09.360 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:27:09 smithi081 systemd[1]: Stopping Ceph mgr.x for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:09.688 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:27:09 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:27:09.387+0000 7f4ef88ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:09.688 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:27:09 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x[31176]: 2024-09-12T12:27:09.387+0000 7f4ef88ed640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T12:27:09.688 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:27:09 smithi081 podman[92155]: 2024-09-12 12:27:09.419220031 +0000 UTC m=+0.159356784 container died 100e314494c1f6424dbad09ed1161451ed20cd9bcfc0b0dd78253ce1d1ab6a73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:27:10.081 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:27:09 smithi081 podman[92155]: 2024-09-12 12:27:09.796373797 +0000 UTC m=+0.536510533 container cleanup 100e314494c1f6424dbad09ed1161451ed20cd9bcfc0b0dd78253ce1d1ab6a73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T12:27:10.081 INFO:journalctl@ceph.mgr.x.smithi081.stdout:Sep 12 12:27:09 smithi081 bash[92155]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-x 2024-09-12T12:27:10.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T12:27:10.254 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:10.254 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T12:27:10.254 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T12:27:10.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.y 2024-09-12T12:27:10.574 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:27:10 smithi103 systemd[1]: Stopping Ceph mgr.y for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:10.879 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:27:10 smithi103 podman[70577]: 2024-09-12 12:27:10.574842857 +0000 UTC m=+0.123107388 container died 6b5607096053cb1219b6980b0caf088f4ed7a3b1059aa096e285eb07cc9cb033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T12:27:11.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:27:11 smithi103 podman[70577]: 2024-09-12 12:27:11.004246635 +0000 UTC m=+0.552511158 container cleanup 6b5607096053cb1219b6980b0caf088f4ed7a3b1059aa096e285eb07cc9cb033 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T12:27:11.185 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Sep 12 12:27:11 smithi103 bash[70577]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-y 2024-09-12T12:27:11.436 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T12:27:11.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:11.471 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T12:27:11.471 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T12:27:11.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.z 2024-09-12T12:27:11.823 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:27:11 smithi173 systemd[1]: Stopping Ceph mgr.z for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:12.112 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:27:11 smithi173 podman[71074]: 2024-09-12 12:27:11.823631547 +0000 UTC m=+0.161000062 container died 5738d836e6b9e02ad5e47601ec290f1a239da559a71c335a53e45c37bfc0c4d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T12:27:12.403 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:27:12 smithi173 podman[71074]: 2024-09-12 12:27:12.203265915 +0000 UTC m=+0.540634415 container cleanup 5738d836e6b9e02ad5e47601ec290f1a239da559a71c335a53e45c37bfc0c4d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T12:27:12.403 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Sep 12 12:27:12 smithi173 bash[71074]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mgr-z 2024-09-12T12:27:12.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T12:27:12.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:12.581 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T12:27:12.581 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T12:27:12.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.0 2024-09-12T12:27:12.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:12 smithi081 systemd[1]: Stopping Ceph osd.0 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:13.360 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0[44399]: 2024-09-12T12:27:12.875+0000 7f79f2987640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:13.360 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0[44399]: 2024-09-12T12:27:12.875+0000 7f79f2987640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-12T12:27:13.360 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0[44399]: 2024-09-12T12:27:12.875+0000 7f79f2987640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:27:18.578 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:18 smithi081 podman[92277]: 2024-09-12 12:27:18.30574069 +0000 UTC m=+5.521085707 container died 0f433ba0a03519401c0c052a8a8ddd79b23bb8efe0905144699acaa644d633e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T12:27:18.859 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:18 smithi081 podman[92277]: 2024-09-12 12:27:18.676328762 +0000 UTC m=+5.891673778 container cleanup 0f433ba0a03519401c0c052a8a8ddd79b23bb8efe0905144699acaa644d633e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T12:27:18.859 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:18 smithi081 bash[92277]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0 2024-09-12T12:27:19.256 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:18 smithi081 podman[92293]: 2024-09-12 12:27:18.944325912 +0000 UTC m=+0.635162008 container remove 0f433ba0a03519401c0c052a8a8ddd79b23bb8efe0905144699acaa644d633e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T12:27:19.547 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:19 smithi081 podman[92383]: 2024-09-12 12:27:19.159308539 +0000 UTC m=+0.015902295 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:27:19.547 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:19 smithi081 podman[92383]: 2024-09-12 12:27:19.26174853 +0000 UTC m=+0.118342272 container create f26a0d263e5adbc1928897734158451ae31b8420c3fb30c7bb1177864b41c4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:27:19.547 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:19 smithi081 podman[92383]: 2024-09-12 12:27:19.547954445 +0000 UTC m=+0.404548188 container init f26a0d263e5adbc1928897734158451ae31b8420c3fb30c7bb1177864b41c4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T12:27:19.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:19 smithi081 podman[92383]: 2024-09-12 12:27:19.551452294 +0000 UTC m=+0.408046038 container start f26a0d263e5adbc1928897734158451ae31b8420c3fb30c7bb1177864b41c4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:19.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:19 smithi081 podman[92383]: 2024-09-12 12:27:19.639559978 +0000 UTC m=+0.496153737 container attach f26a0d263e5adbc1928897734158451ae31b8420c3fb30c7bb1177864b41c4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T12:27:19.860 INFO:journalctl@ceph.osd.0.smithi081.stdout:Sep 12 12:27:19 smithi081 podman[92383]: 2024-09-12 12:27:19.749059112 +0000 UTC m=+0.605652856 container died f26a0d263e5adbc1928897734158451ae31b8420c3fb30c7bb1177864b41c4a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T12:27:20.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T12:27:20.434 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:20.434 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T12:27:20.434 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T12:27:20.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.1 2024-09-12T12:27:20.741 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:20 smithi103 systemd[1]: Stopping Ceph osd.1 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:20.743 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1[39585]: 2024-09-12T12:27:20.741+0000 7fd38660f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:21.185 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1[39585]: 2024-09-12T12:27:20.741+0000 7fd38660f640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-12T12:27:21.185 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1[39585]: 2024-09-12T12:27:20.741+0000 7fd38660f640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:27:26.435 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:26 smithi103 podman[70703]: 2024-09-12 12:27:26.181688952 +0000 UTC m=+5.551431588 container died 16cdeef1659207cfe91281fed9908a88c19827a1b41412e7100286fe24a30ff5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T12:27:26.834 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:26 smithi103 podman[70703]: 2024-09-12 12:27:26.566611452 +0000 UTC m=+5.936354079 container cleanup 16cdeef1659207cfe91281fed9908a88c19827a1b41412e7100286fe24a30ff5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T12:27:26.834 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:26 smithi103 bash[70703]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1 2024-09-12T12:27:27.185 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:26 smithi103 podman[70718]: 2024-09-12 12:27:26.834873648 +0000 UTC m=+0.654123216 container remove 16cdeef1659207cfe91281fed9908a88c19827a1b41412e7100286fe24a30ff5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T12:27:27.446 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:27 smithi103 podman[70806]: 2024-09-12 12:27:27.096111927 +0000 UTC m=+0.016024417 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:27:27.446 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:27 smithi103 podman[70806]: 2024-09-12 12:27:27.244512369 +0000 UTC m=+0.164424851 container create c2bc4de18bccfcdcd88fd7ea4359e0d6fc5c87f0e29dab8ce0b2b9bff5da4684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:27.446 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:27 smithi103 podman[70806]: 2024-09-12 12:27:27.44687437 +0000 UTC m=+0.366786859 container init c2bc4de18bccfcdcd88fd7ea4359e0d6fc5c87f0e29dab8ce0b2b9bff5da4684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:27:27.934 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:27 smithi103 podman[70806]: 2024-09-12 12:27:27.450231609 +0000 UTC m=+0.370144089 container start c2bc4de18bccfcdcd88fd7ea4359e0d6fc5c87f0e29dab8ce0b2b9bff5da4684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:27.934 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:27 smithi103 podman[70806]: 2024-09-12 12:27:27.530214972 +0000 UTC m=+0.450127467 container attach c2bc4de18bccfcdcd88fd7ea4359e0d6fc5c87f0e29dab8ce0b2b9bff5da4684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:27.934 INFO:journalctl@ceph.osd.1.smithi103.stdout:Sep 12 12:27:27 smithi103 podman[70806]: 2024-09-12 12:27:27.636125963 +0000 UTC m=+0.556038451 container died c2bc4de18bccfcdcd88fd7ea4359e0d6fc5c87f0e29dab8ce0b2b9bff5da4684 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:27:28.244 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T12:27:28.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:28.286 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T12:27:28.286 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T12:27:28.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.2 2024-09-12T12:27:28.590 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:28 smithi173 systemd[1]: Stopping Ceph osd.2 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:28.903 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2[40297]: 2024-09-12T12:27:28.590+0000 7fa3c1dd5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:28.903 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2[40297]: 2024-09-12T12:27:28.590+0000 7fa3c1dd5640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-12T12:27:28.903 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2[40297]: 2024-09-12T12:27:28.590+0000 7fa3c1dd5640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:27:34.298 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:33 smithi173 podman[71200]: 2024-09-12 12:27:33.983785038 +0000 UTC m=+5.503618682 container died 2f78740efd823bb255e7172bb4af6f82e0c53a43d44b27d9187aeedc320d725b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-12T12:27:34.653 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:34 smithi173 podman[71200]: 2024-09-12 12:27:34.298896172 +0000 UTC m=+5.818729824 container cleanup 2f78740efd823bb255e7172bb4af6f82e0c53a43d44b27d9187aeedc320d725b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-12T12:27:34.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:34 smithi173 bash[71200]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2 2024-09-12T12:27:34.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:34 smithi173 podman[71217]: 2024-09-12 12:27:34.475496398 +0000 UTC m=+0.485643032 container remove 2f78740efd823bb255e7172bb4af6f82e0c53a43d44b27d9187aeedc320d725b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T12:27:35.170 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:34 smithi173 podman[71302]: 2024-09-12 12:27:34.814501709 +0000 UTC m=+0.016207392 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:27:35.170 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:34 smithi173 podman[71302]: 2024-09-12 12:27:34.934949778 +0000 UTC m=+0.136655491 container create 1bb120f2aeb10cbee9daa433c469efc8bea8d8af9a302d8bc5e4f742e7f058e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T12:27:35.653 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 podman[71302]: 2024-09-12 12:27:35.170593089 +0000 UTC m=+0.372298763 container init 1bb120f2aeb10cbee9daa433c469efc8bea8d8af9a302d8bc5e4f742e7f058e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:35.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 podman[71302]: 2024-09-12 12:27:35.173961964 +0000 UTC m=+0.375667635 container start 1bb120f2aeb10cbee9daa433c469efc8bea8d8af9a302d8bc5e4f742e7f058e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:35.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 podman[71302]: 2024-09-12 12:27:35.270720841 +0000 UTC m=+0.472426522 container attach 1bb120f2aeb10cbee9daa433c469efc8bea8d8af9a302d8bc5e4f742e7f058e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:35.654 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 podman[71302]: 2024-09-12 12:27:35.360507242 +0000 UTC m=+0.562212927 container died 1bb120f2aeb10cbee9daa433c469efc8bea8d8af9a302d8bc5e4f742e7f058e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:35.970 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T12:27:35.994 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 podman[71324]: 2024-09-12 12:27:35.94990769 +0000 UTC m=+0.580131821 container remove 1bb120f2aeb10cbee9daa433c469efc8bea8d8af9a302d8bc5e4f742e7f058e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:27:35.994 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 systemd[1]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-12T12:27:35.994 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 systemd[1]: Stopped Ceph osd.2 for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:27:35.995 INFO:journalctl@ceph.osd.2.smithi173.stdout:Sep 12 12:27:35 smithi173 systemd[1]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.2.service: Consumed 25.693s CPU time. 2024-09-12T12:27:36.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:36.010 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T12:27:36.010 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T12:27:36.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.3 2024-09-12T12:27:36.326 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:36 smithi081 systemd[1]: Stopping Ceph osd.3 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:36.610 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:36 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3[51331]: 2024-09-12T12:27:36.325+0000 7f504f82a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:36.610 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:36 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3[51331]: 2024-09-12T12:27:36.325+0000 7f504f82a640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-12T12:27:36.610 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:36 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3[51331]: 2024-09-12T12:27:36.325+0000 7f504f82a640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:27:39.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:39 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:39.294+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:39.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:39.546+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:40.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:39 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:39.739+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:40.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:40 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:40.262+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:40.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:40.587+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:41.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:40 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:40.728+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:41.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:41 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:41.234+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:41.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:41.634+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:42.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:41 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:41.701+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:42.110 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:41 smithi081 podman[92502]: 2024-09-12 12:27:41.847626268 +0000 UTC m=+5.635122092 container died 418ee817528d373179ddf1ae5255a21f1bb64586ffb088d4817b203e867b3099 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T12:27:42.505 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:42 smithi081 podman[92502]: 2024-09-12 12:27:42.196589063 +0000 UTC m=+5.984084926 container cleanup 418ee817528d373179ddf1ae5255a21f1bb64586ffb088d4817b203e867b3099 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T12:27:42.506 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:42 smithi081 bash[92502]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3 2024-09-12T12:27:42.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:42 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:42.283+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:42.859 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:42 smithi081 podman[92518]: 2024-09-12 12:27:42.506281959 +0000 UTC m=+0.654423459 container remove 418ee817528d373179ddf1ae5255a21f1bb64586ffb088d4817b203e867b3099 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-12T12:27:42.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:42 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:42.734+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:42.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:42 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:42.614+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:43.121 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:42 smithi081 podman[92610]: 2024-09-12 12:27:42.77193289 +0000 UTC m=+0.016316866 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:27:43.121 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:42 smithi081 podman[92610]: 2024-09-12 12:27:42.882073535 +0000 UTC m=+0.126457506 container create 3cb7ebf5c0179b4bb9f3fcecfcab8d77e6b75832b5c33a2ad2893bea0f5f6bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T12:27:43.121 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:43 smithi081 podman[92610]: 2024-09-12 12:27:43.117813357 +0000 UTC m=+0.362197326 container init 3cb7ebf5c0179b4bb9f3fcecfcab8d77e6b75832b5c33a2ad2893bea0f5f6bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:27:43.121 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:43 smithi081 podman[92610]: 2024-09-12 12:27:43.121456788 +0000 UTC m=+0.365840760 container start 3cb7ebf5c0179b4bb9f3fcecfcab8d77e6b75832b5c33a2ad2893bea0f5f6bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T12:27:43.596 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:43 smithi081 podman[92610]: 2024-09-12 12:27:43.217959827 +0000 UTC m=+0.462343806 container attach 3cb7ebf5c0179b4bb9f3fcecfcab8d77e6b75832b5c33a2ad2893bea0f5f6bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:27:43.596 INFO:journalctl@ceph.osd.3.smithi081.stdout:Sep 12 12:27:43 smithi081 podman[92610]: 2024-09-12 12:27:43.306033188 +0000 UTC m=+0.550417157 container died 3cb7ebf5c0179b4bb9f3fcecfcab8d77e6b75832b5c33a2ad2893bea0f5f6bae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T12:27:43.614 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:43.358+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:43.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:43 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:43.250+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:43.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:43.716+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:43.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:43 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:43.616+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:43.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:43.614+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:43.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T12:27:43.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:43.957 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T12:27:43.957 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T12:27:43.957 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.4 2024-09-12T12:27:44.286 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:44 smithi103 systemd[1]: Stopping Ceph osd.4 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:44.287 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:44 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:44.233+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:44.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:44.344+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:44.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:44 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:44.581+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:44.685 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:44 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:27:44.286+0000 7fb74e9ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:44.685 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:44 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:27:44.286+0000 7fb74e9ed640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-12T12:27:44.685 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:44 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:27:44.286+0000 7fb74e9ed640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:27:45.010 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:44 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:44.746+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:45.011 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:44 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:44.663+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:45.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:45.341+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:45.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:45 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:45.545+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:45.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:45 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:45.253+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:46.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:45 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:45.758+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:46.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:45 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:45.649+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:46.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:46 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:46.552+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:46.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:46 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:46.350+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:46.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:46.248+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:47.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:46.803+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:47.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:46.691+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:47.185 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:46 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:27:46.784+0000 7fb74aff2640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.852902+0000 front 2024-09-12T12:27:20.852771+0000 (oldest deadline 2024-09-12T12:27:46.753007+0000) 2024-09-12T12:27:47.539 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:47.340+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:47.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:47.292+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:47.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:47.539+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:47.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:47 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:47.539+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:48.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:47.757+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:48.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:47.710+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:48.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:47 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:47.710+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:48.185 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:47 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:27:47.752+0000 7fb74aff2640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.852902+0000 front 2024-09-12T12:27:20.852771+0000 (oldest deadline 2024-09-12T12:27:46.753007+0000) 2024-09-12T12:27:48.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:48.575+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:48.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:48.575+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:48.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:48 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:48.365+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:48.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:48 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:48.340+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:48.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:48 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:48.560+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:49.011 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:48.761+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:49.011 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:48.730+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:49.011 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:48 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:48.730+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:49.185 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:48 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4[46359]: 2024-09-12T12:27:48.704+0000 7fb74aff2640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.852902+0000 front 2024-09-12T12:27:20.852771+0000 (oldest deadline 2024-09-12T12:27:46.753007+0000) 2024-09-12T12:27:49.610 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:49.348+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:49.610 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:49.348+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:49.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:49 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:49.560+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:49.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:49 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:49.560+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:49.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:49 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:49.357+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:49.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:49 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:49.357+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:49.935 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:49 smithi103 podman[70920]: 2024-09-12 12:27:49.794121928 +0000 UTC m=+5.635919568 container died d1dbd82e6416ac834da4edd1cba0bc1eaf897365724aba74ea8f1afaac145261 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:49.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:49 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:49.608+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:50.022 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:49.741+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:50.023 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:49.771+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:50.023 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:49 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:49.771+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:50.370 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:50 smithi103 podman[70920]: 2024-09-12 12:27:50.17847259 +0000 UTC m=+6.020270224 container cleanup d1dbd82e6416ac834da4edd1cba0bc1eaf897365724aba74ea8f1afaac145261 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T12:27:50.370 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:50 smithi103 bash[70920]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4 2024-09-12T12:27:50.646 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:50 smithi103 podman[70936]: 2024-09-12 12:27:50.462843034 +0000 UTC m=+0.661785674 container remove d1dbd82e6416ac834da4edd1cba0bc1eaf897365724aba74ea8f1afaac145261 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4, ceph=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-12T12:27:50.646 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:50.370+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:50.647 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:50.370+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:50.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:50 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:50.340+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:50.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:50 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:50.340+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:50.654 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:50 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:50.584+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:50.654 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:50 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:50.584+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:50.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:50 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:50.403+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:50.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:50 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:50.645+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:50.936 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:50 smithi103 podman[71023]: 2024-09-12 12:27:50.707857715 +0000 UTC m=+0.015645511 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:27:50.936 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:50 smithi103 podman[71023]: 2024-09-12 12:27:50.838764763 +0000 UTC m=+0.146552555 container create 2b757279662523c568acef7aabf1c3265b00ddad3ced2c87d1549665880d703c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T12:27:51.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:50 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:50.729+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:51.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:50 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:50.729+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:51.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:50 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:50.732+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:51.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:50 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:50.732+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:51.242 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:51 smithi103 podman[71023]: 2024-09-12 12:27:51.05006616 +0000 UTC m=+0.357853961 container init 2b757279662523c568acef7aabf1c3265b00ddad3ced2c87d1549665880d703c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T12:27:51.243 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:51 smithi103 podman[71023]: 2024-09-12 12:27:51.053584426 +0000 UTC m=+0.361372221 container start 2b757279662523c568acef7aabf1c3265b00ddad3ced2c87d1549665880d703c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T12:27:51.243 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:51 smithi103 podman[71023]: 2024-09-12 12:27:51.132911583 +0000 UTC m=+0.440699394 container attach 2b757279662523c568acef7aabf1c3265b00ddad3ced2c87d1549665880d703c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T12:27:51.526 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 12 12:27:51 smithi103 podman[71023]: 2024-09-12 12:27:51.243902391 +0000 UTC m=+0.551690184 container died 2b757279662523c568acef7aabf1c3265b00ddad3ced2c87d1549665880d703c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T12:27:51.527 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:51 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:51.402+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:51.527 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:51 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:51.402+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:51.609 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:51 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:51.434+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:51.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:51 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:51.326+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:51.609 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:51 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:51.326+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:51.794 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:51 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:51.654+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:51.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T12:27:51.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:51.859 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T12:27:51.859 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T12:27:51.860 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.5 2024-09-12T12:27:51.888 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:51 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:51.608+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:51.888 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:51 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:51.608+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:52.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:51 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:51.761+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:52.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:51 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:51.761+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:52.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:51 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:51.718+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:52.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:51 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:51.718+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:52.153 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:51 smithi173 systemd[1]: Stopping Ceph osd.5 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:52.574 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:52.386+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:52.574 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:52.290+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:52.574 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:52.290+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:52.574 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:52.168+0000 7f449e1a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:27:52.575 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:52.168+0000 7f449e1a4640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-12T12:27:52.575 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:52.168+0000 7f449e1a4640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:27:52.575 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:52.574+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:52.575 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:52 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:52.574+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:52.663 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:52 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:52.387+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:52.663 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:52 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:52.387+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:52.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:52 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:52.663+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:53.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:52 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:52.717+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:53.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:52 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:52.717+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:53.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:52 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:52.698+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:53.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:52 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:52.698+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:53.544 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:53 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:53.395+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:53.544 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:53 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:53.287+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:53.545 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:53 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:53.287+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:53.622 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:53 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:53.341+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:53.622 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:53 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:53.341+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:53.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:53 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:53.544+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:53.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:53 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:53.544+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:53.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:53 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:53.621+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:54.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:53 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:53.714+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:54.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:53 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:53.714+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:54.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:53 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:53.689+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:54.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:53 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:53.689+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:54.535 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:54 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:54.399+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:54.535 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:54 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:54.278+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:54.536 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:54 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:54.278+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:54.588 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:54 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:54.330+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:54.588 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:54 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:54.330+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:54.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:54 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:54.536+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:54.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:54 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:54.536+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:54.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:54 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:54.588+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:55.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:54 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:54.744+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:55.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:54 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:54.744+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:55.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:54 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:54.681+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:55.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:54 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:54.681+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:55.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:55 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:55.378+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:55.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:55 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:55.301+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:55.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:55 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:55.301+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:55.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:55 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:55.301+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:27:55.654 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:55 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:55.497+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:55.654 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:55 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:55.497+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:55.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:55 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:55.547+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:55.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:55 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:55.365+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:55.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:55 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:55.365+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:56.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:55 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:55.786+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:56.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:55 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:55.786+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:56.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:55 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:55.651+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:56.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:55 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:55.651+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:56.653 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:56.535+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.453297+0000 front 2024-09-12T12:27:17.453270+0000 (oldest deadline 2024-09-12T12:27:38.553151+0000) 2024-09-12T12:27:56.654 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5[46817]: 2024-09-12T12:27:56.535+0000 7f449a7a9640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.355024+0000 front 2024-09-12T12:27:21.355107+0000 (oldest deadline 2024-09-12T12:27:46.655115+0000) 2024-09-12T12:27:56.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:56.370+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:56.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:56.370+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:27:56.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:56.324+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:56.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:56.324+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:56.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:56 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:56.324+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:27:56.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:56 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:56.582+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:56.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:56 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:56.582+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:27:56.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:56 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:56.406+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:56.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:56 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:56.406+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:57.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:56 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:56.768+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:57.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:56 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:56.768+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:57.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:56 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:56.649+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:57.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:56 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:56.649+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:57.652 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:57 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:57.353+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:57.652 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:57 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:57.353+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:27:57.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:57 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:57.326+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:57.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:57 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:57.326+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:57.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:57 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:57.326+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:27:57.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:57 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:57.606+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:57.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:57 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:57.606+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:27:57.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:57 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:57.379+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:57.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:57 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:57.379+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:57.903 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:57 smithi173 podman[71416]: 2024-09-12 12:27:57.652095679 +0000 UTC m=+5.589433675 container died 013233dbd6a18fd0b4e271e0a5cd390576bd7168d53506cbe08a70ee4988d8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:58.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:57 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:57.776+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:58.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:57 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:57.776+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:58.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:57 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:57.662+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:58.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:57 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:57.662+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:58.170 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:57 smithi173 podman[71416]: 2024-09-12 12:27:57.977522037 +0000 UTC m=+5.914860040 container cleanup 013233dbd6a18fd0b4e271e0a5cd390576bd7168d53506cbe08a70ee4988d8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:27:58.170 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:57 smithi173 bash[71416]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5 2024-09-12T12:27:58.571 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:58 smithi173 podman[71431]: 2024-09-12 12:27:58.170479925 +0000 UTC m=+0.511249222 container remove 013233dbd6a18fd0b4e271e0a5cd390576bd7168d53506cbe08a70ee4988d8e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:27:58.571 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:58.347+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:58.572 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:58.347+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:27:58.572 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:58.349+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:58.572 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:58.349+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:58.572 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:58 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:58.349+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:27:58.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:58.605+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:58.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:58.605+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:27:58.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:58.419+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:58.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:58.419+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:58.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:58 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:58.419+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:27:58.840 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:58 smithi173 podman[71521]: 2024-09-12 12:27:58.571471878 +0000 UTC m=+0.112347870 container create 00949e9eba3d8f90f9ff9633366f0292e3c511d59d548d76b3d4932afe535439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:27:58.840 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:58 smithi173 podman[71521]: 2024-09-12 12:27:58.475158086 +0000 UTC m=+0.016034050 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:27:58.840 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:58 smithi173 podman[71521]: 2024-09-12 12:27:58.840935402 +0000 UTC m=+0.381811356 container init 00949e9eba3d8f90f9ff9633366f0292e3c511d59d548d76b3d4932afe535439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T12:27:59.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:58.802+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:59.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:58.802+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:59.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:58.802+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:27:59.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:58.614+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:59.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:58.614+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:59.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:58 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:58.614+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:27:59.153 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:58 smithi173 podman[71521]: 2024-09-12 12:27:58.844648387 +0000 UTC m=+0.385524345 container start 00949e9eba3d8f90f9ff9633366f0292e3c511d59d548d76b3d4932afe535439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T12:27:59.154 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:58 smithi173 podman[71521]: 2024-09-12 12:27:58.932499538 +0000 UTC m=+0.473375507 container attach 00949e9eba3d8f90f9ff9633366f0292e3c511d59d548d76b3d4932afe535439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:27:59.154 INFO:journalctl@ceph.osd.5.smithi173.stdout:Sep 12 12:27:59 smithi173 podman[71521]: 2024-09-12 12:27:59.032851561 +0000 UTC m=+0.573727525 container died 00949e9eba3d8f90f9ff9633366f0292e3c511d59d548d76b3d4932afe535439 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T12:27:59.652 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:59 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:59.363+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:27:59.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:27:59 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:27:59.363+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:27:59.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:59 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:59.390+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:27:59.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:59 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:59.390+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:27:59.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:27:59 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:27:59.390+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:27:59.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T12:27:59.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:59 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:59.560+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:27:59.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:27:59 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:27:59.560+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:27:59.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:59 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:59.380+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:27:59.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:59 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:59.380+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:27:59.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:27:59 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:27:59.380+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:27:59.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:27:59.752 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T12:27:59.752 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T12:27:59.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.6 2024-09-12T12:27:59.859 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:59.796+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:27:59.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:59.796+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:27:59.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:27:59.796+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:27:59.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:27:59 smithi081 systemd[1]: Stopping Ceph osd.6 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:27:59.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:59.605+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:27:59.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:59.605+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:27:59.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:27:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:27:59.605+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:00.359 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:00.061+0000 7fc3eca1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:00.360 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:00.061+0000 7fc3eca1b640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-12T12:28:00.360 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:00.061+0000 7fc3eca1b640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:28:00.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:00 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:00.337+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:00.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:00 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:00.337+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:00.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:00 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:00.369+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:00.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:00 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:00.369+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:00.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:00 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:00.369+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:00.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:00 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:00.529+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:00.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:00 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:00.529+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:00.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:00 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:00.366+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:00.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:00 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:00.366+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:00.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:00 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:00.366+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:00.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:00.755+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:28:00.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:00.755+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:28:00.860 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:00.755+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:28:00.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:00.584+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:00.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:00.584+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:00.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:00 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:00.584+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:01.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:01 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:01.331+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:01.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:01 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:01.331+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:01.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:01 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:01.380+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:01.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:01 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:01.380+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:01.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:01 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:01.380+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:01.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:01 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:01.506+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:01.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:01 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:01.506+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:01.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:01 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:01.343+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:01.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:01 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:01.343+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:01.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:01 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:01.343+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:02.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:01 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:01.802+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:28:02.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:01 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:01.802+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:28:02.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:01 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:01.802+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:28:02.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:01 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:01.622+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:02.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:01 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:01.622+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:02.111 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:01 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:01.622+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:02.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:02 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:02.339+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:02.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:02 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:02.339+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:02.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:02 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:02.371+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:02.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:02 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:02.371+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:02.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:02 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:02.371+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:02.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:02 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:02.489+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:02.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:02 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:02.489+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:02.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:02 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:02.368+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:02.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:02 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:02.368+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:02.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:02 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:02.368+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:03.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:02.766+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:02.766+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:02.766+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:02.766+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.809818+0000 front 2024-09-12T12:27:39.809848+0000 (oldest deadline 2024-09-12T12:28:02.709935+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:02.626+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:02.626+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:02.626+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:03.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:02 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:02.626+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:03.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:03.314+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:03.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:03.314+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:03.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:03.323+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:03.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:03.323+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:03.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:03 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:03.323+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:03.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:03 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:03.462+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:03.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:03 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:03.462+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:03.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:03 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:03.358+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:03.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:03 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:03.358+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:03.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:03 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:03.358+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:04.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:03.800+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:28:04.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:03.800+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:28:04.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:03.800+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:28:04.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:03.800+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.809818+0000 front 2024-09-12T12:27:39.809848+0000 (oldest deadline 2024-09-12T12:28:02.709935+0000) 2024-09-12T12:28:04.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:03.612+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:04.111 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:03.612+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:04.111 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:03.612+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:04.111 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:03 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:03.612+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:04.555 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:04 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:04.287+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:04.555 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:04 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:04.287+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:04.555 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:04 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:04.287+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:04.556 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:04 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:04.354+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:04.556 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:04 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:04.354+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:04.556 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:04 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:04.354+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:04.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:04.455+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:04.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:04.455+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:04.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:04.346+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:04.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:04.346+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:04.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:04.346+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:04.788+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:13.605858+0000 front 2024-09-12T12:27:13.605650+0000 (oldest deadline 2024-09-12T12:27:39.505811+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:04.788+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:21.206935+0000 front 2024-09-12T12:27:21.206819+0000 (oldest deadline 2024-09-12T12:27:50.007449+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:04.788+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.209012+0000 front 2024-09-12T12:27:32.208909+0000 (oldest deadline 2024-09-12T12:27:58.108792+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6[57832]: 2024-09-12T12:28:04.788+0000 7fc3e9020640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.809818+0000 front 2024-09-12T12:27:39.809848+0000 (oldest deadline 2024-09-12T12:28:02.709935+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:04.650+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:04.650+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:05.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:04.650+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:05.111 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:04 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:04.650+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:05.569 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:05 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:05.283+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:05.569 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:05 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:05.283+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:05.570 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:05 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:05.283+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:05.570 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:05 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:05.376+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:05.570 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:05 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:05.376+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:05.570 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:05 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:05.376+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:05.666 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:05 smithi081 podman[92723]: 2024-09-12 12:28:05.412752135 +0000 UTC m=+5.459921222 container died bac7293e2a366dbcfc251de8e391795fb4c5f6d63bbf41db99be502bc8530bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:05.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:05.446+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:05.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:05.446+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:05.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:05.446+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:05.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:05.331+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:05.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:05.331+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:05.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:05.331+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:05.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:05 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:05.331+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:05.958 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:05 smithi081 podman[92723]: 2024-09-12 12:28:05.749022272 +0000 UTC m=+5.796191358 container cleanup bac7293e2a366dbcfc251de8e391795fb4c5f6d63bbf41db99be502bc8530bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T12:28:05.958 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:05 smithi081 bash[92723]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6 2024-09-12T12:28:05.958 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:05 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:05.673+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:05.959 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:05 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:05.673+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:05.959 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:05 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:05.673+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:05.959 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:05 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:05.673+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:06.359 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:05 smithi081 podman[92738]: 2024-09-12 12:28:05.958815322 +0000 UTC m=+0.542896803 container remove bac7293e2a366dbcfc251de8e391795fb4c5f6d63bbf41db99be502bc8530bb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T12:28:06.625 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:06 smithi081 podman[92827]: 2024-09-12 12:28:06.266800276 +0000 UTC m=+0.015653802 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:28:06.626 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:06 smithi081 podman[92827]: 2024-09-12 12:28:06.384828977 +0000 UTC m=+0.133682539 container create 88c19539608d83d2333ed553317a07955c8c7330d3d0a52d799055f00355dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:28:06.626 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:06 smithi081 podman[92827]: 2024-09-12 12:28:06.595341093 +0000 UTC m=+0.344194612 container init 88c19539608d83d2333ed553317a07955c8c7330d3d0a52d799055f00355dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T12:28:06.626 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:06 smithi081 podman[92827]: 2024-09-12 12:28:06.598603998 +0000 UTC m=+0.347457518 container start 88c19539608d83d2333ed553317a07955c8c7330d3d0a52d799055f00355dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T12:28:06.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:06 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:06.248+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:06.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:06 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:06.248+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:06.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:06 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:06.248+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:06.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:06 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:06.332+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:06.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:06 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:06.332+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:06.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:06 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:06.332+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:06.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:06.435+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:06.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:06.435+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:06.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:06.435+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:06.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:06.377+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:06.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:06.377+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:06.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:06.377+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:06.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:06 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:06.377+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:07.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:06 smithi081 podman[92827]: 2024-09-12 12:28:06.687129725 +0000 UTC m=+0.435983262 container attach 88c19539608d83d2333ed553317a07955c8c7330d3d0a52d799055f00355dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T12:28:07.110 INFO:journalctl@ceph.osd.6.smithi081.stdout:Sep 12 12:28:06 smithi081 podman[92827]: 2024-09-12 12:28:06.782955088 +0000 UTC m=+0.531808610 container died 88c19539608d83d2333ed553317a07955c8c7330d3d0a52d799055f00355dffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T12:28:07.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:06 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:06.625+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:07.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:06 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:06.625+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:07.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:06 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:06.625+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:07.111 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:06 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:06.625+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:07.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T12:28:07.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:07.497 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T12:28:07.497 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T12:28:07.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.7 2024-09-12T12:28:07.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:07 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:07.294+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:07.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:07 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:07.294+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:07.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:07 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:07.294+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:07.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:07 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:07.301+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:07.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:07 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:07.301+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:07.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:07 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:07.301+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:07.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:07.405+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:07.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:07.405+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:07.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:07.405+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:07.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:07.405+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:07.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:07.431+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:07.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:07.431+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:07.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:07.431+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:07.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 systemd[1]: Stopping Ceph osd.7 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:07.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:07 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:07.586+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:07.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:07 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:07.586+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:07.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:07 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:07.586+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:07.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:07 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:07.586+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:08.185 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:07.811+0000 7f02ff4cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:08.185 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:07.811+0000 7f02ff4cc640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-12T12:28:08.185 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:07.811+0000 7f02ff4cc640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:28:08.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:08.266+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:08.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:08.266+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:08.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:08.266+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:08.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:08.283+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:08.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:08.283+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:08.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:08 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:08.283+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:08.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:08.404+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:08.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:08.404+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:08.686 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:08.404+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:08.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:08.447+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:08.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:08.447+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:08.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:08.447+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:08.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:08 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:08.447+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:08.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:08 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:08.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:08.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:08 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:08.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:08.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:08 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:08.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:08.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:08 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:08.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:09.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:09 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:09.238+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:09.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:09 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:09.238+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:09.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:09 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:09.238+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:09.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:09 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:09.243+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:09.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:09 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:09.243+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:09.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:09 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:09.243+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:09.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:09 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:09.602+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:09.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:09 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:09.602+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:09.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:09 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:09.602+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:09.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:09 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:09.602+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:09.446+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:09.446+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:09.446+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:09.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:09.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:09.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:09.862 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:09 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:09.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:10.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:10 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:10.253+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:10.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:10 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:10.253+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:10.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:10 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:10.253+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:10.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:10 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:10.248+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:10.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:10 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:10.248+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:10.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:10 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:10.248+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:10.478+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:10.478+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:10.478+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:10.453+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:10.453+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:10.453+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:10.832 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:10 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:10.453+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:10.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:10.573+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:10.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:10.573+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:10.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:10.573+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:10.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:10 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:10.573+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:11.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:11 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:11.250+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:11.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:11 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:11.250+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:11.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:11 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:11.250+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:11.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:11 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:11.210+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:11.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:11 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:11.210+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:11.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:11 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:11.210+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:11.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:11.524+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:11.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:11.524+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:11.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:11.524+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:11.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:11 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:11.524+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:11.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:11.445+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:11.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:11.445+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:11.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:11.445+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:11.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:11.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:11.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:11.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:11.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:11.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:11.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:11.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:11.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:11.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:12.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:12 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:12.261+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:12.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:12 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:12.261+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:12.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:12 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:12.261+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:12.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:12 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:12.212+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:12.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:12 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:12.212+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:12.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:12 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:12.212+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:12.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:12.421+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:20.107625+0000 front 2024-09-12T12:27:20.107658+0000 (oldest deadline 2024-09-12T12:27:48.308239+0000) 2024-09-12T12:28:12.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:12.421+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:31.209189+0000 front 2024-09-12T12:27:31.209228+0000 (oldest deadline 2024-09-12T12:27:55.909029+0000) 2024-09-12T12:28:12.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:12.421+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:39.410311+0000 front 2024-09-12T12:27:39.410352+0000 (oldest deadline 2024-09-12T12:28:05.310380+0000) 2024-09-12T12:28:12.685 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7[52889]: 2024-09-12T12:28:12.421+0000 7f02f7ac9640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.211314+0000 front 2024-09-12T12:27:48.211362+0000 (oldest deadline 2024-09-12T12:28:11.711463+0000) 2024-09-12T12:28:12.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:12.443+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:12.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:12.443+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:12.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:12.443+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:12.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:12.443+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:12.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:12 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:12.443+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:12.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:12.526+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:12.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:12.526+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:12.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:12.526+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:12.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:12.526+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:12.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:12 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:12.526+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:13.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:13.268+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:13.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:13.268+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:13.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:13.268+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:13.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:13.268+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:13.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:13.199+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:13.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:13.199+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:13.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:13 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:13.199+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:13.655 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:13 smithi103 podman[71126]: 2024-09-12 12:28:13.353967712 +0000 UTC m=+5.656179158 container died 3272ae43e5c163a00b98ea059f4aa7c7665bfd9eb0f194379e265bf92f1409a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T12:28:13.656 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:13 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:13.473+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:13.656 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:13 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:13.473+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:13.656 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:13 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:13.473+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:13.656 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:13 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:13.473+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:13.656 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:13 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:13.473+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:13.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:13.541+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:13.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:13.541+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:13.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:13.541+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:13.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:13.541+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:13.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:13 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:13.541+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:13.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:13 smithi103 podman[71126]: 2024-09-12 12:28:13.755665428 +0000 UTC m=+6.057876873 container cleanup 3272ae43e5c163a00b98ea059f4aa7c7665bfd9eb0f194379e265bf92f1409a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:13.936 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:13 smithi103 bash[71126]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7 2024-09-12T12:28:14.307 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:13 smithi103 podman[71153]: 2024-09-12 12:28:13.973523951 +0000 UTC m=+0.618595585 container remove 3272ae43e5c163a00b98ea059f4aa7c7665bfd9eb0f194379e265bf92f1409a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T12:28:14.593 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:14 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:14.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:14.593 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:14 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:14.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:14.593 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:14 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:14.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:14.593 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:14 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:14.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:14.593 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:14 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:14.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:14.594 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:14 smithi103 podman[71243]: 2024-09-12 12:28:14.307551001 +0000 UTC m=+0.113320642 container create ac57921cfc2b74375a133e73c0eedb29fbe00e34f42220445d8bf10b7f02be23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T12:28:14.594 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:14 smithi103 podman[71243]: 2024-09-12 12:28:14.210510371 +0000 UTC m=+0.016280010 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:28:14.594 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:14 smithi103 podman[71243]: 2024-09-12 12:28:14.518196232 +0000 UTC m=+0.323965871 container init ac57921cfc2b74375a133e73c0eedb29fbe00e34f42220445d8bf10b7f02be23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-12T12:28:14.594 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:14 smithi103 podman[71243]: 2024-09-12 12:28:14.521409962 +0000 UTC m=+0.327179601 container start ac57921cfc2b74375a133e73c0eedb29fbe00e34f42220445d8bf10b7f02be23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T12:28:14.594 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:14 smithi103 podman[71243]: 2024-09-12 12:28:14.593192658 +0000 UTC m=+0.398962311 container attach ac57921cfc2b74375a133e73c0eedb29fbe00e34f42220445d8bf10b7f02be23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T12:28:14.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:14.255+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:14.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:14.255+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:14.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:14.255+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:14.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:14.255+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:14.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:14.243+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:14.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:14.243+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:14.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:14 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:14.243+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:14.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:14.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:14.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:14.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:14.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:14.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:14.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:14.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:14.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:14 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:14.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:14.935 INFO:journalctl@ceph.osd.7.smithi103.stdout:Sep 12 12:28:14 smithi103 podman[71243]: 2024-09-12 12:28:14.716016994 +0000 UTC m=+0.521786633 container died ac57921cfc2b74375a133e73c0eedb29fbe00e34f42220445d8bf10b7f02be23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T12:28:15.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T12:28:15.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:15.334 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T12:28:15.334 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T12:28:15.335 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.8 2024-09-12T12:28:15.653 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:15.220+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:15.220+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:15.220+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:15.220+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.257+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.257+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.257+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.257+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:15.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 systemd[1]: Stopping Ceph osd.8 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:15.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:15.434+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:15.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:15.434+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:15.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:15.434+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:15.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:15.434+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:15.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:15.434+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:15.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:15 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:15.520+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:15.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:15 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:15.520+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:15.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:15 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:15.520+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:15.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:15 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:15.520+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:15.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:15 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:15.520+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:16.153 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.655+0000 7faa3abba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:16.153 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.655+0000 7faa3abba640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-12T12:28:16.153 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:15 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:15.655+0000 7faa3abba640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:16.290+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:16.290+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:16.290+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:16.290+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:16.244+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:16.244+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:16.244+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:16.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:16 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:16.244+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:16.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:16 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:16.566+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:16.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:16 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:16.566+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:16.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:16 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:16.566+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:16.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:16 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:16.566+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:16.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:16 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:16.566+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:16.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:16 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:16.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:16.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:16 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:16.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:16.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:16 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:16.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:16.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:16 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:16.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:16.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:16 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:16.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:17.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:17.335+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:17.335+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:17.335+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:17.335+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:17.245+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:17.245+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:17.245+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:17.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:17 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:17.245+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:17.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:17 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:17.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:17.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:17 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:17.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:17.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:17 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:17.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:17.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:17 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:17.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:17.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:17 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:17.568+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:17.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:17 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:17.512+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:17.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:17 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:17.512+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:17.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:17 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:17.512+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:17.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:17 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:17.512+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:17.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:17 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:17.512+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:18.656 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:18.379+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:18.656 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:18.379+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:18.656 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:18.379+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:18.657 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:18.379+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:18.657 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:18.217+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:18.657 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:18.217+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:18.657 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:18.217+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:18.657 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:18 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:18.217+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:18.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:18 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:18.539+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:18.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:18 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:18.539+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:18.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:18 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:18.539+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:18.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:18 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:18.539+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:18.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:18 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:18.539+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:18.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:18.470+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:18.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:18.470+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:18.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:18.470+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:18.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:18.470+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:18.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:18.470+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:18.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:18 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:18.470+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:19.387+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:19.387+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:19.387+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:19.387+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:19.387+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.732115+0000 front 2024-09-12T12:27:55.732161+0000 (oldest deadline 2024-09-12T12:28:18.632166+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:19.239+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:19.239+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:19.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:19.239+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:19.655 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:19 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:19.239+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:19.761 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:19.494+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:19.761 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:19.494+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:19.761 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:19.494+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:19.761 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:19.494+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:19.761 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:19.494+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:19.762 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:19 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:19.494+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:19.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:19.475+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:19.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:19.475+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:19.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:19.475+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:19.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:19.475+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:19.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:19.475+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:19.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:19 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:19.475+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:20.234+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:20.234+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:20.234+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:20.234+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:20.380+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:24.927117+0000 front 2024-09-12T12:27:24.926899+0000 (oldest deadline 2024-09-12T12:27:50.127597+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:20.380+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:30.128051+0000 front 2024-09-12T12:27:30.128123+0000 (oldest deadline 2024-09-12T12:27:55.428171+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:20.380+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.729247+0000 front 2024-09-12T12:27:37.729316+0000 (oldest deadline 2024-09-12T12:28:03.629336+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:20.380+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:47.030953+0000 front 2024-09-12T12:27:47.030862+0000 (oldest deadline 2024-09-12T12:28:12.831294+0000) 2024-09-12T12:28:20.654 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:20 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8[53370]: 2024-09-12T12:28:20.380+0000 7faa371bf640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.732115+0000 front 2024-09-12T12:27:55.732161+0000 (oldest deadline 2024-09-12T12:28:18.632166+0000) 2024-09-12T12:28:20.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:20.466+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:20.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:20.466+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:20.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:20.466+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:20.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:20.466+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:20.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:20.466+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:20.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:20 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:20.466+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:20.773 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:20.485+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:20.773 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:20.485+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:20.774 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:20.485+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:20.774 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:20.485+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:20.774 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:20.485+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:20.774 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:20 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:20.485+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:21.314 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:21 smithi173 podman[71635]: 2024-09-12 12:28:21.037269841 +0000 UTC m=+5.506051563 container died e5bf21fc8982c8911c9ece75fa8d12e6c79a1379ac124e9a23757977b886e109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T12:28:21.315 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:21.267+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:21.315 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:21.267+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:21.315 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:21.267+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:21.315 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:21.267+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:21.315 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:21 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:21.267+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:21.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:21 smithi173 podman[71635]: 2024-09-12 12:28:21.413874703 +0000 UTC m=+5.882656413 container cleanup e5bf21fc8982c8911c9ece75fa8d12e6c79a1379ac124e9a23757977b886e109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:21.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:21 smithi173 bash[71635]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8 2024-09-12T12:28:21.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:21.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:21.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:21.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:21.685 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:21.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:21.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:21.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:21.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:21.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:21.686 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:21 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:21.427+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:21.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:21.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:21.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:21.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:21.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:21.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:21.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:21.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:21.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:21.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:21.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:21 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:21.523+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:22.033 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:21 smithi173 podman[71652]: 2024-09-12 12:28:21.682078823 +0000 UTC m=+0.640261097 container remove e5bf21fc8982c8911c9ece75fa8d12e6c79a1379ac124e9a23757977b886e109 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:22.218+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:22.218+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:22.218+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:22.218+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:22 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:22.218+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:22 smithi173 podman[71742]: 2024-09-12 12:28:21.937338622 +0000 UTC m=+0.016448253 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:22 smithi173 podman[71742]: 2024-09-12 12:28:22.041656033 +0000 UTC m=+0.120765700 container create a7a4a4d00a0bc1b958b17cadfec65a8e78507939537ad50d2ff34d842ab836b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:22 smithi173 podman[71742]: 2024-09-12 12:28:22.277345881 +0000 UTC m=+0.356455517 container init a7a4a4d00a0bc1b958b17cadfec65a8e78507939537ad50d2ff34d842ab836b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:22.352 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:22 smithi173 podman[71742]: 2024-09-12 12:28:22.280522222 +0000 UTC m=+0.359631848 container start a7a4a4d00a0bc1b958b17cadfec65a8e78507939537ad50d2ff34d842ab836b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T12:28:22.353 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:22 smithi173 podman[71742]: 2024-09-12 12:28:22.352340965 +0000 UTC m=+0.431450607 container attach a7a4a4d00a0bc1b958b17cadfec65a8e78507939537ad50d2ff34d842ab836b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T12:28:22.653 INFO:journalctl@ceph.osd.8.smithi173.stdout:Sep 12 12:28:22 smithi173 podman[71742]: 2024-09-12 12:28:22.467583631 +0000 UTC m=+0.546693256 container died a7a4a4d00a0bc1b958b17cadfec65a8e78507939537ad50d2ff34d842ab836b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:28:22.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:22.555+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:22.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:22.555+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:22.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:22.555+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:22.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:22.555+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:22.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:22.555+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:22.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:22 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:22.555+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:22.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:22.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:22.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:22.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:22.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:22.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:22.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:22.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:22.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:22.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:22.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:22 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:22.474+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:23.285 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T12:28:23.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:23.325 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T12:28:23.325 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T12:28:23.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.9 2024-09-12T12:28:23.529 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:23.182+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:23.530 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:23.182+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:23.530 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:23.182+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:23.530 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:23.182+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:23.530 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:23.182+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 systemd[1]: Stopping Ceph osd.9 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.529+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.529+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.529+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.529+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.529+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:23.610 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.529+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:23.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:23.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:23.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:23.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:23.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:23.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:23.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:23.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:23.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:23.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:23.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:23 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:23.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:24.109 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.634+0000 7f4a7975d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:24.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.634+0000 7f4a7975d640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-12T12:28:24.110 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:23 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:23.634+0000 7f4a7975d640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:28:24.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:24.146+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:24.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:24.146+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:24.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:24.146+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:24.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:24.146+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:24.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:24 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:24.146+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:24.859 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:24.491+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:24.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:24.491+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:24.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:24.491+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:24.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:24.491+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:24.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:24.491+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:24.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:24 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:24.491+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:24.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:24.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:24.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:24.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:24.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:24.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:24.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:24.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:24.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:24.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:24.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:24 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:24.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:25.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:25 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:25.123+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:25.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:25 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:25.123+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:25.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:25 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:25.123+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:25.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:25 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:25.123+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:25.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:25 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:25.123+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:25.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:25.451+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:25.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:25.451+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:25.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:25.451+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:25.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:25.451+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:25.861 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:25.451+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:25.861 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:25 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:25.451+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:25.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:25.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:25.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:25.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:25.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:25.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:25.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:25.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:25.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:25.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:25.937 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:25 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:25.438+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:26.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:26 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:26.107+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:26.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:26 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:26.107+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:26.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:26 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:26.107+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:26.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:26 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:26.107+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:26.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:26 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:26.107+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:26.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:26.470+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:26.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:26.470+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:26.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:26.470+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:26.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:26.470+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:26.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:26.470+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:26.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:26 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:26.470+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:26.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:26 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:26.450+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:26.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:26 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:26.450+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:26.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:26 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:26.450+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:26.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:26 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:26.450+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:26.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:26 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:26.450+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:26.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:26 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:26.450+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:27.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:27.058+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:27.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:27.058+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:27.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:27.058+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:27.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:27.058+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:27.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:27.058+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:27.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:27.058+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:27.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:27.464+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:27.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:27.464+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:27.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:27.464+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:27.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:27.464+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:27.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:27.464+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:27.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:27 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:27.464+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:27.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:27 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:27.456+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:27.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:27 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:27.456+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:27.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:27 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:27.456+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:27.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:27 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:27.456+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:27.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:27 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:27.456+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:27.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:27 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:27.456+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:28.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:28.064+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:28.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:28.064+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:28.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:28.064+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:28.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:28.064+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:28.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:28.064+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:28.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:28 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:28.064+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:28.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:28.512+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:16.863415+0000 front 2024-09-12T12:27:16.863459+0000 (oldest deadline 2024-09-12T12:27:42.763569+0000) 2024-09-12T12:28:28.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:28.512+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.764187+0000 front 2024-09-12T12:27:22.764226+0000 (oldest deadline 2024-09-12T12:27:46.864181+0000) 2024-09-12T12:28:28.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:28.512+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.066203+0000 front 2024-09-12T12:27:32.066014+0000 (oldest deadline 2024-09-12T12:27:57.965942+0000) 2024-09-12T12:28:28.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:28.512+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.966204+0000 front 2024-09-12T12:27:37.966253+0000 (oldest deadline 2024-09-12T12:28:02.066319+0000) 2024-09-12T12:28:28.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:28.512+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:46.767475+0000 front 2024-09-12T12:27:46.767555+0000 (oldest deadline 2024-09-12T12:28:12.067419+0000) 2024-09-12T12:28:28.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:28 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9[64383]: 2024-09-12T12:28:28.512+0000 7f4a75d62640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:54.968596+0000 front 2024-09-12T12:27:54.968667+0000 (oldest deadline 2024-09-12T12:28:19.068467+0000) 2024-09-12T12:28:28.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:28 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:28.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:28.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:28 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:28.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:28.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:28 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:28.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:28.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:28 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:28.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:28.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:28 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:28.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:28.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:28 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:28.486+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:29.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:29 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:29.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:29.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:29 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:29.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:29.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:29 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:29.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:29.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:29 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:29.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:29.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:29 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:29.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:29.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:29 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:29.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:29.427 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:29 smithi081 podman[92942]: 2024-09-12 12:28:29.158713383 +0000 UTC m=+5.635228983 container died bb40364fa3f321d06943c0ff18fb2ff4a2a8ae9bea075bbc257569fd080f0bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T12:28:29.793 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:29 smithi081 podman[92942]: 2024-09-12 12:28:29.517997621 +0000 UTC m=+5.994513220 container cleanup bb40364fa3f321d06943c0ff18fb2ff4a2a8ae9bea075bbc257569fd080f0bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T12:28:29.794 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:29 smithi081 bash[92942]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9 2024-09-12T12:28:29.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:29.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:29.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:29.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:29.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:29.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:29.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:29 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:29.526+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:30.099 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:29 smithi081 podman[92958]: 2024-09-12 12:28:29.794013764 +0000 UTC m=+0.628305452 container remove bb40364fa3f321d06943c0ff18fb2ff4a2a8ae9bea075bbc257569fd080f0bfa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:28:30.360 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:30 smithi081 podman[93047]: 2024-09-12 12:28:30.002539928 +0000 UTC m=+0.015431519 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:28:30.360 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:30 smithi081 podman[93047]: 2024-09-12 12:28:30.119890107 +0000 UTC m=+0.132781689 container create d009e01e5522b3ae8929624f8ed7e47da75b9746408e01635e556e46cd15fbb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T12:28:30.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:30.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:30.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:30.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:30.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:30.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:30.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:30.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:30.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:30.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:30.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:30 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:30.039+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:30.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:30 smithi081 podman[93047]: 2024-09-12 12:28:30.389138927 +0000 UTC m=+0.402030504 container init d009e01e5522b3ae8929624f8ed7e47da75b9746408e01635e556e46cd15fbb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T12:28:30.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:30 smithi081 podman[93047]: 2024-09-12 12:28:30.392478128 +0000 UTC m=+0.405369711 container start d009e01e5522b3ae8929624f8ed7e47da75b9746408e01635e556e46cd15fbb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T12:28:30.860 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:30 smithi081 podman[93047]: 2024-09-12 12:28:30.480882959 +0000 UTC m=+0.493774557 container attach d009e01e5522b3ae8929624f8ed7e47da75b9746408e01635e556e46cd15fbb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:30.861 INFO:journalctl@ceph.osd.9.smithi081.stdout:Sep 12 12:28:30 smithi081 podman[93047]: 2024-09-12 12:28:30.586765613 +0000 UTC m=+0.599657190 container died d009e01e5522b3ae8929624f8ed7e47da75b9746408e01635e556e46cd15fbb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:30.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:30 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:30.518+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:31.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T12:28:31.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:31.213 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T12:28:31.213 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T12:28:31.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.10 2024-09-12T12:28:31.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:31.072+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:31.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:31.072+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:31.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:31.072+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:31.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:31.072+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:31.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:31.072+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:31.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:31.072+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:31.523 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 systemd[1]: Stopping Ceph osd.10 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:31.523 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.480+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.523+0000 7fecead62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.523+0000 7fecead62640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-12T12:28:31.524 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:31 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:31.523+0000 7fecead62640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:28:32.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:32 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:32.110+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:32.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:32 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:32.110+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:32.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:32 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:32.110+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:32.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:32 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:32.110+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:32.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:32 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:32.110+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:32.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:32 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:32.110+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:32.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:32.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:32.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:32.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:32.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:32.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:32.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:32 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:32.503+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:33.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:33 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:33.065+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:33.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:33 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:33.065+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:33.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:33 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:33.065+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:33.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:33 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:33.065+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:33.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:33 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:33.065+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:33.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:33 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:33.065+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:33.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:33.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:33.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:33.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:33.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:33.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:33.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:33 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:33.534+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:34.305 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.032+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:34.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:34.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:34.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:34.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:34.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:34.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:34.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:34 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:34.529+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:35.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.988+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:35.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.988+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:35.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.988+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:35.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:35.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:35.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:35.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:34 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:34.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:35.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:35.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:35.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:35.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:35.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:35.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:35.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:35 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:35.500+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:36.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:36.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:36.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:36.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:36.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:36.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:36.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:35 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:35.956+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:36.935 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:14.047809+0000 front 2024-09-12T12:27:14.047820+0000 (oldest deadline 2024-09-12T12:27:38.747557+0000) 2024-09-12T12:28:36.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:25.049808+0000 front 2024-09-12T12:27:25.049735+0000 (oldest deadline 2024-09-12T12:27:49.149803+0000) 2024-09-12T12:28:36.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:33.250747+0000 front 2024-09-12T12:27:33.250832+0000 (oldest deadline 2024-09-12T12:27:57.950707+0000) 2024-09-12T12:28:36.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-09-12T12:27:37.951292+0000 front 2024-09-12T12:27:37.951400+0000 (oldest deadline 2024-09-12T12:28:04.351658+0000) 2024-09-12T12:28:36.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:45.953270+0000 front 2024-09-12T12:27:45.953312+0000 (oldest deadline 2024-09-12T12:28:10.653297+0000) 2024-09-12T12:28:36.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:52.854945+0000 front 2024-09-12T12:27:52.854776+0000 (oldest deadline 2024-09-12T12:28:18.154666+0000) 2024-09-12T12:28:36.936 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10[59956]: 2024-09-12T12:28:36.462+0000 7fece7367640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:05.056634+0000 front 2024-09-12T12:28:05.056567+0000 (oldest deadline 2024-09-12T12:28:28.556499+0000) 2024-09-12T12:28:37.207 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:36 smithi103 podman[71345]: 2024-09-12 12:28:36.946921099 +0000 UTC m=+5.535038551 container died 8dc9b54123d8de4d9ba10ec706da1318cca56cab02ed2eef34e4ff73da57b3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3) 2024-09-12T12:28:37.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:37.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:37.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:37.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:37.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:37.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:37.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:36 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:36.970+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:37.591 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:37 smithi103 podman[71345]: 2024-09-12 12:28:37.306893497 +0000 UTC m=+5.895010945 container cleanup 8dc9b54123d8de4d9ba10ec706da1318cca56cab02ed2eef34e4ff73da57b3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T12:28:37.591 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:37 smithi103 bash[71345]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10 2024-09-12T12:28:37.898 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:37 smithi103 podman[71362]: 2024-09-12 12:28:37.591534483 +0000 UTC m=+0.640025510 container remove 8dc9b54123d8de4d9ba10ec706da1318cca56cab02ed2eef34e4ff73da57b3c5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T12:28:38.153 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:37 smithi103 podman[71451]: 2024-09-12 12:28:37.80209514 +0000 UTC m=+0.016013489 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:28:38.153 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:37 smithi103 podman[71451]: 2024-09-12 12:28:37.91707526 +0000 UTC m=+0.130993604 container create 76122d3b9ac281a022899e35fc92c3486424cb0fd7c17d16e19e4936fd6de426 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T12:28:38.153 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:38 smithi103 podman[71451]: 2024-09-12 12:28:38.15326736 +0000 UTC m=+0.367185717 container init 76122d3b9ac281a022899e35fc92c3486424cb0fd7c17d16e19e4936fd6de426 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T12:28:38.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:38.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:38.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:38.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:38.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:38.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:38.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:37 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:37.964+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:38.435 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:38 smithi103 podman[71451]: 2024-09-12 12:28:38.156682798 +0000 UTC m=+0.370601142 container start 76122d3b9ac281a022899e35fc92c3486424cb0fd7c17d16e19e4936fd6de426 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T12:28:38.435 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:38 smithi103 podman[71451]: 2024-09-12 12:28:38.228053564 +0000 UTC m=+0.441971929 container attach 76122d3b9ac281a022899e35fc92c3486424cb0fd7c17d16e19e4936fd6de426 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-12T12:28:38.436 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:38 smithi103 podman[71451]: 2024-09-12 12:28:38.346673373 +0000 UTC m=+0.560591717 container died 76122d3b9ac281a022899e35fc92c3486424cb0fd7c17d16e19e4936fd6de426 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T12:28:38.898 INFO:journalctl@ceph.osd.10.smithi103.stdout:Sep 12 12:28:38 smithi103 podman[71474]: 2024-09-12 12:28:38.881275061 +0000 UTC m=+0.528980213 container remove 76122d3b9ac281a022899e35fc92c3486424cb0fd7c17d16e19e4936fd6de426 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T12:28:38.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T12:28:38.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:38.942 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T12:28:38.942 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T12:28:38.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.11 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:38.989+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:39.268 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:38 smithi173 systemd[1]: Stopping Ceph osd.11 for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:39.269 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.266+0000 7f3865d4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:39.269 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.266+0000 7f3865d4f640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-12T12:28:39.269 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.266+0000 7f3865d4f640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T12:28:40.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:40.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:40.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:40.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:40.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:40.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:40.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:39 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:39.941+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:41.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:41.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:41.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:41.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:41.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:41.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:41.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:40 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:40.977+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:42.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:41 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:41.991+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:43.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.012+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.012+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.013+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.013+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.013+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.013+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.013+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:43.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.013+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-12T12:28:19.471815+0000 front 2024-09-12T12:28:19.471889+0000 (oldest deadline 2024-09-12T12:28:42.371805+0000) 2024-09-12T12:28:44.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-09-12T12:27:17.559506+0000 front 2024-09-12T12:27:17.559450+0000 (oldest deadline 2024-09-12T12:27:42.859356+0000) 2024-09-12T12:28:44.403 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-09-12T12:27:22.859935+0000 front 2024-09-12T12:27:22.859965+0000 (oldest deadline 2024-09-12T12:27:49.260880+0000) 2024-09-12T12:28:44.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-09-12T12:27:32.162127+0000 front 2024-09-12T12:27:32.162223+0000 (oldest deadline 2024-09-12T12:27:54.462092+0000) 2024-09-12T12:28:44.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6812 osd.4 since back 2024-09-12T12:27:48.667420+0000 front 2024-09-12T12:27:48.667398+0000 (oldest deadline 2024-09-12T12:28:14.567387+0000) 2024-09-12T12:28:44.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-09-12T12:27:55.668463+0000 front 2024-09-12T12:27:55.668368+0000 (oldest deadline 2024-09-12T12:28:20.968493+0000) 2024-09-12T12:28:44.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-09-12T12:28:00.969074+0000 front 2024-09-12T12:28:00.969124+0000 (oldest deadline 2024-09-12T12:28:26.268889+0000) 2024-09-12T12:28:44.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.103:6820 osd.7 since back 2024-09-12T12:28:08.570016+0000 front 2024-09-12T12:28:08.570101+0000 (oldest deadline 2024-09-12T12:28:33.770228+0000) 2024-09-12T12:28:44.404 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:43 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11[60404]: 2024-09-12T12:28:43.990+0000 7f385e34c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-09-12T12:28:19.471815+0000 front 2024-09-12T12:28:19.471889+0000 (oldest deadline 2024-09-12T12:28:42.371805+0000) 2024-09-12T12:28:44.903 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:44 smithi173 podman[71860]: 2024-09-12 12:28:44.669600485 +0000 UTC m=+5.530837706 container died f0fd51ce9aae172852d5f211eeead5794d25039f816c7701a2e5e835bef861f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T12:28:45.201 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:44 smithi173 podman[71860]: 2024-09-12 12:28:44.99218212 +0000 UTC m=+5.853419339 container cleanup f0fd51ce9aae172852d5f211eeead5794d25039f816c7701a2e5e835bef861f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:28:45.202 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:44 smithi173 bash[71860]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11 2024-09-12T12:28:45.594 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:45 smithi173 podman[71878]: 2024-09-12 12:28:45.202235391 +0000 UTC m=+0.535538293 container remove f0fd51ce9aae172852d5f211eeead5794d25039f816c7701a2e5e835bef861f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T12:28:45.903 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:45 smithi173 podman[71968]: 2024-09-12 12:28:45.594687076 +0000 UTC m=+0.109918420 container create 96558b1a002a05e3b65dd56efb356216a2efdfca82f0edf46018733a5fd3c347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T12:28:45.903 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:45 smithi173 podman[71968]: 2024-09-12 12:28:45.500449209 +0000 UTC m=+0.015680553 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T12:28:45.903 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:45 smithi173 podman[71968]: 2024-09-12 12:28:45.831262006 +0000 UTC m=+0.346493361 container init 96558b1a002a05e3b65dd56efb356216a2efdfca82f0edf46018733a5fd3c347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:28:45.904 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:45 smithi173 podman[71968]: 2024-09-12 12:28:45.8350438 +0000 UTC m=+0.350275149 container start 96558b1a002a05e3b65dd56efb356216a2efdfca82f0edf46018733a5fd3c347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T12:28:46.308 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:45 smithi173 podman[71968]: 2024-09-12 12:28:45.914077553 +0000 UTC m=+0.429308898 container attach 96558b1a002a05e3b65dd56efb356216a2efdfca82f0edf46018733a5fd3c347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-12T12:28:46.308 INFO:journalctl@ceph.osd.11.smithi173.stdout:Sep 12 12:28:46 smithi173 podman[71968]: 2024-09-12 12:28:46.027795645 +0000 UTC m=+0.543026991 container died 96558b1a002a05e3b65dd56efb356216a2efdfca82f0edf46018733a5fd3c347 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T12:28:46.580 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T12:28:46.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:46.619 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T12:28:46.619 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T12:28:46.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.a 2024-09-12T12:28:46.911 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:46 smithi081 systemd[1]: Stopping Ceph mds.a for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:47.360 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a[71178]: 2024-09-12T12:28:46.910+0000 7f078844d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:47.360 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:46 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a[71178]: 2024-09-12T12:28:46.910+0000 7f078844d640 -1 mds.a *** got signal Terminated *** 2024-09-12T12:28:50.610 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:50 smithi081 podman[93150]: 2024-09-12 12:28:50.285179846 +0000 UTC m=+3.474480420 container died ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T12:28:50.903 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:50 smithi081 podman[93150]: 2024-09-12 12:28:50.71895812 +0000 UTC m=+3.908258693 container cleanup ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T12:28:50.904 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:50 smithi081 bash[93150]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a 2024-09-12T12:28:51.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T12:28:51.167 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:50 smithi081 podman[93163]: 2024-09-12 12:28:50.903734774 +0000 UTC m=+0.614676551 container remove ee0b88d6e6c128e4a8f67da10f0ec9c438ce9c43ffda334118f7a34d35191be6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T12:28:51.167 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:51 smithi081 systemd[1]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-12T12:28:51.167 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:51 smithi081 systemd[1]: Stopped Ceph mds.a for 595bfb7a-70ff-11ef-bcea-c7b262605968. 2024-09-12T12:28:51.167 INFO:journalctl@ceph.mds.a.smithi081.stdout:Sep 12 12:28:51 smithi081 systemd[1]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.a.service: Consumed 3.222s CPU time. 2024-09-12T12:28:51.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:51.179 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T12:28:51.179 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T12:28:51.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.d 2024-09-12T12:28:51.498 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:28:51 smithi081 systemd[1]: Stopping Ceph mds.d for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:51.859 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:28:51 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d[69991]: 2024-09-12T12:28:51.498+0000 7f889572a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:51.859 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:28:51 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d[69991]: 2024-09-12T12:28:51.498+0000 7f889572a640 -1 mds.d *** got signal Terminated *** 2024-09-12T12:28:55.848 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:28:55 smithi081 podman[93270]: 2024-09-12 12:28:55.512565757 +0000 UTC m=+4.114630291 container died 75db628b4dd69cebb972378c5ab51436fa572df8b498509f6ac0809579f05394 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T12:28:56.109 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:28:55 smithi081 podman[93270]: 2024-09-12 12:28:55.931103854 +0000 UTC m=+4.533168388 container cleanup 75db628b4dd69cebb972378c5ab51436fa572df8b498509f6ac0809579f05394 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T12:28:56.110 INFO:journalctl@ceph.mds.d.smithi081.stdout:Sep 12 12:28:55 smithi081 bash[93270]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-d 2024-09-12T12:28:56.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T12:28:56.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:56.403 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T12:28:56.403 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T12:28:56.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.g 2024-09-12T12:28:56.735 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:28:56 smithi081 systemd[1]: Stopping Ceph mds.g for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:57.109 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:28:56 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g[70765]: 2024-09-12T12:28:56.734+0000 7feb1a77e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:57.110 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:28:56 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g[70765]: 2024-09-12T12:28:56.734+0000 7feb1a77e640 -1 mds.g *** got signal Terminated *** 2024-09-12T12:28:58.577 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:28:58 smithi081 podman[93402]: 2024-09-12 12:28:58.286634782 +0000 UTC m=+1.662406225 container died 474301c7659fa740bc19ebf707a35d5903cbb971d0bb846967c01cd6b1ab2d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T12:28:58.860 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:28:58 smithi081 podman[93402]: 2024-09-12 12:28:58.676623927 +0000 UTC m=+2.052395369 container cleanup 474301c7659fa740bc19ebf707a35d5903cbb971d0bb846967c01cd6b1ab2d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:28:58.860 INFO:journalctl@ceph.mds.g.smithi081.stdout:Sep 12 12:28:58 smithi081 bash[93402]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-g 2024-09-12T12:28:59.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T12:28:59.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:28:59.282 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T12:28:59.283 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T12:28:59.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.j 2024-09-12T12:28:59.605 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:28:59 smithi081 systemd[1]: Stopping Ceph mds.j for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:28:59.859 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:28:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j[69576]: 2024-09-12T12:28:59.605+0000 7f20285aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:28:59.860 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:28:59 smithi081 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j[69576]: 2024-09-12T12:28:59.605+0000 7f20285aa640 -1 mds.j *** got signal Terminated *** 2024-09-12T12:29:03.859 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:29:03 smithi081 podman[93525]: 2024-09-12 12:29:03.619161182 +0000 UTC m=+4.116699980 container died 97081209fd1a60492288c1602361711d4c95d7c4a246b06cf6a9b4bf52087e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T12:29:04.256 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:29:03 smithi081 podman[93525]: 2024-09-12 12:29:03.963993481 +0000 UTC m=+4.461532277 container cleanup 97081209fd1a60492288c1602361711d4c95d7c4a246b06cf6a9b4bf52087e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:04.256 INFO:journalctl@ceph.mds.j.smithi081.stdout:Sep 12 12:29:03 smithi081 bash[93525]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-j 2024-09-12T12:29:04.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T12:29:04.430 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:04.430 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T12:29:04.430 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T12:29:04.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.b 2024-09-12T12:29:04.733 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:29:04 smithi103 systemd[1]: Stopping Ceph mds.b for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:05.185 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:29:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: 2024-09-12T12:29:04.732+0000 7ff92cde7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:05.185 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:29:04 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b[65314]: 2024-09-12T12:29:04.732+0000 7ff92cde7640 -1 mds.b *** got signal Terminated *** 2024-09-12T12:29:06.686 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:29:06 smithi103 podman[71567]: 2024-09-12 12:29:06.299166254 +0000 UTC m=+1.668428704 container died e88a5a8179263e335cf0dcfb513779b7ee23f4779a5cf3613a6403f947fd9b5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:07.041 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:29:06 smithi103 podman[71567]: 2024-09-12 12:29:06.766158086 +0000 UTC m=+2.135420575 container cleanup e88a5a8179263e335cf0dcfb513779b7ee23f4779a5cf3613a6403f947fd9b5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:07.041 INFO:journalctl@ceph.mds.b.smithi103.stdout:Sep 12 12:29:06 smithi103 bash[71567]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-b 2024-09-12T12:29:07.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T12:29:07.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:07.243 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T12:29:07.243 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T12:29:07.244 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.e 2024-09-12T12:29:07.561 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:29:07 smithi103 systemd[1]: Stopping Ceph mds.e for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:07.935 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:29:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e[64714]: 2024-09-12T12:29:07.561+0000 7fe7a43e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:07.935 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:29:07 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e[64714]: 2024-09-12T12:29:07.561+0000 7fe7a43e1640 -1 mds.e *** got signal Terminated *** 2024-09-12T12:29:10.578 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:29:10 smithi103 podman[71689]: 2024-09-12 12:29:10.300603863 +0000 UTC m=+2.838380799 container died 374ff74323ff0f6de5f352c97d34029386d156522db34a4d0c0b23319d2e9106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T12:29:10.928 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:29:10 smithi103 podman[71689]: 2024-09-12 12:29:10.678001925 +0000 UTC m=+3.215778929 container cleanup 374ff74323ff0f6de5f352c97d34029386d156522db34a4d0c0b23319d2e9106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T12:29:10.928 INFO:journalctl@ceph.mds.e.smithi103.stdout:Sep 12 12:29:10 smithi103 bash[71689]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-e 2024-09-12T12:29:11.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T12:29:11.095 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:11.095 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T12:29:11.095 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T12:29:11.095 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.h 2024-09-12T12:29:11.185 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:29:11 smithi103 systemd[1]: Stopping Ceph mds.h for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:11.685 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:29:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h[65014]: 2024-09-12T12:29:11.406+0000 7f3a04919640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:11.685 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:29:11 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h[65014]: 2024-09-12T12:29:11.406+0000 7f3a04919640 -1 mds.h *** got signal Terminated *** 2024-09-12T12:29:14.641 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:29:14 smithi103 podman[71809]: 2024-09-12 12:29:14.295690628 +0000 UTC m=+2.986963638 container died a9ecb9b59d86d8b9a636fe1cd2eb46081bed95f70094778fd75edba2e2d975b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-12T12:29:14.925 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:29:14 smithi103 podman[71809]: 2024-09-12 12:29:14.723768002 +0000 UTC m=+3.415041009 container cleanup a9ecb9b59d86d8b9a636fe1cd2eb46081bed95f70094778fd75edba2e2d975b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T12:29:14.925 INFO:journalctl@ceph.mds.h.smithi103.stdout:Sep 12 12:29:14 smithi103 bash[71809]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-h 2024-09-12T12:29:15.139 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T12:29:15.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:15.172 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T12:29:15.172 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T12:29:15.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.k 2024-09-12T12:29:15.494 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:29:15 smithi103 systemd[1]: Stopping Ceph mds.k for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:15.935 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:29:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k[64401]: 2024-09-12T12:29:15.494+0000 7f869312e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:15.935 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:29:15 smithi103 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k[64401]: 2024-09-12T12:29:15.494+0000 7f869312e640 -1 mds.k *** got signal Terminated *** 2024-09-12T12:29:18.569 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:29:18 smithi103 podman[71930]: 2024-09-12 12:29:18.303501083 +0000 UTC m=+2.917760666 container died 5d098296042fb6a0f5f40eee66a8676e31cb5c29c407194613f59035d68cbf0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T12:29:18.895 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:29:18 smithi103 podman[71930]: 2024-09-12 12:29:18.643911485 +0000 UTC m=+3.258171066 container cleanup 5d098296042fb6a0f5f40eee66a8676e31cb5c29c407194613f59035d68cbf0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-12T12:29:18.895 INFO:journalctl@ceph.mds.k.smithi103.stdout:Sep 12 12:29:18 smithi103 bash[71930]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-k 2024-09-12T12:29:19.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T12:29:19.137 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:19.138 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T12:29:19.138 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T12:29:19.138 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.c 2024-09-12T12:29:22.654 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 12:29:22 smithi173 podman[72070]: 2024-09-12 12:29:22.293377745 +0000 UTC m=+2.961611195 container died ea24f7a944cb1fcd1a102c1b9d8a0c2b5732c9bd771eded7417ac3e81e9f92f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-c, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T12:29:23.109 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 12:29:22 smithi173 podman[72070]: 2024-09-12 12:29:22.842148174 +0000 UTC m=+3.510381626 container cleanup ea24f7a944cb1fcd1a102c1b9d8a0c2b5732c9bd771eded7417ac3e81e9f92f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T12:29:23.109 INFO:journalctl@ceph.mds.c.smithi173.stdout:Sep 12 12:29:22 smithi173 bash[72070]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-c 2024-09-12T12:29:23.275 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T12:29:23.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:23.311 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T12:29:23.311 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T12:29:23.311 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.f 2024-09-12T12:29:23.653 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:29:23 smithi173 systemd[1]: Stopping Ceph mds.f for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:23.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:29:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f[64984]: 2024-09-12T12:29:23.651+0000 7f4fa53fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:23.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:29:23 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f[64984]: 2024-09-12T12:29:23.651+0000 7f4fa53fe640 -1 mds.f *** got signal Terminated *** 2024-09-12T12:29:26.588 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:29:26 smithi173 podman[72202]: 2024-09-12 12:29:26.315256806 +0000 UTC m=+2.788219278 container died e0790123f71387e1fbfa8c4ba396a38ba6d898e87528d1ee11a006c7fa68514a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-12T12:29:26.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:29:26 smithi173 podman[72202]: 2024-09-12 12:29:26.687770559 +0000 UTC m=+3.160733016 container cleanup e0790123f71387e1fbfa8c4ba396a38ba6d898e87528d1ee11a006c7fa68514a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T12:29:26.903 INFO:journalctl@ceph.mds.f.smithi173.stdout:Sep 12 12:29:26 smithi173 bash[72202]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-f 2024-09-12T12:29:27.066 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T12:29:27.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:27.099 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T12:29:27.100 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T12:29:27.100 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.i 2024-09-12T12:29:27.653 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:29:27 smithi173 systemd[1]: Stopping Ceph mds.i for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:27.654 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:29:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i[65585]: 2024-09-12T12:29:27.424+0000 7fe49ea57640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:27.654 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:29:27 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i[65585]: 2024-09-12T12:29:27.424+0000 7fe49ea57640 -1 mds.i *** got signal Terminated *** 2024-09-12T12:29:30.403 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:29:30 smithi173 podman[72321]: 2024-09-12 12:29:30.297351439 +0000 UTC m=+2.977546081 container died 6620330d374a38e534988b8213897d9b20b6c81d1ccaf5660e9846db63d38b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T12:29:30.903 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:29:30 smithi173 podman[72321]: 2024-09-12 12:29:30.80886387 +0000 UTC m=+3.489058511 container cleanup 6620330d374a38e534988b8213897d9b20b6c81d1ccaf5660e9846db63d38b73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T12:29:30.903 INFO:journalctl@ceph.mds.i.smithi173.stdout:Sep 12 12:29:30 smithi173 bash[72321]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-i 2024-09-12T12:29:31.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T12:29:31.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:31.266 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T12:29:31.266 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T12:29:31.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.l 2024-09-12T12:29:31.587 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:29:31 smithi173 systemd[1]: Stopping Ceph mds.l for 595bfb7a-70ff-11ef-bcea-c7b262605968... 2024-09-12T12:29:31.903 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:29:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l[64683]: 2024-09-12T12:29:31.587+0000 7fa5ce448640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T12:29:31.903 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:29:31 smithi173 ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l[64683]: 2024-09-12T12:29:31.587+0000 7fa5ce448640 -1 mds.l *** got signal Terminated *** 2024-09-12T12:29:34.588 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:29:34 smithi173 podman[72444]: 2024-09-12 12:29:34.312663636 +0000 UTC m=+2.822034545 container died b7aaae45e3b8437d55ec060000363ff90dd678d910ea2a0d68684a6f1b8d605f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T12:29:34.904 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:29:34 smithi173 podman[72444]: 2024-09-12 12:29:34.687811234 +0000 UTC m=+3.197182131 container cleanup b7aaae45e3b8437d55ec060000363ff90dd678d910ea2a0d68684a6f1b8d605f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T12:29:34.904 INFO:journalctl@ceph.mds.l.smithi173.stdout:Sep 12 12:29:34 smithi173 bash[72444]: ceph-595bfb7a-70ff-11ef-bcea-c7b262605968-mds-l 2024-09-12T12:29:35.115 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-595bfb7a-70ff-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T12:29:35.147 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T12:29:35.147 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T12:29:35.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:29:35.353 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:29:37.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:29:38.101 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:29:40.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T12:29:40.650 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:29:42.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:29:43.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:29:43.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T12:29:43.085 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T12:29:43.087 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi081/crash 2024-09-12T12:29:43.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:29:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:29:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:29:43.118 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi103/crash 2024-09-12T12:29:43.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:29:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:29:43.157 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:29:43.159 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi173/crash 2024-09-12T12:29:43.160 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash -- . 2024-09-12T12:29:43.196 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T12:29:43.196 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-09-12T12:29:43.197 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T12:29:43.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T12:29:43.247 INFO:tasks.cephadm:Compressing logs... 2024-09-12T12:29:43.247 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:29:43.250 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:29:43.252 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T12:29:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T12:29:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:: No such file or directory 2024-09-12T12:29:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T12:29:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:29:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:29:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:: No such file or directory 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T12:29:43.278 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T12:29:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:29:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T12:29:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T12:29:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.a.log: 84.7%gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T12:29:43.280 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:29:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:29:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.g.log: /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.6.log: 90.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:29:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T12:29:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T12:29:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:: No such file or directory 2024-09-12T12:29:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:29:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T12:29:43.282 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T12:29:43.283 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T12:29:43.283 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T12:29:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log: 87.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:29:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr: 82.2% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr: 90.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T12:29:43.286 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.l.log: 87.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:29:43.287 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T12:29:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T12:29:43.287 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T12:29:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T12:29:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T12:29:43.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.x.log: 91.1% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:29:43.289 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:29:43.290 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T12:29:43.295 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T12:29:43.299 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T12:29:43.299 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.2% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T12:29:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T12:29:43.303 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log 2024-09-12T12:29:43.305 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.z.log: 91.9% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T12:29:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T12:29:43.309 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T12:29:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T12:29:43.309 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log: 91.8% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T12:29:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T12:29:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.h.log: 87.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T12:29:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:29:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T12:29:43.322 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:29:43.336 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T12:29:43.341 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:29:43.343 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:29:43.351 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T12:29:43.642 INFO:teuthology.orchestra.run.smithi081.stderr: 90.2% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T12:29:43.644 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T12:29:43.773 INFO:teuthology.orchestra.run.smithi081.stderr: 94.9% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T12:29:43.926 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T12:29:43.929 INFO:teuthology.orchestra.run.smithi081.stderr: 95.3% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T12:29:44.130 INFO:teuthology.orchestra.run.smithi103.stderr: 95.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T12:29:44.237 INFO:teuthology.orchestra.run.smithi173.stderr: 95.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T12:29:44.386 INFO:teuthology.orchestra.run.smithi081.stderr: 90.4% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T12:29:45.444 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T12:29:45.581 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T12:29:45.668 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T12:29:45.689 INFO:teuthology.orchestra.run.smithi173.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T12:29:45.777 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T12:29:46.082 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T12:29:46.084 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-12T12:29:46.085 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m2.822s 2024-09-12T12:29:46.085 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m11.971s 2024-09-12T12:29:46.085 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.423s 2024-09-12T12:29:46.182 INFO:teuthology.orchestra.run.smithi173.stderr: 95.2% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T12:29:46.276 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T12:29:46.303 INFO:teuthology.orchestra.run.smithi173.stderr: 93.8% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T12:29:46.340 INFO:teuthology.orchestra.run.smithi173.stderr: 93.6% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T12:29:46.618 INFO:teuthology.orchestra.run.smithi103.stderr: 93.7% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T12:29:47.058 INFO:teuthology.orchestra.run.smithi173.stderr: 93.7% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T12:29:47.138 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T12:29:48.340 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T12:29:50.050 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T12:29:50.866 INFO:teuthology.orchestra.run.smithi103.stderr: 93.9% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T12:29:52.305 INFO:teuthology.orchestra.run.smithi173.stderr: 93.7% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T12:29:52.306 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-09-12T12:29:52.306 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m9.040s 2024-09-12T12:29:52.306 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m29.273s 2024-09-12T12:29:52.306 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.909s 2024-09-12T12:30:07.448 INFO:teuthology.orchestra.run.smithi103.stderr: 93.3% -- replaced with /var/log/ceph/595bfb7a-70ff-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T12:30:07.450 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-12T12:30:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m24.186s 2024-09-12T12:30:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m49.716s 2024-09-12T12:30:07.450 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.528s 2024-09-12T12:30:07.451 INFO:tasks.cephadm:Archiving logs... 2024-09-12T12:30:07.451 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi081/log 2024-09-12T12:30:07.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:30:09.038 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi103/log 2024-09-12T12:30:09.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:30:15.522 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi173/log 2024-09-12T12:30:15.522 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T12:30:18.890 INFO:tasks.cephadm:Removing cluster... 2024-09-12T12:30:18.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --force 2024-09-12T12:30:19.096 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:30:19.380 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --force 2024-09-12T12:30:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:30:19.897 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 595bfb7a-70ff-11ef-bcea-c7b262605968 --force 2024-09-12T12:30:20.101 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: 595bfb7a-70ff-11ef-bcea-c7b262605968 2024-09-12T12:30:20.387 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T12:30:20.387 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:30:20.406 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:30:20.423 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T12:30:20.440 INFO:tasks.cephadm:Teardown complete 2024-09-12T12:30:20.440 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T12:30:20.451 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T12:30:20.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:30:20.454 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:30:20.466 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T12:30:20.617 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T12:30:20.905 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T12:30:20.906 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:30:20.910 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:30:20.913 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T12:30:20.924 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:30:20.928 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:30:20.929 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:30:20.929 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-12T12:30:20.929 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -1285us[-1285us] +/- 46ms 2024-09-12T12:30:20.929 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 +1114us[+1115us] +/- 57ms 2024-09-12T12:30:20.929 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +660us[ +660us] +/- 74ms 2024-09-12T12:30:20.930 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:30:20.930 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-09-12T12:30:20.933 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:30:20.933 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-09-12T12:30:20.933 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -1297us[-1284us] +/- 46ms 2024-09-12T12:30:20.933 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +1106us[+1119us] +/- 57ms 2024-09-12T12:30:20.933 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +647us[ +660us] +/- 74ms 2024-09-12T12:30:20.933 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:30:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T12:30:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-12T12:30:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 -1272us[-1272us] +/- 46ms 2024-09-12T12:30:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +1127us[+1127us] +/- 57ms 2024-09-12T12:30:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +679us[ +679us] +/- 74ms 2024-09-12T12:30:20.935 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T12:30:20.935 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T12:30:20.953 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T12:30:20.953 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T12:30:20.977 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:30:21.058 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:30:21.132 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T12:30:21.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:30:21.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:30:21.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:30:21.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:30:21.264 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T12:30:21.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:30:21.292 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T12:30:21.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T12:30:21.316 INFO:teuthology.task.internal:Duration was 1817.573185 seconds 2024-09-12T12:30:21.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T12:30:21.329 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T12:30:21.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:30:21.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:30:21.334 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T12:30:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:30:21.374 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:30:21.374 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T12:30:21.728 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T12:30:21.728 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-12T12:30:21.728 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:30:21.749 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T12:30:21.749 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:30:21.793 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-09-12T12:30:21.793 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T12:30:21.818 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T12:30:21.819 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:30:21.821 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:30:21.836 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T12:30:21.885 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T12:30:21.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:30:21.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:30:21.904 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T12:30:22.479 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T12:30:22.490 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T12:30:22.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:30:22.515 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:30:22.543 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T12:30:22.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T12:30:22.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:30:22.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:30:22.586 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:30:22.605 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-12T12:30:22.609 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-12T12:30:22.632 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-09-12T12:30:22.664 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:30:22.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:30:22.678 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:30:22.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:30:22.718 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T12:30:22.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T12:30:22.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T12:30:22.745 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T12:30:22.745 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi081 2024-09-12T12:30:22.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:30:22.793 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi103 2024-09-12T12:30:22.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:30:22.828 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901705/remote/smithi173 2024-09-12T12:30:22.829 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T12:30:22.866 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T12:30:22.866 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:30:22.869 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:30:22.871 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T12:30:22.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T12:30:22.928 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T12:30:22.928 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T12:30:22.939 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T12:30:22.939 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:30:22.942 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:30:22.944 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T12:30:22.954 INFO:teuthology.orchestra.run.smithi081.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:30 /home/ubuntu/cephtest 2024-09-12T12:30:22.957 INFO:teuthology.orchestra.run.smithi103.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:30 /home/ubuntu/cephtest 2024-09-12T12:30:22.970 INFO:teuthology.orchestra.run.smithi173.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 12:30 /home/ubuntu/cephtest 2024-09-12T12:30:22.971 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T12:30:22.982 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T12:30:23.010 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1817.5731852054596 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T12:30:23.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T12:30:23.104 INFO:teuthology.run:pass